← GitHub Trending

GitHub topic

vllm GitHub repositories

Explore 28 tracked GitHub repositories tagged vllm. Compare their recorded star activity and implementation languages, then follow related topics to find other projects.

Snapshot: 2026-10-28. The collection gained 126 stars since the previous daily snapshot.

Tracked repositories: 28
Total stars: 112,922
Stars gained · 7 days: +1,502
Stars gained · 30 days: +7,876

Compare star activity

Up to five projects on this page, ordered by daily star growth. Open a project for its description and recorded star history.

Swipe to compare all star periods →

Star activity for vllm repositories on this page
Repository	Total stars	Today	7 days	30 days
Orchestra-Research/AI-Research-SKILLs	14.0K	+28	+247	+3,257
StartLuxLabs/StartLux-Decision	1.6K	+13	+635	+1,061
kvcache-ai/Mooncake	6.9K	+12	+51	+232
vllm-project/semantic-router	6.3K	+12	+50	+353
LMCache/LMCache	12.2K	+10	+56	+259

Explore repositories

Showing 1–28 of 28 tracked repositories.

Orchestra-Research/AI-Research-SKILLs

Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent with full horsepower. Maintained by Orchestra Research.

★ 14.0K+28 todayTeX

StartLuxLabs/StartLux-Decision

Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.

★ 1.6K+13 todayPython

kvcache-ai/Mooncake

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

★ 6.9K+12 todayC++

llm reinforcement-learning

vllm-project/semantic-router

An open, programmable decision layer for models and compute.

★ 6.3K+12 todayGo

LMCache/LMCache

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

★ 12.2K+10 todayPython

nokia-applied-research/AnyJev

Turn any LLM into a Jev-style decision model: typed decisions, real probabilities, no training. (continue updating, welcome any issue and PR request)

★ 1.5K+8 todayPython

llm transformers

gpustack/gpustack

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

★ 5.9K+6 todayPython

vllm-project/vllm-ascend

Community maintained hardware plugin for vLLM on Huawei Ascend

★ 3.0K+6 todayPython

XHToken/Spark-X2.6

Spark-x2.6 open model series. Pushing the Limits of Agentic Capabilities in On-Device Models

★ 860+5 todayUnknown

smg-project/smg

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

★ 687+5 todayRust

vllm-project/vllm-metal

Community maintained hardware plugin for vLLM on Apple Silicon

★ 1.9K+5 todayPython

ovg-project/kvcached

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

★ 2.0K+3 todayPython

pegainfer-project/pegainfer

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

★ 729+3 todayRust

kserve/kserve

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

jmaczan/tiny-vllm

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

★ 1.2K+2 todayC++

xorbitsai/inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

★ 9.6K+2 todayPython

llm machine-learning

pgalko/BambooAI

AI data analyst for transparent, reproducible analysis. Works step by step in Python, verifies the evidence behind its reports, and supports a wide selection of models, including local open-weight models.

★ 826+1 todayPython

skyzh/tiny-llm

learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen

★ 4.8K+1 todayPython

llmmanorg/llmman

Run any agent on any model, models stored as OCI images

★ 572+1 todayRust

llm claude-code

ome-projects/ome

Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

★ 521+1 todayGo

waybarrios/vllm-mlx

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

containers/ramalama

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

★ 3.1K+0 todayPython

whitecircle/halo

Halo is an open-source framework built by White Circle for training large language and multimodal models

jaylfc/taOS

Self-hosted AI agent OS. Your memory, chat, agents, and files stay on hardware you own, offline by default, cloud by choice. Offline AI memory (taOSmd), self-hosted multi-framework group chat, a full web desktop + app store, and auto-clustering across the consumer hardware you already have (Orange/Raspberry Pi, Mac mini, gaming PC).

OpenBMB/UltraRAG

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

★ 5.7K+0 todayPython

kubeai-project/kubeai

AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.

★ 1.3K+0 todayGo

halfrost/Halfrost-Field

✍🏻 Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field 冰霜之地：源码解析、系统设计与工程实践笔记

★ 13.3K+0 todayGo

llm machine-learning

katanaml/sparrow

Structured data extraction, instruction calling and agentic workflows with ML, LLM and Vision LLM

★ 5.2K+0 todayPython