GitHub topic

inference-server GitHub repositories

Explore 7 tracked GitHub repositories tagged inference-server. Compare their recorded star activity and implementation languages, then follow related topics to find other projects.

Snapshot: 2026-10-28. The collection gained 38 stars since the previous daily snapshot.

Tracked repositories: 7
Total stars: 40,992
Stars gained · 7 days: +204
Stars gained · 30 days: +1,124

Compare star activity

Up to five projects on this page, ordered by total stars. Open a project for its description and recorded star history.

Swipe to compare all star periods →

Star activity for inference-server repositories on this page
Repository	Total stars	Today	7 days	30 days
jundot/omlx	23.1K	+34	+141	+798
Michael-A-Kuykendall/shimmy	6.0K	+2	+8	+89
superlinked/sie	3.5K	+0	+36	+122
containers/ramalama	3.1K	+0	+6	+32
roboflow/inference	2.5K	+2	+2	+24

Explore repositories

Showing 1–7 of 7 tracked repositories.

jundot/omlx

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

★ 23.1K+34 todayPython

llm macos

View ↗

Michael-A-Kuykendall/shimmy

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

superlinked/sie

Open-source inference server and production cluster for all the models your agent needs.

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

★ 3.1K+0 todayPython

llm ai

View ↗