← GitHub Trending

GitHub topic

llama-cpp GitHub repositories

Explore 20 tracked GitHub repositories tagged llama-cpp. Compare their recorded star activity and implementation languages, then follow related topics to find other projects.

Snapshot: 2026-10-28. The collection gained 126 stars since the previous daily snapshot.

Tracked repositories: 20
Total stars: 44,915
Stars gained · 7 days: +1,204
Stars gained · 30 days: +3,909

Compare star activity

Up to five projects on this page, ordered by total stars. Open a project for its description and recorded star history.

Swipe to compare all star periods →

Star activity for llama-cpp repositories on this page
Repository	Total stars	Today	7 days	30 days
xorbitsai/inference	9.6K	+2	+10	+36
Osmantic/ODS	7.7K	+3	+101	+837
SciSharp/LLamaSharp	3.8K	+0	+3	+15
AtomicBot-ai/atomic-agent	3.5K	+17	+37	+944
off-grid-ai/OGAM	3.3K	+10	+77	+116

Explore repositories

Showing 1–20 of 20 tracked repositories.

xorbitsai/inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

★ 9.6K+2 todayPython

llm machine-learning

Osmantic/ODS

ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.

★ 7.7K+3 todayPython

SciSharp/LLamaSharp

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

★ 3.8K+0 todayC#

AtomicBot-ai/atomic-agent

Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.

★ 3.5K+17 todayTypeScript

off-grid-ai/OGAM

The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.

antoinezambelli/forge

A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows

★ 2.3K+2 todayPython

withcatai/node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

★ 2.2K+1 todayTypeScript

Roy3838/Observer

Local Micro-Agents that monitor your screen, so you don't have to.

★ 1.7K+4 todayTypeScript

ai-agents agents

StartLuxLabs/StartLux-Decision

Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.

★ 1.6K+13 todayPython

ciddwd/overlay-translator

无需 ROOT 的开源 Android 屏幕实时翻译工具，适合游戏、视觉小说和漫画。支持端侧与云端 OCR、离线 LLM、多种翻译服务和文字朗读（TTS），译文可直接显示在画面上。Open-source no-root Android real-time screen translator for games, visual novels, and manga. Supports on-device and cloud OCR, offline LLMs, multiple translation services, on-screen translations, and text-to-speech (TTS).

docker/compose-for-agents

Build and run AI agents using Docker Compose. A collection of ready-to-use examples for orchestrating open-source LLMs, tools, and agent runtimes.

★ 1.1K+1 todayTypeScript

ai-agents self-hosted

mybigday/llama.rn

React Native binding of llama.cpp

★ 1.1K+1 todayC

kennss/SiliconScope

Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

★ 1.0K+1 todaySwift

OleksandrChekhovskyi/hax

A minimalist, terminal-native coding agent written in C.

★ 942+4 todayC

feder-cr/jev

jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.

cobanov/PS5LM

llama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8

★ 724+7 todayC++

Helldez/BigMoeOnEdge

Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.

★ 678+10 todayC++

timmyy123/LLM-Hub

Local LLM, image&video&music generator, run codex with local models on your phone

★ 625+2 todayC

sgaofen/humanizer-local-model

Rewrites AI drafts so they read like a person wrote them — runs locally, keeps the facts

★ 579+31 todayPython

llmmanorg/llmman

Run any agent on any model, models stored as OCI images

★ 572+1 todayRust

llm claude-code