GitHub topic

gguf GitHub repositories

Explore 20 tracked GitHub repositories tagged gguf. Compare their recorded star activity and implementation languages, then follow related topics to find other projects.

Snapshot: 2026-10-28. The collection gained 211 stars since the previous daily snapshot.

Tracked repositories: 20
Total stars: 79,710
Stars gained · 7 days: +1,759
Stars gained · 30 days: +7,351

Compare star activity

Up to five projects on this page, ordered by total stars. Open a project for its description and recorded star history.

Swipe to compare all star periods →

Star activity for gguf repositories on this page
Repository	Total stars	Today	7 days	30 days
AlexsJones/llmfit	38.4K	+23	+251	+1,208
MakazhanAlpamys/Soup	9.7K	+31	+246	+2,321
Michael-A-Kuykendall/shimmy	6.0K	+2	+8	+89
AtomicBot-ai/atomic-agent	3.5K	+17	+37	+944
off-grid-ai/OGAM	3.3K	+10	+77	+116

Explore repositories

Showing 1–20 of 20 tracked repositories.

AlexsJones/llmfit

Hundreds of models & providers. One command to find what runs on your hardware.

★ 38.4K+23 todayRust

llm skill

View ↗

MakazhanAlpamys/Soup

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

★ 9.7K+31 todayPython

llm machine-learning

View ↗

Michael-A-Kuykendall/shimmy

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

AtomicBot-ai/atomic-agent

Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.

★ 3.5K+17 todayTypeScript

llm mcp

View ↗

The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.

withcatai/node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

★ 2.2K+1 todayTypeScript

llm ai

View ↗

ddalcu/mlx-serve

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

AtomicBot-ai/Atomic-Chat

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V

★ 1.9K+4 todayTypeScript

llm mcp

View ↗

sammcj/gollama

Go manage your Ollama models

★ 1.8K+0 todayGo

llm ai

View ↗

nobodywho-ooo/nobodywho

NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

★ 1.7K+5 todayRust

llm ai

View ↗

StartLuxLabs/StartLux-Decision

Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.

★ 1.6K+13 todayPython

llm agents

View ↗

kitops-ml/kitops

An open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.

ciddwd/overlay-translator

无需 ROOT 的开源 Android 屏幕实时翻译工具，适合游戏、视觉小说和漫画。支持端侧与云端 OCR、离线 LLM、多种翻译服务和文字朗读（TTS），译文可直接显示在画面上。Open-source no-root Android real-time screen translator for games, visual novels, and manga. Supports on-device and cloud OCR, offline LLMs, multiple translation services, on-screen translations, and text-to-speech (TTS).

jegly/Box

The most advanced, fully offline client-side AI suite on Android today.

feder-cr/jev

jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.

Helldez/BigMoeOnEdge

Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.

★ 678+10 todayC++

llm inference

View ↗

hybridgroup/yzma

Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.

★ 661+0 todayGo

llm llama

View ↗

zhongkaifu/TensorSharp

A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability

★ 632+2 todayC#

llm ai

View ↗

sgaofen/humanizer-local-model

Rewrites AI drafts so they read like a person wrote them — runs locally, keeps the facts

★ 579+31 todayPython

llm local-llm

View ↗

VecSzn/PolyStrata

Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.

★ 574+33 todayC++

llm self-hosted

View ↗

gguf GitHub repositories

Compare star activity

Explore repositories

AlexsJones/llmfit

MakazhanAlpamys/Soup

Michael-A-Kuykendall/shimmy

AtomicBot-ai/atomic-agent

off-grid-ai/OGAM

withcatai/node-llama-cpp

ddalcu/mlx-serve

AtomicBot-ai/Atomic-Chat

sammcj/gollama

nobodywho-ooo/nobodywho

StartLuxLabs/StartLux-Decision

kitops-ml/kitops

ciddwd/overlay-translator

jegly/Box

feder-cr/jev

Helldez/BigMoeOnEdge

hybridgroup/yzma

zhongkaifu/TensorSharp

sgaofen/humanizer-local-model

VecSzn/PolyStrata

Sign in to continue

Loading

Account settings

Delete listing?