← GitHub Trending

GitHub topic

local-llm GitHub repositories

Explore 40 tracked GitHub repositories tagged local-llm. Compare their recorded star activity and implementation languages, then follow related topics to find other projects.

Snapshot: 2026-10-28. The collection gained 1,492 stars since the previous daily snapshot.

Tracked repositories: 40
Total stars: 124,542
Stars gained · 7 days: +3,892
Stars gained · 30 days: +10,801

Compare star activity

Up to five projects on this page, ordered by total stars. Open a project for its description and recorded star history.

Swipe to compare all star periods →

Star activity for local-llm repositories on this page
Repository	Total stars	Today	7 days	30 days
HKUDS/nanobot	49.5K	+97	+693	+900
MakazhanAlpamys/Soup	9.7K	+31	+246	+2,321
open-multi-agent/open-multi-agent	7.0K	+1	+17	+66
maziyarpanahi/openmed	5.7K	+5	+20	+299
langroid/langroid	4.1K	+0	+0	+16

Explore repositories

Showing 1–40 of 40 tracked repositories.

HKUDS/nanobot

Ultra-lightweight, open-source, self-hosted personal AI agent framework in Python with WebUI, tools, memory, MCP, multi-agent workflows, automation, and chat apps

MakazhanAlpamys/Soup

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

★ 9.7K+31 todayPython

llm machine-learning

open-multi-agent/open-multi-agent

Self-hosted TypeScript agent runtime with durable approvals and verifiable run records. Own it, approve it, audit it.

★ 7.0K+1 todayTypeScript

maziyarpanahi/openmed

Local-first healthcare AI: clinical NER and HIPAA PII de-identification on hardware you control. 2,200+ medical models, 35 model-backed PII languages, and Python, MLX, Android and browser runtimes. Apache-2.0 SDK.

★ 5.7K+5 todayPython

langroid/langroid

Harness LLMs with Multi-Agent Programming

★ 4.1K+0 todayPython

AtomicBot-ai/atomic-agent

Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.

★ 3.5K+17 todayTypeScript

rafska/awesome-local-llm

A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally

★ 3.0K+4 todayUnknown

PurpleDoubleD/locally-uncensored

The all-in-one local AI studio for your desktop: chat, image and video generation and a coding agent in one free, open source app. Windows and Linux. No Docker, no terminal, no cloud required.

papersgpt/papersgpt-for-zotero

Professional AI research tool for Zotero: chat with PDFs, whole-library search, Literature Radar, AutoPilot. 30+ LLMs or local models; built-in MCP server.

★ 2.7K+1 todayJavaScript

ddalcu/mlx-serve

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

inferstep/ATLAS

Adaptive Test-time Learning and Autonomous Specialization

★ 2.1K+1 todayPython

llm developer-tools

mw00/project-maya

Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.

★ 2.1K+100 todayCuda

llm self-hosted

AtomicBot-ai/Atomic-Chat

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V

★ 1.9K+4 todayTypeScript

siddsachar/row-bot

Row-Bot - Personal AI Sovereignty. A local-first AI assistant with integrated tools, a personal knowledge graph, voice, vision, shell, browser automation, scheduled tasks, health tracking, and messaging channels. Run locally via Ollama or add opt-in cloud models. Your data stays on your machine.

★ 1.7K+0 todayPython

ollama langchain

Roy3838/Observer

Local Micro-Agents that monitor your screen, so you don't have to.

★ 1.7K+4 todayTypeScript

ai-agents agents

nobodywho-ooo/nobodywho

NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

★ 1.7K+5 todayRust

waybarrios/vllm-mlx

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

razzant/ouroboros

Ouroboros — self-creating AI agent. Born Feb 16, 2026.

najmuzzaman-mohammad/gawkbot

open source grok bot. gawk bots automate your menial work via AI models and build you microapps to manage the outcome, so that you have a false sense of control.

★ 1.5K+0 todayGo

ai-agents claude-code

AienTech/dossier

A self-hosted job search app that writes tailored resumes and cover letters from your profile.

★ 1.5K+950 todayTypeScript

llm self-hosted

obsei/obsei

Open source, privacy-first Voice of Customer analytics. A self-hosted alternative to Enterpret and Unwrap that strips PII from feedback before any LLM sees it.

HelgeSverre/ollama-gui

A Web Interface for chatting with your local LLMs via the ollama API

★ 1.3K+1 todayTypeScript

ASCIT31/Dark-Moon

Open-source autonomous AI penetration testing. 50 specialist agents across web, API, cloud, Active Directory, Kubernetes, CI/CD and AI/LLM (OWASP LLM Top 10). Runs on a local LLM behind a Privacy Gateway. Integrates with GitHub, GitLab, Jenkins, VS Code, JetBrains, n8n, Grafana & Splunk.

peonist-ai/halogen-flash-server

Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.

★ 1.1K+12 todayShell

DasterProkio/awesome-ai-companion

Open-source AI companions, desktop pets, long-term memory & proactive chat. 人机恋开源项目大全。让你的家机能够脱离官端自主存在，拥有记忆和主动性。

kennss/SiliconScope

Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

★ 1.0K+1 todaySwift

kossakovsky/selfhost-ai

One-command installer for a self-hosted AI stack on your own server: n8n, Ollama, Open WebUI, OpenClaw, Dify, Flowise, Supabase, ComfyUI, Qdrant & 30+ tools. Docker Compose, automatic HTTPS via Caddy, built-in monitoring. Free Zapier/Make alternative.

jegly/Box

The most advanced, fully offline client-side AI suite on Android today.

OleksandrChekhovskyi/hax

A minimalist, terminal-native coding agent written in C.

★ 942+4 todayC

feder-cr/jev

jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.

IncarnaMind/IncarnaMind

From messy files to a checked report. A free, open-source desktop app for macOS, Windows and Linux: write and analyse with AI from your own files, check each sentence and figure against them, and export to Word. Meeting notes too. Works with ChatGPT, Claude, Gemini or a local model through Ollama.

jonigl/mcp-client-for-ollama

Harness the power of local LLMs with this TUI MCP Client for Ollama. Featuring all core MCP primitives (tools, prompts, resources), agent mode, multi-server, model switching, streaming responses, human-in-the-loop, thinking mode, model params config, system prompts, and saved preferences.

Nehanth/pooled

Peer-to-peer LLM inference in the browser: pool your devices to run big open models, for chat and coding agents.

★ 616+2 todayJavaScript

carloslfu/slotstream

Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.

★ 595+24 todaySwift

llm claude-code

heider-x/vela

AI-powered IDE for novel writing — local LLM + RAG, privacy-first, BYOK. For web fiction authors and creative writers.

★ 584+1 todayTypeScript

NightMean/OlliteRT

Turn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source

★ 583+4 todayKotlin

llm llm-inference

jaylfc/taOS

Self-hosted AI agent OS. Your memory, chat, agents, and files stay on hardware you own, offline by default, cloud by choice. Offline AI memory (taOSmd), self-hosted multi-framework group chat, a full web desktop + app store, and auto-clustering across the consumer hardware you already have (Orange/Raspberry Pi, Mac mini, gaming PC).

sgaofen/humanizer-local-model

Rewrites AI drafts so they read like a person wrote them — runs locally, keeps the facts

★ 579+31 todayPython

VecSzn/PolyStrata

Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.

★ 574+33 todayC++

llm self-hosted

ibrahimcetin/reins

Local AI chat for iPhone, iPad and Mac. Connect Ollama, LM Studio or any OpenAI-compatible server, or run MLX models on-device. Includes tools and web search.

★ 556+0 todayDart