llm GitHub repositories

zjunlp/LLMAgentPapers

Must-read Papers on LLM Agents.

★ 3.1K+1 todayUnknown

llm agents

b4rtaz/distributed-llama

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

★ 3.1K+2 todayC++

llm llms

Natively-AI-assistant/natively-cluely-ai-assistant

Natively — Free open-source AI meeting assistant, interview copilot, and note taker. The best alternative to Cluely, Otter, Granola, Final Round AI, Fireflies, and Interview Coder. Real-time transcription, AI meeting notes, lecture recording, local RAG, BYOK, and stealth mode. Runs locally. No subscriptions. No data breaches.

dwgx/WindsurfAPI

Turn Windsurf / Devin Desktop's 100+ AI models (Claude, GPT, Gemini, DeepSeek, Kimi, GLM, SWE) into OpenAI-, Anthropic- & Gemini-compatible APIs. Zero-dependency self-hosted reverse proxy for Claude Code, Cline & Cursor. 把 Windsurf/Devin 云端 100+ 模型变成三套兼容 API。

containers/ramalama

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

★ 3.1K+3 todayPython

MemMachine/MemMachine

Universal memory layer for AI Agents. It provides scalable, extensible, and interoperable memory storage and retrieval to streamline AI agent state management for next-generation autonomous systems.

★ 3.1K+0 todayPython

pinecone-io/examples

Jupyter Notebooks to help you get hands-on with Pinecone vector databases

★ 3.0K+0 todayJupyter Notebook

Simon-He95/markstream-vue

Multi-framework streaming Markdown renderers for AI apps: Vue/Nuxt, React/Next.js, Svelte, and Angular, with Mermaid, KaTeX, stream-diffs code blocks, safe HTML, and low-jitter updates.

★ 3.0K+1 todayVue

Prism-Shadow/penguin-harness

🐧 Unified and Stable RSI Platform

★ 3.0K+39 todayTypeScript

vllm-project/vllm-ascend

Community maintained hardware plugin for vLLM on Huawei Ascend

★ 3.0K+5 todayPython

llm mlops

rafska/awesome-local-llm

A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally

★ 3.0K+4 todayUnknown

Dicklesworthstone/llm_aided_ocr

Enhances Tesseract OCR output using LLMs (local or API) for error correction, smart chunking, and markdown formatting of scanned PDFs

★ 3.0K+0 todayPython

llm ocr

trymirai/uzu

A high-performance inference engine for AI models

★ 3.0K+143 todayRust

thu-pacman/chitu

High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

★ 3.0K+0 todayPython

llm pytorch

michaelfeil/infinity

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

★ 3.0K+2 todayRust

llm bert-embeddings

ax-llm/ax

The pretty much "official" DSPy framework for Typescript

★ 3.0K+1 todayTypeScript

OpenMind/OM1

Modular AI HAL (Hardware Abstraction Layer) for Robots

★ 3.0K+0 todayGo

llm robotics

zinja-coder/jadx-ai-mcp

Plugin for JADX to integrate MCP server

★ 2.9K+5 todayJava

qingchencloud/clawpanel

🦞 OpenClaw & Hermes Agent 多引擎 AI 管理面板 — 内置 AI 助手（工具调用 + 图片识别 + 多模态），一键安装 | Tauri v2 跨平台桌面应用 | 11 种语言

moltis-org/moltis

A secure persistent personal agent server in Rust. One binary, sandboxed execution, multi-provider LLMs, voice, memory, Telegram, WhatsApp, Discord, Teams, and MCP tools. Secure by design, runs on your hardware.

★ 2.9K+2 todayRust

PurpleDoubleD/locally-uncensored

The all-in-one local AI studio for your desktop: chat, image and video generation and a coding agent in one free, open source app. Windows and Linux. No Docker, no terminal, no cloud required.

codedogQBY/ReadAny

AI-powered cross-platform e-book reader with semantic search, RAG chat, local vector store, notes, TTS, and WebDAV sync.

★ 2.9K+3 todayTypeScript

jeremylongshore/tons-of-skills-marketplace

Model-agnostic agent-skills platform with a harness-free canonical layer, verified adapters, and the ccpi package manager. Explore at tonsofskills.com.

★ 2.9K+3 todayPython

sahibzada-allahyar/Formal-Verification-RSI

Formal verification for AI: a Lean 4 + Dafny proof checker that catches fake AI proofs (reward hacking), and verified recursive self-improvement (RSI) for coding agents. AI for math, physics and software engineering.

chrisryugj/kordoc

모두 파싱해버리겠다 — HWP·HWPX·PDF·Office 문서를 Markdown으로. 양식 자동 채우기와 신구대조를 갖춘 CLI·MCP 서버 | Convert Korean documents (HWP, HWPX, PDF, Office) to Markdown — CLI and MCP server with form filling and diff

★ 2.8K+16 todayTypeScript

NeptuneHub/AudioMuse-AI

AudioMuse-AI uses sonic analysis to rediscover forgotten songs, uncover hidden connections in your music library, and generate intelligent playlists for Navidrome, Jellyfin, LMS, Lyrion, Emby and Plex: no metadata or external services required.

★ 2.8K+7 todayPython

llm self-hosted

lightseekorg/tokenspeed

TokenSpeed is a speed-of-light LLM inference engine.

★ 2.8K+6 todayPython

llm deepseek

jgravelle/jcodemunch-mcp

Symbol-level code retrieval for AI agents: fetch the function you need, not the whole file. Runs locally. 96.2% fewer tokens per lookup than grep-and-read on our 15-lookup benchmark. Works with Claude Code, Cursor, Codex and any MCP client.

nano-muse/nanoMuse

nanoMuse: an open-source personal agent for every device you own. One agent with a name and a look of its own that does things, keeps working while the app is closed, remembers you, and asks before anything you cannot undo. On Android, iPhone and iPad, Windows / macOS / Linux and in the browser; your phone's screen and your computer as its hands.

★ 2.8K+76 todaySwift

opensolon/solon

🔥 Java enterprise application development framework for full scenario: Restrained, Efficient, Open, Ecologicalll!!! 700% higher concurrency 50% memory savings Startup is 10 times faster. Packing 90% smaller; Compatible with java8 ~ java26; Supports LTS. (Replaceable spring)

★ 2.8K+0 todayJava

llm openai

icereed/paperless-gpt

Use LLMs and LLM Vision (OCR) to handle paperless-ngx - Document Digitalization powered by AI

★ 2.8K+1 todayGo

postgres-ai/database-lab-engine

DBLab enables 🖖 database branching and ⚡️ thin cloning for any Postgres database and empowers DB testing in CI/CD. This optimizes database-related costs while improving time-to-market and software quality. Follow to stay updated.

iamsrikanthnani/pluely

The Open Source Alternative to Cluely - A lightning-fast, privacy-first AI assistant that works seamlessly during meetings, interviews, and conversations without anyone knowing. Built with Tauri for native performance, just 10MB. Completely undetectable in video calls, screen shares, and recordings.

★ 2.8K+3 todayTypeScript

llm claude

AienTech/dossier

A self-hosted job search app that writes tailored resumes and cover letters from your profile.

★ 2.7K+1,263 todayTypeScript

llm self-hosted

AMAP-ML/SkillClaw

Let Skills Evolve Collectively with Agentic Evolver

★ 2.7K+2 todayPython

llm agent

wassim249/fastapi-langgraph-agent-production-ready-template

A production-ready FastAPI template for building AI agent applications with LangGraph integration. This template provides a robust foundation for building scalable, secure, and maintainable AI agent services.

★ 2.7K+1 todayPython

llm agent

Pinvou/pinvou-agent

Open-source desktop AI agent for tools, files, knowledge, workflows, and real deliverables.

★ 2.7K+23 todayRust

brightdata/brightdata-mcp

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

★ 2.7K+2 todayJavaScript

llm ai-agents

stochasticai/xTuring

Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

★ 2.7K+0 todayPython

llm deep-learning

om-ai-lab/OmAgent

[EMNLP-2024] Build multimodal language agents for fast prototype and production

★ 2.7K+1 todayPython

llm agent

google/mantis

A modular, stack-agnostic toolkit for AI coding agents to autonomously find, reproduce, and patch vulnerabilities.

lobehub/lobe-icons

🥨 Lobe Icons - Brings AI/LLM brand logos to your React & React Native apps — static SVG/PNG/WebP, no dependencies.

★ 2.7K+4 todayTypeScript

nanaism/yomiyasu

AI生成の日本語を自然な日本語へ推敲するAgent Skill / Agent Skill for Refining AI-Generated Japanese into Natural Japanese

★ 2.7K+50 todayPython

llm claude-code

Zleap-AI/SAG

A new SOTA for RAG — an original retrieval architecture and an open-source knowledge base for humans and agents.

★ 2.6K+4 todayPython

openlake-project/openlake

OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

★ 2.6K+0 todayRust

llm gpt

llm large-language-models

Agent-Field/agentfield

Build, run and scale AI agents like API and microservices

MiniMax-AI/MiniMax-M2

MiniMax-M2, a model built for Max coding & agentic workflows.

★ 2.6K+0 todayUnknown

Exorust/TorchLeet

LeetCode for PyTorch — 65 ML/AI interview problems from real interviews at Google, Meta, Anthropic. Jupyter notebooks, an auto-grader, and an MCP AI tutor.

★ 2.6K+4 todayJupyter Notebook

llm deep-learning

lealone/Lealone

能安全适用于氛围编程和企业应用的全栈自进化通用智能体

★ 2.6K+0 todayJava