llama GitHub repositories

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

★ 95.7K+86 todayPython

llm openai

unslothai/unsloth

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.

★ 78.6K+40 todayPython

hiyouga/LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

★ 75.7K+8 todayPython

mudler/LocalAI

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

★ 50.0K+25 todayGo

AstrBotDevs/AstrBot

AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. ✨

★ 44.2K+349 todayPython

lyogavin/airllm

AirLLM 2.8T LLM inference with single 4GB GPU

★ 41.0K+206 todayJupyter Notebook

llm open-source

sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

★ 38.3K+72 todayPython

llm deepseek

📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, DeepSeek, Perplexity, Gemini, Gemma, Llama, Grok, and more.

★ 29.0K+11 todayTypeScript

langchain4j/langchain4j

LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.

★ 13.3K+7 todayJava

llm openai

bentoml/OpenLLM

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

★ 12.6K+2 todayPython

dataelement/bisheng

BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.

★ 12.1K+2 todayPython

ludwig-ai/ludwig

Low-code framework for building custom LLMs, neural networks, and other AI models

oumi-ai/oumi

Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!

★ 9.4K+2 todayPython

llm agentic-ai

WangRongsheng/awesome-LLM-resources

🧑‍🚀 全世界最好的LLM资料总结（多模态生成、Agent、辅助编程、AI审稿、数据处理、模型训练、模型推理、o1 模型、MCP、小语言模型、视觉语言模型） | Summary of the world's best LLM resources.

★ 9.0K+2 todayUnknown

llm rag

AAswordman/Operit

The most powerful AI agent and AI chat software on Android/Operit是一款Android上能力最为强大、发展最久的AI Agent

★ 9.0K+30 todayKotlin

InternLM/lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

★ 8.1K+0 todayPython

arcee-ai/mergekit

Tools for merging pretrained large language models.

★ 7.4K+2 todayPython

mishushakov/llm-scraper

Turn any webpage into structured data using LLMs

★ 6.9K+0 todayTypeScript

lemonade-sdk/lemonade

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

★ 6.0K+6 todayC++

Michael-A-Kuykendall/shimmy

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

gpustack/gpustack

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

★ 5.9K+6 todayPython

llm openai

h2oai/h2o-llmstudio

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

★ 5.2K+0 todayPython

ModelTC/LightLLM

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

★ 4.3K+1 todayPython

llm deep-learning

raiyanyahya/how-to-train-your-gpt

Build a modern LLM from scratch. Every line commented. Explained like we are five.

★ 4.1K+6 todayJupyter Notebook

llm machine-learning

langroid/langroid

Harness LLMs with Multi-Agent Programming

★ 4.1K+0 todayPython

SciSharp/LLamaSharp

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

★ 3.8K+0 todayC#

llm gpt

johnbean393/Sidekick

A native macOS app that allows users to chat with a local LLM that can respond with information from files, folders and websites on your Mac without installing any other software. Powered by llama.cpp.

★ 3.3K+1 todaySwift

papersgpt/papersgpt-for-zotero

Professional AI research tool for Zotero: chat with PDFs, whole-library search, Literature Radar, AutoPilot. 30+ LLMs or local models; built-in MCP server.

★ 2.7K+1 todayJavaScript

ai mcp

stochasticai/xTuring

Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

★ 2.7K+1 todayPython

llm deep-learning

om-ai-lab/OmAgent

[EMNLP-2024] Build multimodal language agents for fast prototype and production

★ 2.7K+1 todayPython

llm agent

floneum/kalosm

Instant, controllable, local pre-trained AI models in Rust

★ 2.2K+0 todayRust

beelzebub-labs/beelzebub

A secure low code deception runtime framework, leveraging AI for System Virtualization.

withcatai/node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

★ 2.2K+1 todayTypeScript

ggml-org/llama.vim

Vim plugin for LLM-assisted code/text completion

★ 2.2K+0 todayVim Script

ROCm/FastFlowLM

Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.

★ 2.0K+4 todayC++

llm deepseek

kwaroran/Risuai

Make your own story. User-friendly software for LLM roleplaying

★ 1.8K+1 todayTypeScript

richardgill/llm-ui

The React library for LLMs

★ 1.7K+0 todayTypeScript

llm claude

tenstorrent/tt-metal

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

★ 1.7K+3 todayPython

UbiquitousLearning/mllm

Fast Multimodal LLM on Mobile Devices

★ 1.6K+2 todayC++

ggml-org/llama.vscode

VS Code extension for LLM-assisted code/text completion

★ 1.6K+0 todayTypeScript

awaescher/OllamaSharp

The easiest way to use Ollama in .NET

★ 1.4K+0 todayC#

explosion/spacy-llm

🦙 Integrating LLMs into structured NLP pipelines

★ 1.4K+0 todayPython

llm machine-learning

alibaba/rtp-llm

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

★ 1.4K+1 todayPython

llm gpt

ngxson/wllama

WebAssembly binding for llama.cpp - Enabling on-browser LLM inference

★ 1.4K+0 todayTypeScript

strands-agents/tools

A set of tools that gives agents powerful capabilities.

★ 1.3K+1 todayPython

datawhalechina/base-llm

从 NLP 到 LLM 的算法全栈教程，在线阅读地址：https://datawhalechina.github.io/base-llm/

★ 1.1K+2 todayJupyter Notebook

llm python

mybigday/llama.rn

React Native binding of llama.cpp

★ 1.1K+1 todayC

NVIDIA-NeMo/Automodel

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

★ 1.1K+3 todayPython

llm agent

machine-learning ai-agents

curiousily/AI-Bootcamp

Self-paced bootcamp on Generative AI. Tutorials on ML fundamentals, Ollama, LLMs, RAGs, LangChain, LangGraph, Fine-tuning, DSPy & AI Agents (CrewAI), (Using ChatGPT, gpt-oss, Claude, Qwen, Gemma, Llama, Gemini)

★ 955+0 todayJupyter Notebook