← GitHub Trending

GitHub topic

llmops GitHub repositories

Explore 43 tracked GitHub repositories tagged llmops. Compare their recorded star activity and implementation languages, then follow related topics to find other projects.

Snapshot: 2026-10-28. The collection gained 421 stars since the previous daily snapshot.

Tracked repositories: 43
Total stars: 405,977
Stars gained · 7 days: +2,688
Stars gained · 30 days: +12,395

Compare star activity

Up to five projects on this page, ordered by total stars. Open a project for its description and recorded star history.

Swipe to compare all star periods →

Star activity for llmops repositories on this page
Repository	Total stars	Today	7 days	30 days
BerriAI/litellm	62.2K	+98	+511	+2,448
langfuse/langfuse	36.6K	+74	+516	+1,504
ComposioHQ/composio	30.8K	+8	+121	+439
mlflow/mlflow	28.6K	+17	+93	+409
promptfoo/promptfoo	26.5K	+44	+314	+1,013

Explore repositories

Showing 1–43 of 43 tracked repositories.

BerriAI/litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

★ 62.2K+98 todayPython

langfuse/langfuse

🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.

ComposioHQ/composio

Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.

★ 30.8K+8 todayTypeScript

mlflow/mlflow

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

★ 28.6K+17 todayPython

ai machine-learning

promptfoo/promptfoo

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

★ 26.5K+44 todayTypeScript

liguodongiot/llm-action

本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

★ 25.2K+1 todayHTML

llm llm-inference

comet-ml/opik

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

★ 23.0K+27 todayPython

dipakkr/awesome-ai-engineering

🚀 A curated collection of AI engineering resources, roadmaps, tools, and projects covering LLMs, RAG, AI Agents, MCP, fine-tuning, evaluations, and production AI systems.

bentoml/OpenLLM

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

★ 12.6K+2 todayPython

dataelement/bisheng

BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.

★ 12.1K+2 todayPython

Arize-ai/phoenix

AI Observability & Evaluation

★ 12.0K+19 todayPython

Netflix/metaflow

Build, Manage and Deploy AI/ML Systems

MakazhanAlpamys/Soup

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

★ 9.7K+31 todayPython

llm machine-learning

0xPlaygrounds/rig

⚙️🦀 Build modular and scalable LLM Applications in Rust

★ 9.0K+14 todayRust

bentoml/BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

★ 8.9K+2 todayPython

llm machine-learning

evidentlyai/evidently

Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

★ 8.0K+4 todayJupyter Notebook

llm machine-learning

traceloop/openllmetry

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

★ 7.5K+2 todayPython

llm open-source

clearml/clearml

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

★ 6.9K+0 todayPython

ai machine-learning

Helicone/helicone

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

Giskard-AI/giskard-oss

🐢 Open-Source Evaluation & Testing library for LLM Agents

★ 5.9K+6 todayPython

zenml-io/zenml

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

langwatch/langwatch

Open-Source Agent Observability & Evals for AI Platform teams. Trace, test, route and govern every agent & coding assistant in the company.

★ 5.0K+3 todayTypeScript

truera/trulens

Evaluation and Tracking for LLM Experiments and AI Agents

★ 3.6K+2 todayPython

machine-learning ai-agents

lmnr-ai/lmnr

Laminar - open-source observability platform purpose-built for AI agents. YC S24.

★ 3.5K+6 todayTypeScript

vllm-project/vllm-ascend

Community maintained hardware plugin for vLLM on Huawei Ascend

★ 3.0K+6 todayPython

apache/hamilton

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

data-infra/cube-studio

cubestudio开源云原生一站式机器学习/深度学习/大模型AI平台/MaaS/mlops/人工智能平台/训推平台，算法全链路流程，多租户，算力租赁平台，token中转，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务，VGPU虚拟化，云边端协同，边缘计算，自动化标注平台，deepseek等大模型sft微调/奖励模型/强化学习训练，vllm/ollama/mindie大模型多机推理，私有知识库llmops智能体，AI模型市场，支持国产异构算力调度,昇腾/寒武纪/海光/摩尔/沐曦等，支持ib/roce/RDMA，信创支持

★ 2.6K+3 todayPython

machine-learning deepseek

ShenSeanChen/waku-agent

Waku Waku! Waku Agent is a local-first AI agent harness you actually own, including loop, memory, eval, all in code built to stay legible as it grows.

★ 2.1K+5 todayPython

intentee/paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

★ 1.7K+1 todayRust

alibaba/rtp-llm

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

★ 1.4K+1 todayPython

jwuthri-cloud/Tracely-ai

Trace-native CI/CD for AI agents: grade production traces, cluster failures, freeze them into replayable regression tests, and block PRs that regress. Self-hostable.

★ 1.2K+12 todayPython

dynamiq-ai/dynamiq

Dynamiq is an orchestration framework for agentic AI and LLM applications

★ 1.1K+0 todayPython

santifer/cv-santiago

Interactive CV with AI chat integration. Built with React 19, TypeScript, Claude API. Chat with my AI avatar about my experience.

★ 858+1 todayHTML

bosun-ai/swiftide

Fast, streaming indexing, query, and agentic LLM applications in Rust

★ 796+0 todayRust

iblai/os

Enables organizations to create and deploy customizable AI agents with support for multiple LLM providers, real-time chat, voice, document training, analytics, user management, SSO authentication, and embeddable widgets. Built with React 19, Redux Toolkit, Radix UI, and Tailwind CSS.

Haohao-end/openagent

What if OpenAI Deep Research and Dify were one platform? OpenAgent — harness architecture for rapidly building vertical AI agents, with deep reasoning loops, visual workflows, RAG, and A2A delegation.

★ 774+0 todayPython

mikehasa/agentacct

See what your coding agents did and what it cost. Breaks each task down into work steps — tools used, files changed, tests run, time and tokens spent. Local-first dashboard for Claude Code, Codex, OpenCode, and more. No login, no telemetry.

★ 756+0 todayPython

mozilla-ai/otari

Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

★ 744+4 todayPython

calmrocks/ai-engineer-notebooks

Hands-on, framework-free Colab notebooks for the AI Engineer / Forward Deployed Engineer (FDE) skill set — model APIs, structured output, tool calling, RAG, evals-as-the-spine, agents (loop from scratch, tool design, guardrails, MCP, Skills), fine-tuning vs LoRA, prompt-injection/security, LLMOps, and customer craft. Runs on the free Groq API.

★ 712+0 todayJupyter Notebook

Abilityai/trinity

Self-hosted AI Agents Platform for AI Native companies. Claude Code, Codex, Gemini, OpenCode agents. Apache 2.0.

overmind-core/overmind

The platform for continuously improving AI agents.

★ 703+14 todayPython

Fast-Editor/Lynkr

Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions using Claude Code CLI.

superlinked/VectorHub

Deprecated historical repo. Superlinked now develops SIE, a self-hosted inference engine for embeddings, reranking, OCR, extraction, and document processing.

★ 533+0 todayJupyter Notebook