GitHub topic

evals GitHub repositories

Explore 14 tracked GitHub repositories tagged evals. Compare their recorded star activity and implementation languages, then follow related topics to find other projects.

Snapshot: 2026-10-28. The collection gained 393 stars since the previous daily snapshot.

Tracked repositories: 14
Total stars: 72,680
Stars gained · 7 days: +1,738
Stars gained · 30 days: +4,730

Compare star activity

Up to five projects on this page, ordered by total stars. Open a project for its description and recorded star history.

Swipe to compare all star periods →

Star activity for evals repositories on this page
Repository	Total stars	Today	7 days	30 days
mastra-ai/mastra	29.1K	+35	+171	+756
Arize-ai/phoenix	12.0K	+19	+106	+394
FailproofAI/failproofai	6.9K	+231	+884	+1,697
Kiln-AI/Kiln	5.2K	+1	+27	+122
ombharatiya/ai-system-design-guide	4.0K	+75	+307	+693

Explore repositories

Showing 1–14 of 14 tracked repositories.

mastra-ai/mastra

Mastra is the modern TypeScript framework for AI-powered applications and agents.

★ 29.1K+35 todayTypeScript

llm ai

View ↗

Arize-ai/phoenix

AI Observability & Evaluation

★ 12.0K+19 todayPython

agents openai

View ↗

FailproofAI/failproofai

Observability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy enforcement.

Kiln-AI/Kiln

Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

ombharatiya/ai-system-design-guide

AI system design guide for engineers building production AI systems and evals.

truera/trulens

Evaluation and Tracking for LLM Experiments and AI Agents

★ 3.6K+2 todayPython

machine-learning ai-agents

View ↗

lmnr-ai/lmnr

Laminar - open-source observability platform purpose-built for AI agents. YC S24.

★ 3.5K+6 todayTypeScript

ai agents

View ↗

ShenSeanChen/waku-agent

Waku Waku! Waku Agent is a local-first AI agent harness you actually own, including loop, memory, eval, all in code built to stay legible as it grows.

★ 2.1K+5 todayPython

llm claude

View ↗

LilMGenius/paperthin

Low-level agentic design patterns. Turning old engineering wisdom into reflexes your agent reaches for on its own—on any agent.

★ 1.4K+3 todayJavaScript

skills markdown

View ↗

heymrun/heym

Build agentic systems. Run them with confidence. Orchestrate agents, automate business processes, inspect every execution, and keep humans in control. Deploy Heym on your own infrastructure.

superlinear-ai/raglite

🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL

★ 1.2K+1 todayPython

llm rag

View ↗

benchflow-ai/awesome-evals

A curated, non-BS library of the best resources for building and evaluating AI agents — papers, blogs, talks, tools, benchmarks. Maintained by BenchFlow.

★ 1.0K+1 todayUnknown

llm ai-agents

View ↗

calmrocks/ai-engineer-notebooks

Hands-on, framework-free Colab notebooks for the AI Engineer / Forward Deployed Engineer (FDE) skill set — model APIs, structured output, tool calling, RAG, evals-as-the-spine, agents (loop from scratch, tool design, guardrails, MCP, Skills), fine-tuning vs LoRA, prompt-injection/security, LLMOps, and customer craft. Runs on the free Groq API.

★ 712+0 todayJupyter Notebook