kubernetes GitHub repositories

Infisical/infisical

Infisical is the open-source platform for securing secrets, certificates, access, and AI Agents.

agentgateway/agentgateway

Next Generation Agentic Proxy for AI Agents and MCP servers

★ 5.7K+18 todayRust

ai mcp

llm-d/llm-d

State of the art inference performance with modern accelerators on Kubernetes

★ 5.1K+18 todayPython

vllm-project/semantic-router

An open, programmable decision layer for models and compute.

★ 6.3K+12 todayGo

llm pytorch

theagentrouter/agent-router

Manages Unified Access to Generative AI Services built on Envoy Gateway

★ 2.3K+7 todayGo

AudioMuse-AI uses sonic analysis to rediscover forgotten songs, uncover hidden connections in your music library, and generate intelligent playlists for Navidrome, Jellyfin, LMS, Lyrion, Emby and Plex: no metadata or external services required.

★ 2.8K+7 todayPython

llm self-hosted

IBM/mcp-context-forge

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

DataTalksClub/machine-learning-zoomcamp

Learn ML engineering for free in 4 months! Register here 👇🏼

★ 14.9K+5 todayJupyter Notebook

machine-learning pytorch

ToolJet/ToolJet

Open-source foundation of ToolJet AI - the enterprise app generation platform for internal tools, dashboards, business applications, workflows and AI agents. Build visually, from a prompt, or from Claude Code, Codex and Cursor over MCP 🚀

★ 41.1K+4 todayHTML

typescript self-hosted

machine-learning hacktoberfest

argoproj/argo-workflows

Workflow Engine for Kubernetes

★ 17.1K+4 todayGo

ongridio/ongrid

An ops AI Agent that understands your infrastructure, finds the root cause, and fixes it — right from Slack, Telegram, Lark or DingTalk.

★ 1.2K+3 todayGo

llm ai-agents

ASCIT31/Dark-Moon

Open-source autonomous AI penetration testing. 50 specialist agents across web, API, cloud, Active Directory, Kubernetes, CI/CD and AI/LLM (OWASP LLM Top 10). Runs on a local LLM behind a Privacy Gateway. Integrates with GitHub, GitLab, Jenkins, VS Code, JetBrains, n8n, Grafana & Splunk.

alibaba/nacos

an easy-to-use dynamic service discovery, configuration and service management platform for building AI cloud native applications.

★ 33.5K+3 todayJava

mcp agent

volcano-sh/volcano

A Cloud Native Batch System (Project under CNCF)

★ 6.0K+3 todayGo

machine-learning deepseek

data-infra/cube-studio

cubestudio开源云原生一站式机器学习/深度学习/大模型AI平台/MaaS/mlops/人工智能平台/训推平台，算法全链路流程，多租户，算力租赁平台，token中转，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务，VGPU虚拟化，云边端协同，边缘计算，自动化标注平台，deepseek等大模型sft微调/奖励模型/强化学习训练，vllm/ollama/mindie大模型多机推理，私有知识库llmops智能体，AI模型市场，支持国产异构算力调度,昇腾/寒武纪/海光/摩尔/沐曦等，支持ib/roce/RDMA，信创支持

★ 2.6K+3 todayPython

Agent-Field/agentfield

Build, run and scale AI agents like API and microservices

metalbear-co/mirrord

Run any process, on your machine or in an AI agent's environment, as if it were a pod in your Kubernetes cluster: real env vars, DNS, network, traffic.

★ 5.4K+3 todayRust

ai-agents claude-code

oracle-devrel/oracle-ai-developer-hub

Technical resources for AI developers to build applications, agents, and systems using Oracle AI Database and OCI services

★ 4.5K+3 todayJupyter Notebook

ai agents

jonwiggins/optio

Workflow orchestration for AI agent swarms.

★ 1.1K+3 todayTypeScript

ai claude-code

kserve/kserve

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

kubeflow/kubeflow

The Cloud Native AI Platform

★ 15.9K+2 todayUnknown

machine-learning deep-learning

kuberay-project/kuberay

A toolkit to run Ray applications on Kubernetes

★ 2.8K+2 todayGo

Netflix/metaflow

Build, Manage and Deploy AI/ML Systems

kubeflow/trainer

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

★ 2.3K+2 todayGo

deepflowio/deepflow

eBPF Observability - Distributed Tracing and Profiling

★ 4.3K+2 todayGo

llm kubernetes

recommenders-team/recommenders

Best Practices on Recommendation Systems

★ 22.0K+1 todayPython

microsoft/mcp-gateway

MCP Gateway is a reverse proxy and management layer for MCP servers, enabling scalable, session-aware stateful routing and lifecycle management of MCP servers in Kubernetes environments.

★ 898+1 todayC#

machine-learning agent-skills

dstackai/dstack

A unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU clouds, Kubernetes, VMs, or bare-metal clusters.

★ 2.3K+1 todayPython

openeverest/openeverest

OpenEverest is an open-source platform for automated database, storage and LLMs provisioning and management. It supports multiple technologies and can be hosted on any Kubernetes infrastructure, in the cloud or on-premises.

★ 956+1 todayTypeScript

llm open-source

kitops-ml/kitops

An open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.

pixie-io/pixie

Instant Kubernetes-Native Application Observability

★ 6.6K+1 todayC++

machine-learning golang

machine-learning data-science

kubeflow/pipelines

Machine Learning Pipelines for Kubeflow

★ 4.3K+0 todayPython

kubeai-project/kubeai

AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.

★ 1.3K+0 todayGo

kubewall/kubewall

kubewall - Kubernetes Dashboard for Multi-Cluster Management Real-Time, Self-Hosted, Single Binary, AI-powered. Manage, monitor & debug K8s clusters in your browser, no cloud, no agents.

TykTechnologies/tyk

Open Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol)

★ 10.9K+0 todayGo

ramitsurana/awesome-kubernetes

A curated list for awesome kubernetes sources :ship::tada:

★ 16.1K+0 todayShell

machine-learning docker

Katakate/k7

Your own self-hosted infra for lightweight VM sandboxes to safely execute untrusted code. CLI, API, Python SDK. ⭐ Star it if you like it! ⭐

★ 824+0 todayPython

agents self-hosted

machine-learning deep-learning

metarank/metarank

A low code Machine Learning personalized ranking service for articles, listings, search results, recommendations that boosts user engagement. A friendly Learn-to-Rank engine

★ 2.5K+0 todayScala

machine-learning kubernetes

argoproj-labs/hera

Hera makes Python code easy to orchestrate on Argo Workflows through native Python integrations. It lets you construct and submit your Workflows entirely in Python. ⭐️ Remember to star!

★ 947+0 todayPython

OWASP/wrongsecrets

Vulnerable app with examples showing how to not use secrets

kubeflow/katib

Automated Machine Learning on Kubernetes

★ 1.7K+0 todayPython

openvinotoolkit/model_server

A scalable inference server for models optimized with OpenVINO™

★ 952+0 todayC++

machine-learning data-science

polyaxon/polyaxon

AI Infra / AI Orchestration / AI Control Plane

mlrun/mlrun

MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.

★ 1.7K+0 todayPython

kaito-project/aikit

🏗️ Fine-tune, build, and deploy open-source LLMs easily!

★ 539+0 todayGo

nudgebee/nudgebee

Open-source agentic ops platform for cloud, SRE, DevOps, support and FinOps teams. AI agents investigate incidents, cut cloud and Kubernetes waste and run approval-gated runbooks across Kubernetes, AWS, Azure, GCP and your databases. Self-hosted, bring your own models.

★ 520+0 todayGo

llm ai-agents