gpu GitHub repositories

deepspeedai/DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

★ 43.3K+0 todayPython

isl-org/Open3D

Open3D: A Modern Library for 3D Data Processing

apache/tvm

Open Machine Learning Compiler Framework

★ 13.9K+3 todayPython

triton-inference-server/server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

★ 11.1K+2 todayPython

skypilot-org/skypilot

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

★ 9.2K+4 todayC++

machine-learning python

h2oai/h2o-3

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

bojieli/ai-infra-book

《深入理解 AI Infra：量化分析与系统设计》（李博杰著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验

★ 7.1K+44 todayPython

llm deepseek

lemonade-sdk/lemonade

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

★ 6.0K+6 todayC++

NVIDIA/DALI

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

★ 5.8K+0 todayC++

machine-learning python

NVIDIA/cuml

NVIDIA cuML: GPU-Accelerated Machine Learning

★ 5.3K+1 todayPython

machine-learning gpu

pytorch/executorch

On-device AI across mobile, embedded and edge for PyTorch

★ 5.1K+4 todayPython

llm-d/llm-d

State of the art inference performance with modern accelerators on Kubernetes

★ 5.1K+18 todayPython

sktime/pytorch-forecasting

Time series forecasting with PyTorch

★ 5.0K+0 todayPython

ai machine-learning

deepflowio/deepflow

eBPF Observability - Distributed Tracing and Profiling

★ 4.3K+2 todayGo

llm kubernetes

NVIDIA/TransformerEngine

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.

★ 3.6K+4 todayPython

heavyai/heavydb

HeavyDB (formerly MapD/OmniSciDB)

★ 3.1K+0 todayC++

machine-learning gpu

thu-pacman/chitu

High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

★ 3.0K+1 todayPython

llm pytorch

leptonai/leptonai

A Pythonic framework to simplify AI service building

★ 2.8K+0 todayPython

CVCUDA/CV-CUDA

CV-CUDA™ is an open-source, GPU accelerated library for cloud-scale image processing and computer vision.

★ 2.7K+0 todayC++

machine-learning python

openlake-project/openlake

OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

★ 2.6K+0 todayRust

llm gpt

jolibrain/deepdetect

Deep Learning Server and CLI for Torch and TensorRT

★ 2.6K+0 todayC++

machine-learning agent-skills

dstackai/dstack

A unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU clouds, Kubernetes, VMs, or bare-metal clusters.

★ 2.3K+1 todayPython

kubeflow/trainer

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

★ 2.3K+2 todayGo

withcatai/node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

★ 2.2K+1 todayTypeScript

beam-cloud/beta9

Ultrafast serverless GPU inference, sandboxes, and background jobs

★ 1.8K+3 todayGo

llm self-hosted

tenstorrent/tt-metal

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

★ 1.7K+3 todayPython

uccl-project/uccl

UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)

★ 1.6K+2 todayC++

CliMA/Oceananigans.jl

🌊 Julia software for fast, friendly, flexible, ocean-flavored fluid dynamics on CPUs and GPUs

★ 1.4K+0 todayJulia

machine-learning gpu

machine-learning hacktoberfest

uxlfoundation/scikit-learn-intelex

Extension for Scikit-learn is a seamless way to speed up your Scikit-learn application

★ 1.4K+0 todayPython

modal-labs/modal-examples

Examples of programs built using Modal

★ 1.3K+2 todayPython

machine-learning pytorch

NVIDIA/raft

RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.

kennss/SiliconScope

Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

★ 1.0K+1 todaySwift

llm ollama

mosecorg/mosec

A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine

★ 902+0 todayPython

llm machine-learning

NVIDIA-BioNeMo/bionemo-recipes

BioNeMo Recipes: For building and adapting AI models in drug discovery at scale

★ 878+0 todayPython

machine-learning pytorch

NVIDIA/cuvs

cuVS - a library for vector search and clustering on the GPU

★ 877+3 todayCuda

llm machine-learning

machine-learning neural-network

brucefan1983/GPUMD

Graphics Processing Units Molecular Dynamics

★ 859+0 todayCuda

zszazi/Deep-learning-in-cloud

List of Deep Learning Cloud Providers

★ 827+1 todayUnknown

jasmcaus/caer

High-performance Vision library in Python. Scale your research, not boilerplate.

DaoyuanLi2816/can-i-finetune-this

Single-GPU LLM fine-tuning preflight: memory estimates, runnable LoRA/QLoRA recipes, and local measurements.

★ 794+0 todayPython

llm pytorch

LuxDL/Lux.jl

Elegant and Performant Deep Learning

★ 738+1 todayJulia

baidu-baige/LoongForge

A high-performance framework for training LLMs, VLMs, diffusion, and embodied models on NVIDIA GPUs and Kunlun XPUs. Supports Pi0.5, GR00T-N1.7, FastWAM, Cosmos3, DreamZero, DeepSeek-V4, GLM-5.3, Kimi-K3 and more.

★ 732+4 todayPython

llm gpu

pegainfer-project/pegainfer

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

★ 729+3 todayRust

llm deepseek