C++ GitHub Trending – MakerRelay

OpenSparX/MasterAgent

Build AI agents that run 100% on-device. Sub-100ms latency on Qualcomm NPU. Zero cloud dependency.

★ 588+45 todayC++

llm ai-agent

machine-learning ai-agents

Fincept-Corporation/FinceptTerminal

FinceptTerminal is a modern finance application offering advanced market analytics, investment research, and economic data tools, designed for interactive exploration and data-driven decision-making in a user-friendly environment.

★ 33.2K+44 todayC++

VecSzn/PolyStrata

Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.

★ 574+33 todayC++

llm self-hosted

tensorflow/tensorflow

An Open Source Machine Learning Framework for Everyone

★ 201.3K+29 todayC++

machine-learning hacktoberfest

tesseract-ocr/tesseract

Tesseract Open Source OCR Engine (main repository)

★ 77.2K+24 todayC++

gufo-org/gufo

The Open Source Strix Halo AI engine. Qwen 3.8 Flash Next Q4_K_XL: 1,801.01 pp, 73.17 tg single user, 194.37 tok/s 8 users; Qwen 3.8 27B Q4_K_XL: 656.33pp, 70.56tg tok/s single user with DFlash2

★ 964+15 todayC++

llm amd

DamRsn/NeuralNote

Audio Plugin for Audio to MIDI transcription using deep learning.

★ 3.3K+12 todayC++

machine-learning audio

llm reinforcement-learning

kvcache-ai/Mooncake

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

★ 6.9K+12 todayC++

alibaba/MNN

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

★ 16.3K+12 todayC++

llm machine-learning

machine-learning deep-learning

google-ai-edge/mediapipe

Cross-platform, customizable ML solutions for live and streaming media.

★ 37.4K+10 todayC++

Helldez/BigMoeOnEdge

Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.

★ 678+10 todayC++

llm inference

lightgbm-org/LightGBM

A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.

★ 18.9K+10 todayC++

Likely7/Veyra-NRVideo

Bring PS5 GTA6 to 120FPS with DLSS 5. An advanced Windows video player and capture enhancement tool featuring real-time preview for videos, images, and capture card sources. Combine AI-powered Super Resolution, DLSS5 image enhancement, and Frame Generation to deliver a next-generation visual experience.

★ 873+9 todayC++

cobanov/PS5LM

llama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8

★ 724+7 todayC++

llm qwen

lemonade-sdk/lemonade

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

★ 6.0K+6 todayC++

machine-learning deep-learning

microsoft/onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

★ 22.2K+6 todayC++

TheAlgorithms/C-Plus-Plus

Collection of various algorithms in mathematics, machine learning, computer science and physics implemented in C++ for educational purposes.

★ 34.8K+6 todayC++

machine-learning cpp

alibaba/zvec

A lightweight, lightning-fast, in-process vector database

★ 16.2K+5 todayC++

rag agent-skills

oceanbase/seekdb

The AI-Native Search Database. Best for agent storage, it unifies vector, text, structured, and semi-structured data into a single engine. This all-in-one database makes agents smarter, easier to run, and more stable.

★ 3.2K+4 todayC++

ai-agents python

ROCm/FastFlowLM

Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.

★ 2.0K+4 todayC++

llm deepseek

catboost/catboost

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

★ 9.2K+4 todayC++

feder-cr/jev

jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.

ggml-org/ggml

Tensor library for machine learning

★ 15.5K+3 todayC++

machine-learning

machine-learning distributed-systems

dmlc/xgboost

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow

★ 28.9K+3 todayC++

isl-org/Open3D

Open3D: A Modern Library for 3D Data Processing

kevinpbuckley/VibeUE

Unreal Engine Vibe Coding tool

PaddlePaddle/Paddle

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

★ 24.1K+3 todayC++

invergent-ai/surogate

Train and serve LLMs at extreme speed and massive throughput.

★ 859+3 todayC++

llm deep-learning

hyperfield/ai-file-sorter

Cross-platform desktop application for content-aware file organization and renaming. Supports local and remote LLMs, preview-based workflows, and fully user-controlled changes.

★ 1.9K+2 todayC++

spotify/pedalboard

🎛 🔊 A Python library for audio.

★ 6.4K+2 todayC++

jmaczan/tiny-vllm

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

★ 1.2K+2 todayC++

iree-org/iree

A retargetable MLIR-based machine learning compiler and runtime toolkit.

★ 4.0K+2 todayC++

machine-learning pytorch

root-project/root

The official repository for ROOT: analyzing, storing and visualizing big data, scientifically

★ 3.3K+2 todayC++

uccl-project/uccl

UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)

★ 1.6K+2 todayC++

arcships/light-ocr

Fast, offline OCR for Node.js & C++. PP-OCRv6 with Core ML / WebGPU hardware acceleration — recognize text in images with confidence scores & coordinates. npm: @arcships/light-ocr

infiniflow/infinity

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.

RunanywhereAI/runanywhere-sdks

Production ready toolkit to run AI locally

★ 10.3K+2 todayC++

llm ollama

UbiquitousLearning/mllm

Fast Multimodal LLM on Mobile Devices

★ 1.6K+2 todayC++

hosseinmoein/DataFrame

C++ DataFrame for statistical, financial, and ML analysis in modern C++

★ 3.0K+2 todayC++

ai machine-learning

uxlfoundation/oneDNN

Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.

★ 4.1K+1 todayC++

llm deep-learning

b4rtaz/distributed-llama

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

★ 3.1K+1 todayC++

llm llms

pixie-io/pixie

Instant Kubernetes-Native Application Observability

★ 6.6K+1 todayC++

machine-learning golang

machine-learning video-processing

s60sc/ESP32-CAM_MJPEG2SD

ESP32 Camera motion capture application to record JPEGs to SD card as AVI files and stream to browser as MJPEG. If a microphone is installed then a WAV file is also created. Files can be uploaded via FTP or downloaded to browser.

★ 1.8K+1 todayC++

fabsig/GPBoost

Tree-Boosting, Gaussian Processes, and Mixed-Effects Models

★ 704+1 todayC++

spotify/voyager

🛰️ An approximate nearest-neighbor search library for Python and Java with a focus on ease of use, simplicity, and deployability.

★ 1.6K+1 todayC++

pbek/QOwnNotes

QOwnNotes is a plain-text file notepad and todo-list manager with Markdown support and Nextcloud / ownCloud integration.

NVIDIA/DALI

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

★ 5.8K+0 todayC++

machine-learning computer-vision

interpretml/interpret

Fit interpretable models. Explain blackbox machine learning.

stereolabs/zed-sdk

⚡️The spatial perception framework for rapidly building smart robots and spaces

★ 1.2K+0 todayC++