GitHub topic

quantization GitHub repositories

Explore 16 tracked GitHub repositories tagged quantization. Compare their recorded star activity and implementation languages, then follow related topics to find other projects.

Snapshot: 2026-10-28. The collection gained 133 stars since the previous daily snapshot.

Tracked repositories: 16
Total stars: 130,685
Stars gained · 7 days: +1,208
Stars gained · 30 days: +3,475

Compare star activity

Up to five projects on this page, ordered by daily star growth. Open a project for its description and recorded star history.

Swipe to compare all star periods →

Star activity for quantization repositories on this page
Repository	Total stars	Today	7 days	30 days
mw00/project-maya	2.1K	+100	+807	+1,340
FareedKhan-dev/kimi-k3-in-c	9.2K	+10	+71	+481
hiyouga/LlamaFactory	75.7K	+8	+145	+657
amitshekhariitbhu/ai-engineering-interview-questions	3.6K	+4	+78	+360
RyanCodrai/turbovec	17.4K	+2	+24	+180

Explore repositories

Showing 1–16 of 16 tracked repositories.

mw00/project-maya

Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.

★ 2.1K+100 todayCuda

llm self-hosted

View ↗

FareedKhan-dev/kimi-k3-in-c

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

hiyouga/LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

★ 75.7K+8 todayPython

llm ai

View ↗

amitshekhariitbhu/ai-engineering-interview-questions

Your Cheat Sheet for AI Engineering Interview – Questions and Answers.

★ 3.6K+4 todayMarkdown

llm ai

View ↗

RyanCodrai/turbovec

A vector index built on TurboQuant, written in Rust with Python bindings

★ 17.4K+2 todayRust

python rag

View ↗

Tencent/AngelSlim

Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.

★ 1.8K+2 todayPython

llm deepseek

View ↗

wanshuiyin/ARIS-in-AI-Offer

Bilingual (中文+EN) ML / LLM / diffusion / agent interview cheat sheets for AI 秋招 — generated by ARIS /interview-cheatsheet, rendered by /render-html into single-file HTML, reads anywhere — plus a CV→DBLP-fact-checked academic homepage generator and hand-authored long-form blogs 🌱

bitsandbytes-foundation/bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.

★ 8.5K+2 todayPython

llm machine-learning

View ↗

warpfront/hipfire

RDNA-native LLM inference engine in Rust.

★ 758+1 todayRust

machine-learning llm-inference

View ↗

qualcomm/aimet

AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.

★ 2.7K+1 todayPython

machine-learning deep-learning

View ↗

stochasticai/xTuring

Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

★ 2.7K+1 todayPython

llm deep-learning

View ↗

open-edge-platform/geti

Build, train, optimize, and run computer vision models locally, from raw images to live inference. Open source, optimized for Intel® XPU (CUDA also supported).

★ 1.4K+0 todayPython

machine-learning deep-learning

View ↗

whitecircle/halo

Halo is an open-source framework built by White Circle for training large language and multimodal models

openvinotoolkit/nncf

Neural Network Compression Framework for enhanced OpenVINO™ inference

tensorflow/model-optimization

A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.

★ 1.6K+0 todayPython

machine-learning deep-learning

View ↗

zengxiao-he/tessera

From teacher to tiles — a from-scratch LLM distillation & serving engine: custom Triton/CUDA kernels, FSDP distillation, paged-KV continuous batching, speculative decoding, a Rust gateway, a JAX oracle, and interpretability tooling.

★ 559+0 todayPython

llm pytorch

View ↗

quantization GitHub repositories

Compare star activity

Explore repositories

mw00/project-maya

FareedKhan-dev/kimi-k3-in-c

hiyouga/LlamaFactory

amitshekhariitbhu/ai-engineering-interview-questions

RyanCodrai/turbovec

Tencent/AngelSlim

wanshuiyin/ARIS-in-AI-Offer

bitsandbytes-foundation/bitsandbytes

warpfront/hipfire

qualcomm/aimet

stochasticai/xTuring

open-edge-platform/geti

whitecircle/halo

openvinotoolkit/nncf

tensorflow/model-optimization

zengxiao-he/tessera

Sign in to continue

Loading

Account settings

Delete listing?