transformers GitHub repositories

machine-learning deep-learning

rohitg00/ai-engineering-from-scratch

Learn AI Engineering! Learn it. Build it. Ship it for others.

labmlai/annotated_deep_learning_paper_implementations

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

★ 67.6K+6 todayPython

huggingface/peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

★ 21.9K+0 todayPython

llm pytorch

stas00/ml-engineering

Machine Learning Engineering Open Book

★ 19.6K+14 todayPython

arc53/DocsGPT

Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.

neuml/txtai

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

FareedKhan-dev/train-llm-from-scratch

A straightforward method for training your LLM, from downloading data to generating text.

★ 12.6K+123 todayPython

llm openai

MakazhanAlpamys/Soup

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

★ 9.7K+31 todayPython

xorbitsai/inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

★ 9.6K+2 todayPython

MaartenGr/BERTopic

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

★ 7.9K+0 todayPython

machine-learning nlp

amazon-science/chronos-forecasting

Chronos: Pretrained Models for Time Series Forecasting

★ 6.2K+4 todayPython

machine-learning deep-learning

Michael-A-Kuykendall/shimmy

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

grobidOrg/grobid

A machine learning software for extracting information from scholarly documents

★ 5.2K+0 todayJava

SwanHubX/SwanLab

⚡️SwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultralytics / MMEngine / Keras etc.

★ 4.3K+0 todayPython

JohnSnowLabs/spark-nlp

State of the Art Natural Language Processing

raiyanyahya/how-to-train-your-gpt

Build a modern LLM from scratch. Every line commented. Explained like we are five.

★ 4.1K+6 todayJupyter Notebook

fnnx-ai/scikit-llm

Seamlessly integrate LLMs into scikit-learn.

★ 3.5K+0 todayPython

linto-ai/whisper-timestamped

Multilingual Automatic Speech Recognition with word-level timestamps and confidence

Exorust/TorchLeet

LeetCode for PyTorch — 65 ML/AI interview problems from real interviews at Google, Meta, Anthropic. Jupyter notebooks, an auto-grader, and an MCP AI tutor.

★ 2.6K+0 todayJupyter Notebook

llm deep-learning

InternLM/lagent

A lightweight framework for building LLM-based agents

★ 2.3K+0 todayPython

llm agent

lihanghang/NLP-Knowledge-Graph

自然语言处理、知识图谱、大语言模型，Agent等技术的前沿追踪、研究与应用。

★ 1.8K+0 todayJavaScript

kyegomez/awesome-multi-agent-papers

A compilation of the best multi-agent papers

★ 1.7K+2 todayTeX

agents multi-agent

nokia-applied-research/AnyJev

Turn any LLM into a Jev-style decision model: typed decisions, real probabilities, no training. (continue updating, welcome any issue and PR request)

★ 1.5K+8 todayPython

llm transformers

PrunaAI/pruna

Pruna is a model optimization framework built for developers, enabling you to deliver faster, more efficient models with minimal overhead.

★ 1.3K+2 todayPython

fancyboi999/ai-engineering-from-scratch-zh

Agent工程师最全学习路径 · 从零精通 AI 工程 · 20 阶段 542 课 · 中文全量翻译 + 配套站点 + 动画讲解视频 · 如何成为 AI Agent 工程师的修成指南

NVIDIA/kvpress

LLM KV cache compression made easy

★ 1.2K+0 todayPython

llm pytorch

Rizzo-AI-Academy/rizzo-pii

Local-first privacy guard: anonymize your documents before sharing with LLMs.

★ 1.2K+0 todayPython

llm local-first

openvinotoolkit/nncf

Neural Network Compression Framework for enhanced OpenVINO™ inference

bodaay/HuggingFaceModelDownloader

Simple go utility to download HuggingFace Models and Datasets

★ 1.2K+0 todayGo

llm transformers

whitecircle/halo

Halo is an open-source framework built by White Circle for training large language and multimodal models

DaoyuanLi2816/can-i-finetune-this

Single-GPU LLM fine-tuning preflight: memory estimates, runnable LoRA/QLoRA recipes, and local measurements.

★ 794+0 todayPython

llm pytorch

machine-learning deep-learning

webis-de/small-text

Active Learning for Text Classification in Python

★ 646+0 todayPython

zhongkaifu/TensorSharp

A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability

★ 632+2 todayC#

huggingface/optimum-intel

🤗 Optimum Intel: Accelerate inference with Intel optimization tools

★ 623+0 todayJupyter Notebook

llm transformers

codelion/adaptive-classifier

A flexible, adaptive classification system for dynamic text classification

apocas/restai

RESTai is an AIaaS (AI as a Service) open-source platform. Supports many public and local LLM suported by Ollama/vLLM/etc. Precise embeddings usage, tuning, analytics etc. Built-in image/audio generation with dynamic loading generators. Live chat deployment. Built-in block based graphical language. Prompt versioning and much more...

★ 515+0 todayPython

llm rag