GitHub repository
jmaczan/tiny-vllm
Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
C++- Total stars
- 1.2K
- Today
- +2
- Last 7 days
- +14
- Last 30 days
- +38
View repository on GitHub ↗
GitHub repository
Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
C++