GitHub repository
bentoml/OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
Python- Total stars
- 12.6K
- Today
- +2
- Last 7 days
- +12
- Last 30 days
- +23
Recorded star history
Snapshot: 2026-10-28. Counts recorded during the last 7 days, oldest first.
Oldest recordedLatest recorded