GitHub repository
niieani/gpt-tokenizer
The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken with additional features.
TypeScript- Total stars
- 857
- Today
- +0
- Last 7 days
- +2
- Last 30 days
- +15