GitHub repository
marcelroed/gigatoken
Language model tokenization at GB/s
Rust- Total stars
- 4.1K
- Today
- +2
- Last 7 days
- +8
- Last 30 days
- +44
Recorded star history
Snapshot: 2026-10-02. Counts recorded during the last 7 days, oldest first.
Oldest recordedLatest recorded