Gigatoken: Fastest Tokenizer

convexstrictly 14 points 1 comment July 22, 2026
twitter.com · View on Hacker News

Discussion Highlights (1 comments)

convexstrictly

GitHub: https://github.com/marcelroed/gigatoken

Semantic search powered by Rivestack pgvector
5,564 stories · 50,257 chunks indexed