Gigatoken: Fastest Tokenizer

convexstrictly 14 points 1 comment July 22, 2026
twitter.com · View on Hacker News

Discussion Highlights (1 comments)

convexstrictly

GitHub: https://github.com/marcelroed/gigatoken

Semantic search powered by Rivestack pgvector
14,369 stories · 134,336 chunks indexed