Reinventing Entropy – Compression and Intelligence Part 1 (3b1B) [video]

vismit2000 11 points 2 comments June 07, 2026
www.youtube.com · View on Hacker News

Discussion Highlights (1 comments)

filup

I've tried to make my own text compressor and here was the main idea. One side is a table of all the most probable phrases up to 12, the other side is a unique identifier. Then, then you simply string together the unique identifiers, take the bigint of the overall message, then utilize base62 encoding which shrinks the message even further since we are dealing with numbers. It worked pretty well, some messages would compress very well, but on average, it compressed the original text by 50%.

Semantic search powered by Rivestack pgvector
10,002 stories · 93,925 chunks indexed