Reinventing Entropy – Compression and Intelligence Part 1 (3b1B) [video]
vismit2000
11 points
2 comments
June 07, 2026
Related Discussions
Found 5 related stories in 1456.9ms across 14,736 title embeddings via pgvector HNSW
- TurboQuant: Redefining AI efficiency with extreme compression ray__ · 509 pts · March 25, 2026 · 53% similar
- The Art of Insight in Science and Engineering – Mastering Complexity(2014) [pdf] nill0 · 77 pts · July 19, 2026 · 47% similar
- KV Sharing, MHC, and Compressed Attention gmays · 29 pts · May 19, 2026 · 46% similar
- Apply video compression on KV cache to 10,000x less error at Q4 quant polymorph1sm · 16 pts · March 22, 2026 · 46% similar
- Humanity isn't ready for the coming intelligence explosion andsoitis · 28 pts · June 16, 2026 · 46% similar
Discussion Highlights (1 comments)
filup
I've tried to make my own text compressor and here was the main idea. One side is a table of all the most probable phrases up to 12, the other side is a unique identifier. Then, then you simply string together the unique identifiers, take the bigint of the overall message, then utilize base62 encoding which shrinks the message even further since we are dealing with numbers. It worked pretty well, some messages would compress very well, but on average, it compressed the original text by 50%.