Reinventing Entropy – Compression and Intelligence Part 1 (3b1B) [video]
vismit2000
11 points
2 comments
June 07, 2026
Related Discussions
Found 5 related stories in 121.7ms across 10,002 title embeddings via pgvector HNSW
- TurboQuant: Redefining AI efficiency with extreme compression ray__ · 509 pts · March 25, 2026 · 53% similar
- KV Sharing, MHC, and Compressed Attention gmays · 29 pts · May 19, 2026 · 46% similar
- Apply video compression on KV cache to 10,000x less error at Q4 quant polymorph1sm · 16 pts · March 22, 2026 · 46% similar
- Agentic AI and the next intelligence explosion silverpiranha · 17 pts · March 30, 2026 · 46% similar
- A Day in the Life of an Enshittificator [video] leephillips · 11 pts · March 01, 2026 · 46% similar
Discussion Highlights (1 comments)
filup
I've tried to make my own text compressor and here was the main idea. One side is a table of all the most probable phrases up to 12, the other side is a unique identifier. Then, then you simply string together the unique identifiers, take the bigint of the overall message, then utilize base62 encoding which shrinks the message even further since we are dealing with numbers. It worked pretty well, some messages would compress very well, but on average, it compressed the original text by 50%.