Knowledge Distillation of Black-Box Large Language Models (2024)
babelfish
76 points
13 comments
June 28, 2026
Related Discussions
Found 5 related stories in 652.8ms across 14,015 title embeddings via pgvector HNSW
- δ-mem: Efficient Online Memory for Large Language Models 44za12 · 203 pts · May 16, 2026 · 57% similar
- Different language models learn similar number representations Anon84 · 94 pts · April 24, 2026 · 55% similar
- Show HN: I built a tiny LLM to demystify how language models work armanified · 249 pts · April 06, 2026 · 54% similar
- Hallucination Is Inevitable: An Innate Limitation of Large Language Models drob518 · 12 pts · May 04, 2026 · 53% similar
- Why are large language models so terrible at video games? sxx0 · 29 pts · June 01, 2026 · 52% similar
Discussion Highlights (4 comments)
duendefm
The Chinese are really going strong on destroying the American AI economy bubble. Honestly, despite the fact that I'm totally pro USA and anti China, I think we should help them crashing the American AI bubble. They are controlling everything and we can't even buy a new computer nowadays while getting no benefit from this. I wish some influential programmers stimulated coders everywhere to skip Claude and Chatgpt subscriptions for Chinese ones, at scale. If we programmers united we could help this bubble burst, I'm sure.
linolevan
Can we note that this is a 2024 paper in the title?
Alifatisk
Why is this published again? Is this a reference to recent events?
dmezzetti
Well-Read Students Learn Better: On the Importance of Pre-training Compact Models Related paper that's a good read: https://arxiv.org/abs/1908.08962