The architecture of open-weight LLMs: MoE, hybrid layers, ternary weights
silasyl
14 points
0 comments
November 05, 2026
Related Discussions
Found 5 related stories in 123.3ms across 11,756 title embeddings via pgvector HNSW
- LLMs are not superhuman at reading and writing neural network weights agrm · 50 pts · November 02, 2026 · 59% similar
- Infinite-Parameter LLMs: Generating and Adapting Weights from Live Data Betelbuddy · 133 pts · September 17, 2026 · 55% similar
- Breaking the 1.58-bit Barrier for Ternary LLMs matt_d · 177 pts · September 16, 2026 · 54% similar
- OpenArch – PyTorch implementations of modern LLM architectures anuj0456 · 135 pts · September 14, 2026 · 54% similar
- Learning Programming in an Age of LLMs moneroloop2018 · 236 pts · September 16, 2026 · 53% similar