Intuitions for Tranformer Circuits
cjamsonhn
39 points
3 comments
March 23, 2026
Related Discussions
Found 5 related stories in 381.8ms across 14,015 title embeddings via pgvector HNSW
- Transformers are inherently succinct brandonb · 110 pts · June 05, 2026 · 49% similar
- Transformers Are Inherently Succinct (2025) bearseascape · 45 pts · May 04, 2026 · 47% similar
- Intuitive Quantum Electrodynamics Ono-Sendai · 30 pts · July 05, 2026 · 45% similar
- Talking to Transformers taylorsatula · 33 pts · May 03, 2026 · 44% similar
- Cursed circuits #5: capacitance multiplier surprisetalk · 77 pts · July 05, 2026 · 43% similar
Discussion Highlights (2 comments)
skyberrys
I was glad to discover this is an analogy to electrical circuits further down the page. It's a good topic to understand, the write-up is comprehensive.
jopolous
> They are the only man-made technology in history that we don’t fully understand from first principles …what? What about bicycles? Ice skates? General anesthetics? I feel like there are a ton of commonly-used man-made items we don’t fully understand from a first-principles perspective. Am I missing something here?