Intuitions for Tranformer Circuits
cjamsonhn
39 points
3 comments
March 23, 2026
Related Discussions
Found 5 related stories in 72.0ms across 8,303 title embeddings via pgvector HNSW
- Transformers Are Inherently Succinct (2025) bearseascape · 45 pts · May 04, 2026 · 47% similar
- Talking to Transformers taylorsatula · 33 pts · May 03, 2026 · 44% similar
- The Trouble with Transformers rob_lh · 11 pts · April 19, 2026 · 42% similar
- Show HN: TRiP – a complete transformer engine in C built from scratch just by me carlovalenti · 34 pts · April 30, 2026 · 42% similar
- Learning Pseudorandom Numbers with Transformers pizza · 11 pts · May 03, 2026 · 42% similar
Discussion Highlights (2 comments)
skyberrys
I was glad to discover this is an analogy to electrical circuits further down the page. It's a good topic to understand, the write-up is comprehensive.
jopolous
> They are the only man-made technology in history that we don’t fully understand from first principles …what? What about bicycles? Ice skates? General anesthetics? I feel like there are a ton of commonly-used man-made items we don’t fully understand from a first-principles perspective. Am I missing something here?