Intuitions for Tranformer Circuits
cjamsonhn
39 points
3 comments
March 23, 2026
Related Discussions
Found 5 related stories in 47.3ms across 3,471 title embeddings via pgvector HNSW
- Executing programs inside transformers with exponentially faster inference u1hcw9nx · 17 pts · March 12, 2026 · 41% similar
- Show HN: Duplicate 3 layers in a 24B LLM, logical deduction .22→.76. No training xlayn · 90 pts · March 18, 2026 · 37% similar
- TLA+ Mental Models r4um · 15 pts · March 23, 2026 · 36% similar
- Agentic Engineering Patterns r4um · 505 pts · March 04, 2026 · 35% similar
- Trinity Large Thinking kristianp · 28 pts · April 02, 2026 · 34% similar
Discussion Highlights (2 comments)
skyberrys
I was glad to discover this is an analogy to electrical circuits further down the page. It's a good topic to understand, the write-up is comprehensive.
jopolous
> They are the only man-made technology in history that we don’t fully understand from first principles …what? What about bicycles? Ice skates? General anesthetics? I feel like there are a ton of commonly-used man-made items we don’t fully understand from a first-principles perspective. Am I missing something here?