Intuitions for Tranformer Circuits

cjamsonhn 39 points 3 comments March 23, 2026
www.connorjdavis.com · View on Hacker News

Discussion Highlights (2 comments)

skyberrys

I was glad to discover this is an analogy to electrical circuits further down the page. It's a good topic to understand, the write-up is comprehensive.

jopolous

> They are the only man-made technology in history that we don’t fully understand from first principles …what? What about bicycles? Ice skates? General anesthetics? I feel like there are a ton of commonly-used man-made items we don’t fully understand from a first-principles perspective. Am I missing something here?

Semantic search powered by Rivestack pgvector
3,471 stories · 32,344 chunks indexed