Tools for exploring the souls of large language models

r00tanon

The need for understanding how models arrive at their predictions, and the techniques of mechanistic interpretability is within reach of anyone with a desire to learn.

annoyingnoob

The entire concept of a soul is fictional, something we made up. When its turtles all the way down you can never find the bottom turtle.

dangom

I’d asked a large language model to build something like this for personal study, and the result was pretty much identical to OP’s to the colors chosen to display the matrices and the layout of the viewer. I wonder how many of us are not landing on the same subset of solutions to the same questions (with no judgement here whether this is good or bad). Funny in light of a discussion about the souls of LLMs.