How to make System 1 LLMs show System 2 competencies?

dominotw

> One of Kahneman’s best known contributions to AIthought is the System 1 System 2 metaphor he brought tobear on human cognition in his book Thinking Fast andSlow. I read this book published in 1974 called 'inner game of tennis' that has the same metaphor. Its one of the book i read every once in a while even though i dont play tennis anymore.

max0077

isnt this how flash models are made?

fmbb

I have never heard of ”System 1” and ”System 2” thinking before. Wikipedia implies it’s just some pop-sci (psychology even, so extra pop) book from a few years ago. A book heavily criticized for relying on shoddy science. Why are the terms used to describe anything by anyone trying to sound serious or scientific?

thinkling

I had the opposite take on LLMs using Kahnemann's framework. Maybe I need to reread his book, but I think of System 1 as "fast, reflexive, instinctive" mental activity, and System 2 as "slow, deliberative, rational, verbal" thought. So exactly inverse to this article, I characterize LLMs as 100% System 2, and would say that what's missing in AI is the more "embodied" System 1 intelligence. My current thinking is that the experience of consciousness is closely tied to that embodied, emotional side of our nervous system, and is 100% lacking in LLMs. Anthropic people will say "the models have neural correlates of emotion", and that's fine, our cortex also has neural correlates for emotions and for much of what happens in the cerebellum and brain stem. That doesn't mean that that's where the primary function is implemented.

rambambram

Are we making up words again?

2001zhaozhao

answer: you make a recurrent neuralese model (btw don't do that)