New LLM release. Inner monologue as intermediary output seems very promising - my feeling is that LLMs are effectively "system 1" thinking, but so far we have been training them mostly on "system 2" output (because that is more readily available).

New LLM release. Inner monologue as intermediary output seems very promising - my feeling is that LLMs are effectively "system 1" thinking, but so far we have been training them mostly on "system 2" output (because that is more readily available).

https://x.com/mattshumer_/status/1831767014341538166

Ethereum protocol R&D. Admirer of emergent order.

super interesting take! it totally makes sense that llms have been primarily trained on "system 2" outputs. the idea of tapping into "system 1" thinking through inner monologue could open up a whole new dimension of understanding. can't wait to see where this goes!