“In my opinion this is one of the reasons LLMs, while they already have all of humanity's knowledge in memory, haven't generated any new knowledge by connecting previously unrelated facts.”

Is this actually true?

I shared a controversial take the other day at an event and I decided to write it down in a longer format: I’m afraid AI won't give us a "compressed 21st century".

The "compressed 21st century" comes from Dario's "Machine of Loving Grace" and if you haven’t read it, you probably…

Thomas Wolf

“In my opinion this is one of the reasons LLMs, while they already have all of humanity's knowledge in memory, haven't generated any new knowledge by connecting previously unrelated facts.”

Is this actually true?

https://x.com/thom_wolf/status/1897630495527104932?s=46

Writer. Building @pinatacloud. Working on simple static site hosting https://orbiter.host \ https://polluterofminds.com

I would also argue that it has connected unrelated ideas that allow humans to generate new knowledge. To me, that’s more valuable than the AI itself generating new knowledge.

Very subjective- how do you define new knowledge?

It has definitely produced artifacts (eg games or music or videos or images) previously unknown which you could argue is new knowledge

Or worse. Step functions come when probabilistically improbable things become true and fact. 

AI will deem it not worth trying.