Philosophy

I’m starting to believe that context windows explain EVERYTHING about just about everything.

Neouroscience, ☯️, decentralization, AI. Building verifiable world models at bldx.io Writing a book /mirror-loom : https://paragraph.xyz/@mirrorandloom/

- What is a context window?
- How does it explain everything?
- Why are context windows important?

research /openux || learning /manansh || writing manansh.xyz

A chat gpt chat is a context window as a modern example. It doesn't have other chats available to provide input to answers. 

But a context window is a universal principle in many ways. Everything has a limit on how many relationships, or sources that are available at a given time because of a. limited time to act before the action become irrelevant and b. resources available.  c. related - number of connections that are feasible given b. 

Which context window you are in mentally is everything.  it's hard to effectively operate from different contexts simultaneously.  Going from playing a jazz song to helping your kid with their homework. These are context windows.

To cram more information into context windows, we need to do compressions. Think a map vs the territory, simplified rules of thumb.
Learning? compressing information in your context window and expanding context window to then learn additional skills. Learning letters to reading.