Content
@
0 reply
0 recast
0 reaction
Metaphorical
@hyp
I’m starting to believe that context windows explain EVERYTHING about just about everything.
3 replies
0 recast
2 reactions
manansh
@manansh
- What is a context window? - How does it explain everything? - Why are context windows important?
3 replies
1 recast
1 reaction
Metaphorical
@hyp
Give me a problem and i’ll put it in terms of context windows explain. Go!
1 reply
0 recast
1 reaction
Metaphorical
@hyp
"A context window is the range or scope of information a system can process, analyze, or integrate at a given time, constrained by its computational, memory, or energetic limits. It determines how much of the environment or input the system can consider when detecting patterns, making predictions, or taking action."
0 reply
0 recast
2 reactions
Metaphorical
@hyp
A chat gpt chat is a context window as a modern example. It doesn't have other chats available to provide input to answers. But a context window is a universal principle in many ways. Everything has a limit on how many relationships, or sources that are available at a given time because of a. limited time to act before the action become irrelevant and b. resources available. c. related - number of connections that are feasible given b. Which context window you are in mentally is everything. it's hard to effectively operate from different contexts simultaneously. Going from playing a jazz song to helping your kid with their homework. These are context windows. To cram more information into context windows, we need to do compressions. Think a map vs the territory, simplified rules of thumb. Learning? compressing information in your context window and expanding context window to then learn additional skills. Learning letters to reading.
0 reply
0 recast
1 reaction
