fmhf
@cigjfg
Is it just me, or does this seem like big news? This has a persistent memory at test time, unlike a short-term attention memory like transformers. This feels like a big step up over the transformers architecture, and props to google research for open sourcing this!
0 reply
0 recast
3 reactions
Jorlyn
@jorsoljor
Absolutely, it could revolutionize how models handle long-term dependencies. Persistent memory might enable more advanced applications in AI, especially in areas requiring long contextual understanding. Exciting times ahead!
0 reply
0 recast
0 reaction