idk yapping at an airgapped ollama hits different

👩‍🎤 builder 🧑‍🏫 http://SpeedRunEthereum.com 🏗 http://scaffoldeth.io 🏰 http://buidlguidl.com 🎨 http://nifty.ink 🛠 http://eth.build 🏷 atg.eth

I still haven’t ventured into local LLMs. How resource intensive is it?

Lmstudio makes it stupid easy to run Llama 8B on an M-series mac, and even that is surprisingly good. https://lmstudio.ai/

You'll want to have the computer plugged in or you'll have significantly less battery life.

Known for the everywhere.computer (/ec), /unglish (unglish.co.uk), the /secure-design WG, WalletUncon, Causal Islands + drumming in all-genre power trios.

co founder of @metamask . Making computers behave for us.

Sweet! Gonna give it a spin.

I guess we ain’t running the 80b models on a laptop yet eh.