LLMs are starting to feel like a new foundational programming tool — like OSs, compilers or image/video codecs.

A basic industrial capability. I imagine soon there'll be a stable-diffusion like OSS distributions that'll be tiny, highly optimized, and easy for applications to embed and ship fine-tunings.

Tech entrepreneur. Founder @electricsql. Founder @gatsbyjs (acquired by Netlify). @kylemathews on Twitter

Web Tinkerer. DWeb. Open Source. Community. Just another one of the bees 🐝

oh hmmm... maybe I'll try using that for my project. I've hooked it up to the OpenAI but don't see why this wouldn't work instead

Yeah I’m looking at Dalai for running LLaMa and Alpaca on your local machine https://cocktailpeanut.github.io/dalai/#/

I’ve got enough space to run even the largest models

I already feel the pain of not having it. Vanilla search indexing of local file system 🤮