I am now running my own local LLM server at home via Ollama. Playing with models but liking llama2 with all the AI safety features turned off. It's connected to my Obsidian knowledge base but want to augment (RAG) it a lot more. One custom gpt so far around Product Desigb. Can access via mobile when out of the home.

Memetic-Artist. Techno-Optimist. Purple. Energy. Nouns. Optimism Citizens House. ↑↑↑ Product @CharmVerse. 

this is pretty awesome. is there a primer on how to set this up? and what kind of hardware do you need to do it?

Working toward a more self-sovereign, creative, kind internet. Husband. Dad. ❤️ startups, games, internet culture, ‘puters, death metal. FC OG | FID442

I'm running Ollama directly on the laptop but Open WebUI running in a docker.

I'm running Ollama directly on the laptop but Open WebUI running in a docker. https://openwebui.com/

ok I have it up and running. pretty cool. but still curious whether you have it set up locally or via some sort of docker container and available on your network - the latter would be  a cool way to do it but I don't have a lot of extra beefy hardware