ccarella

I am now running my own local LLM server at home via Ollama. Playing with models but liking llama2 with all the AI safety features turned off. It's connected to my Obsidian knowledge base but want to augment (RAG) it a lot more. One custom gpt so far around Product Desigb. Can access via mobile when out of the home.

Hyperpunk & techni-optimist. Co-founder, Scout Game.
https://scoutgame.xyz

What's been the biggest learning in setting it up?

Building something new. 🟪 Host: /venturecapital /adventures /theitinerant

Interesting. Are you storing all your data locally as well?

I'm bullish on whatever Apple decides to do. I kind of thought you couldn't compete with the cloud and that's just not true. You can totally run them locally and they are even faster that way.