Hey all, maybe you can help me? Thinking of a small RAG project, but would prefer to run it locally. My idea would be to use langchain, vectordb, but I'm not quite sure on the inference/embeddings part yet. Is there a commonly used way to generate embeddings from documents? Are there local ways to generate them? Thanks for helping a dummy out!

I write code and sometimes stories. jakeacasey.com

You can simplify your stack further by just iterating over all your embeddings. There is no need for vector dbs for single-machine low-volume use case, like yours. Plus, if it’s a learning exercise, you can learn a lot of about matrices :)

/frametown citizen. Amusement, wonder, and uncertainty ✴︎ libred.org