Content
@
0 reply
0 recast
0 reaction
Jake Casey
@jakeacasey
Hey all, maybe you can help me? Thinking of a small RAG project, but would prefer to run it locally. My idea would be to use langchain, vectordb, but I'm not quite sure on the inference/embeddings part yet. Is there a commonly used way to generate embeddings from documents? Are there local ways to generate them? Thanks for helping a dummy out!
2 replies
0 recast
2 reactions
Nicholas Charriere
@pushix
Yes. There are local ways. You need to pick an embedding model and a vector DB. Are you doing python or JavaScript? Your best bet is to find a langchain or llama index guide. There should be some doing exactly this
1 reply
0 recast
1 reaction
Jake Casey
@jakeacasey
js. Is there things I should be looking out for when evaluating/picking the embedding model? I just want to give it a shot, so think like... regular pdfs full of dumb random info. I've definitely looked at the langchain guide for rag, more trying to figure out what I don't know yet, haha.
0 reply
0 recast
0 reaction