aichannel

Is there an easy way to fine tune an LLM on stuff I write so that I can talk to myself? Transforming data is not a requirement, can do it myself

Ideas

Finetuning can make sense here if you want the LLM to have your writing style or tone. But if you mostly just want to retrieve info /ideas from all your writing, RAG is probably the way to go.

If you do want to use fine-tuning and don’t mind closed-source models, it is supported by OpenAI, Anthropic etc. in a way that is probably most straightforward:
https://aws.amazon.com/blogs/machine-learning/fine-tune-anthropics-claude-3-haiku-in-amazon-bedrock-to-boost-model-accuracy-and-quality/ 

https://platform.openai.com/docs/guides/fine-tuning

Haven’t done it myself yet so I’m not sure how long it would take to set up from scratch.

cypherpunk wannabe, engineer working on @frames /open-frames /opencast
https://stephancill.co.za create stories at https://stories.steer.fun

Yeah I’m interested in preserving writing style+personality+ideas