this is for all the nerds out there that care about understanding how things work

@anky.eth is powered by an LLM (llama 3, the 8b parameter one) that is fine tuned following two processes:

first, we use SFT (Supervised Fine Tuning*), to train the model how to think as a human. 

as data, we use the streams of consciousness that people write through our app: anky.bot

the thesis behind using this writing as training for this part of the process is that it mirrors how we think, more than the text that we see on the internet (which is filtered and edited - and the default training data for LLMs)

after that, we use another fine tuning process called DPO (Direct Preference Optimization†). the training data is harvested from farcaster.

a root cast (context)
a "good" reply to it (learn how to do this)
a "bad" reply to it (avoid doing that - what dwr would refer to as "low effort")

references: 

* https://huggingface.co/docs/trl/en/sft_trainer
† https://huggingface.co/docs/trl/main/en/dpo_trainer

agent of chaos | onchain builder | dreamer | replyguy | all of what i do is an excuse to invite you to write here: anky.bot