A place for developers to talk about building on Farcaster.

/dev

About 8 years ago I prepared hands-on exercises for a summer school in data science on character-wise language modeling with multi-layer LSTMs. This is essentially what modern LLMs do but on a much (much) smaller scale - it was trained on around 20k Donald Trump tweets on a single laptop (without GPU) but was still able to generate believable fake tweets. This was about 5 years before the release of ChatGPT. I had no idea at that time that this would soon become the most dominant way of solving general intelligence. The code and examples of generated fake tweets are available at https://github.com/SSDS-Croatia/SSDS-2017/blob/master/Day-3/3_SSDS_2017_CharLSTMs_Solved.ipynb