A place for developers to talk about building on Farcaster.

/dev

We should only start getting scared of dev AI tools when companies start training models from first principles a la AlphaZero (i.e. handing them the docs and keeping them running until they figure out *everything*). Depending on existing code will continue to produce the limitations of existing code. But maybe this is only possible in a post-quantum world.

John 3:2b. Building the future, in the open.

1. Existing code is pretty great. So much can be built with it. 

2. Idk that I believe that we can’t end up with emergent behaviour from “depending on existing code”. LLMs are in a sense proof that emergent behaviour can occur even when trained primarily on existing data.

Multidisciplinary software engineer. First Citizen of The Internet. Building @gandalf.

Even scaling laws weren’t something we initially knew would work; they were discovered empirically. There was no theoretical guarantee that just making models bigger and feeding them more data would lead to more coherent, useful intelligence. Yet here we are.

There was no reason to preemptively believe that the kind of training used for LLMs today—predicting the next token from massive datasets—would result in models that can understand language well enough to respond meaningfully.