For the foreseeable future, I think that LLMs will continue to:
- improve significantly on what can be measured
- struggle on what cannot be measured

creating and destroying; built flying cars & autonomous vehicles, now building /faust, more here: /july, web: july.rocks

In many ways, I think the limit is what can be measured. In order to do better on what cannot be measured, we will need to convert more of what cannot be measured to what can be measured, and I think we continue to vastly underestimate what cannot be measured because it is an unknown unknown (we have no idea)

inference time compute to combat the unknown
they are now our allies