For the foreseeable future, I think that LLMs will continue to:
- improve significantly on what can be measured
- struggle on what cannot be measured

creating and destroying; built flying cars & autonomous vehicles, now building /faust, more here: /july, web: july.rocks

In many ways, I think the limit is what can be measured. In order to do better on what cannot be measured, we will need to convert more of what cannot be measured to what can be measured, and I think we continue to vastly underestimate what cannot be measured because it is an unknown unknown (we have no idea)

In a way, LLMs currently deal with unknowns by hallucinating them as knowns and presenting them as such. The onus will still be on people to fact check or to come with ways to verify