https://arcprize.org/blog/oai-o3-pub-breakthrough

An odd read.

o3 is a breakthrough, but likely scores 30% on arc AGI 2

o3 did well but large ensemble of low compute Kaggle solutions can now score 81% on the private eval. 

This part:

Note on "tuned": OpenAI shared they trained the o3 we tested on 75% of the Public Training set. They have not shared more details. We have not yet tested the ARC-untrained model to understand how much of the performance is due to ARC-AGI data.

With all the hype about OpenAI o3 scoring 88% on ARC-AGI, let me remind you of a much more impressive score from a few months ago. https://t.co/N2nIhA5UlS

Haider.

https://x.com/slow_developer/status/1871527733626552548?s=46