Apple is exploring robot control through Vision Pro. A system using Apple Vision Pro provides real-time virtual robot feedback, enabling high-quality, barehanded data collection for robot imitation learning without physical hardware. A user study showed live feedback improved data quality, with trajectories successfully replayed on physical robots, offering a scalable solution for data collection.

Wild. Even though many consider AVP a flop, I'm bullish on it long term. As evidenced by this demo, we're just scratching the surface of what will be possible with Apple's spatial compute and vision capabilities.