All news

Ai2 opens ToyBlocks, a controlled world for training and evaluating robots

Prepared by Sintelligent with the help of SI. Published in SI: . Updated: .

Researchers now have a reproducible open environment for identifying the causes of robot errors and deliberately changing training data instead of relying on costly manual teleoperation.

ToyBlocks simulates a robotic arm and blocks on a tabletop and automatically generates tasks, demonstrations and metrics, allowing researchers to study planning, perception and physical control separately. The open package includes code, Molmo 2 and ManiFlow models, 85,336 long-horizon demonstrations, nearly 1,600 hours of execution and 144 million frames. In experiments, skill descriptions written by an agent after its own trials raised the success rate from 24% to 63%. The Molmo 2 and ManiFlow combination, trained only in simulation, completed 50% of tasks on a real Franka FR3 robot; researchers note that further trials are needed for statistical confidence.