AIRI and Shanghai AI Lab compare seven GPU robotics simulators for speed, accuracy and reproducibility
Prepared by Sintelligent with the help of SI. Published in SI: . Updated: .
Speed alone is not enough when choosing a simulator for training robots: computational noise itself can create some of the differences between policies.
GPUSimBench compares Isaac Lab, ManiSkill, Genesis, Madrona, MuJoCo Warp, MJX and MuJoCo Playground on a single RTX 5070. Genesis reached 11.1 million simulation steps per second across 131,072 environments with a Franka manipulator; in the collision test, five simulators deviated from the real-world experiment by roughly within five centimeters. The researchers also showed that parallel environments and repeated runs can produce different results even under identical initial conditions.
Sources 1