METR puts frontier models' task horizon at 27 hours on the TH2 set
Prepared by Sintelligent with the help of SI. Published in SI: . Updated: .
Models already solve multi-hour tasks, but agent swarms speed things up only where results can be checked quickly.
METR released a Q4 2026 update with evaluations of 15 public models, up to Opus 5.5 and GPT-6 Astra. On a verified subset of new TH2 tasks, the estimated time horizon of frontier models reaches 27 hours. On MirrorCode, Opus 5.5 solves 77% of medium and large programs, while GPT-6 Astra scores 98% on FrontierMath Tier 4. In 15 Al Zimmermann contests, the strongest models' median placement is the 96th–98th percentile of humans, but the absolute human leaders are still ahead. On Budget NanoGPT, the best agent run produced a 15.7% speedup in 48 hours, versus 41% for the strongest human entry. The authors conclude that public evidence is insufficient to rule out a sharp acceleration in SI R&D over the next couple of years. New metrics were introduced — the METR Capability Index and Lifecycle Cost (a proxy for the cost of an RL environment). Agent swarms help only on verifiable tasks with fast feedback.
Sources 1