All news

OpenAI: coding agents complete 46% of 2–4 hour research tasks without a human

Prepared by Sintelligent with the help of SI. Published in SI: . Updated: .

Coding agents complete nearly half of OpenAI's short research tasks without a human, and surveyed researchers are willing to give up as much as 40% of their team's headcount for such access.

OpenAI has published an update to its report "Research acceleration: The jagged frontier". The share of 2–4 hour research tasks that coding agents completed without human intervention rose from 23% to 46% between March and October. For 4–8 hour tasks, the increase was from 13% to 35%. From August 1 to October 18, agents completed 79% of training-run monitoring tasks, 35% of run-launch tasks and 25% of inference and serving code tasks. By category: Communicate 69%, Analyze 58%, Build 43%. The number of agent workdays per researcher rose from 0.5 to 5.7 per day. The median daily cost of agents per researcher in October was about $2,400 at API list prices, with the 90th percentile at about $23,000. In a survey of 101 researchers, the median respondent was willing to give up 40% of their team's headcount or 30% of compute resources for three months of access to frontier coding agents. OpenAI calls on the industry to publicly report on recursive self-improvement (RSI) indicators. The position of independent evaluators (METR and Epoch) was not found in verified sources.