GDPx benchmark gives top model just 12% on professional tasks
Prepared by Sintelligent with the help of SI. Published in SI: . Updated: .
Even the strongest models still complete only a small share of long specialist tasks, while the new benchmark measures their usefulness and cost on work closer to real practice.
SemiAnalysis released 206 tasks across 11 domains: chip and hardware design, cybersecurity, biology, finance, law, quantitative trading, materials science, alignment, software engineering and recursive self-improvement. Fourteen specialist partners built the tasks; the score averages pass@1 across three attempts with equal weight for each domain. Claude Opus 5.5 leads at 12.0% with an average cost of $51.41 per task, Gemini 4 Carbon scored 10.9% at $16.29, and GPT-6 Astra scored 9.6% at $53.99. Every model received zero in finance and law under strict binary grading, so partial scores are shown for those domains. SemiAnalysis cautions that safety classifiers lowered Opus and Astra's results in cybersecurity, biology and alignment. Benchmark updates are planned every three to six months.
Sources 2