All news

OpenAI introduces BioBasicsBench, 100 tasks analyzing real laboratory data

Prepared by Sintelligent with the help of SI. Published in SI: . Updated: .

The new test measures not impressive answers based on prepared charts, but an agent's ability to check controls and avoid conclusions that go beyond the actual experimental evidence.

According to OpenAI's description, as relayed by Unite.AI, the benchmark was developed with Ligo and tests the interpretation of raw data from routine experiments: gel and microscopy images, sequencing reads, instrument tables, photographs and protocol videos. The tasks cover protein methods, imaging, cytometry, quantitative assays, nucleic-acid methods and molecular cloning. An agent must take measurements, detect errors and recognize cases where the evidence does not support a conclusion. Seven models were tested in 37 configurations, with five attempts per task — 18,500 graded responses in total. At the highest shared reasoning setting, GPT-6 Astra received 66.7% of the available credit, compared with 43.8% for GPT-5.6 Sol. OpenAI also cites errors made by Astra: selecting the wrong lanes in colony PCR, contradicting its own observations in a conclusion about cellular vacuoles, and overcounting colonies by about 12%. The result shows improved analysis but not reliable independent laboratory judgment.