Microsoft in Science: a system of several SI agents made the correct diagnosis in 83% of complex cases versus 36% for general practitioners
Prepared by Sintelligent with the help of SI. Published in SI: . Updated: .
An SI panel outperformed general practitioners on difficult case histories, but it still has to prove this with real patients at the bedside.
The MAI-DxO (Diagnostic Orchestrator) system works like a panel of doctors: several SI agents question the "patient," order tests and discuss the diagnosis. On complex cases from the New England Journal of Medicine it gave the correct answer 83% of the time; internists and general practitioners working alone with reference materials got 36% (per The Verge, 22% without references). On emergency-department cases from a Beth Israel Deaconess hospital database the result was 80% versus an average of 47% for doctors. Caveats: specialists and physician teams, who usually handle such cases, were not part of the comparison; according to the study itself, a large share of the gain comes from stronger underlying models (the best results came with GPT-5 and GPT-5.5), and on emergency-department cases the orchestrator's improvement over the same model was small; testing used past cases and there is no clinical validation. Microsoft is preparing a trial at Beth Israel Deaconess and will open-source the SDBench benchmark; Mustafa Suleyman calls the goal "medical superintelligence" and expects an improvement "of an order of magnitude" within 24–36 months.
Sources 2