Microsoft’s Mustafa Suleyman says its AI outperforms doctors on hard cases as he chases ‘medical superintelligence’

Microsoft’s AI diagnostic system correctly diagnosed complex medical cases in a simulation more than twice as often as generalist physicians, according to a study published Thursday in Science. Mustafa Suleyman, Microsoft AI’s CEO, called the result a step toward “medical superintelligence.”

The system, dubbed MAI-DxO (DxO for short), coordinates several AI agents that act like a panel of doctors. They question a patient, order tests, and debate a diagnosis.

In a simulation using complex cases from the New England Journal of Medicine, it was correct 83% of the time. Primary care doctors and general internists, working individually with reference materials, were correct 36% of the time. One note: Cases this complex are usually handled by specialists or physician teams, who weren’t part of the comparison.

“There is something very substantial and exciting here,” Dominic King, vice president of Health at Microsoft AI, told TechCrunch. “The biggest challenge in healthcare delivery at the moment is the growing mismatch between demand and supply of medical expertise.”

In publishing these results, Microsoft joins Google and OpenAI in claiming that its AI can match or outperform doctors.

The study’s own data suggests that much of the improvement comes from more powerful underlying AI models, with Microsoft’s orchestration system adding gains on top.