The Power of Questions: Why AI Is Better at Medical Diagnoses

Send us Fan Mail What if the best AI doctor is the one that asks the most questions? For years, artificial intelligence has been tested on medicine by being handed a finished case file. This episode explores a Science paper that changes the test. In a simulation called SDBench, an AI starts with a vague complaint and must ask questions, order costly tests, and commit to a diagnosis, just like a doctor. In this episode: Why “AI passes the medical exam” headlines can mislead How the SDBench simulation works, with a detective, a gatekeeper and a judge A case walkthrough of a sore throat that turned out to be a rare muscle cancer How an “AI medical board” reached roughly 80% accuracy, compared with doctors in the 36–47% range Why the AI asked about 25 questions where doctors asked about 5, and how that cut costs by about two-thirds Why humans and machines fail differently, from anchoring bias to near-miss diagnoses The study’s real limits, and what a doctor-plus-AI safety net could look like 📖 Read: https://helioxpodcast.substack.com 🎥 YouTube : https://www.youtube.com/channel/UCd5BbCEeC3Z6dp-nNjWRbBw 🎙️ Available for Broadcast: https://exchange.prx.org/group_accounts/253118-heliox_where_evidence_meets_empathy This is Heliox: Where Evidence Meets Empathy Independent, moderated, timely, deep, gentle, clinical, global, and community conversations about things that matter. Breathe Easy, we go deep and lightly surface the big ideas. Support the show Disclosure: This podcast uses AI-generated synthetic voices for a material portion of the audio content, in line with Apple Podcasts guidelines. We make rigorous science accessible, accurate, and unforgettable. Produced by Michelle Bruecker and Scott Bleackley, it features reviews of emerging research and ideas from leading thinkers, curated under our creative direction with AI assistance for voice, imagery, and composition. Systemic voices and illustrative images of people are representative tools, not depictions of specific individuals. We dive deep into peer-reviewed research, pre-prints, and major scientific works—then bring them to life through the stories of the researchers themselves. Complex ideas become clear. Obscure discoveries become conversation starters. And you walk away understanding not just what scientists discovered, but why it matters and how they got there. Independent, moderated, timely, deep, gentle, clinical, global, and community conversations about things that matter. Breathe Easy, we go deep and lightly surface the big ideas. Spoken word, short and sweet, with rhythm and a catchy beat. http://tinyurl.com/stonefolksongs