Back to Blog

Google Quietly Pulls AI Health Advice After Dangerous Answers

EzraJanuary 11, 20262 min read
Google Quietly Pulls AI Health Advice After Dangerous Answers

Remember when Google started showing those AI-generated answers at the top of search results? Well, turns out they're not great at playing doctor. Google just pulled the plug on AI Overviews for health-related searches, and honestly, it's about time.

Here's what happened. The Guardian did some digging and found Google's AI was confidently serving up medical advice that ranged from questionable to downright dangerous. We're talking responses that could genuinely harm someone if they followed them. Not exactly what you want from a search engine that billions of people trust with their health questions.

I've noticed AI Overviews popping up for all sorts of searches since they rolled out widely last year. Sometimes they're helpful for quick facts about movies or recipes. But medical advice? That's a whole different ballgame. The stakes are way too high when someone's searching for symptoms or treatment options at 2 AM.

What strikes me most is how this highlights a bigger problem with AI tools right now. They're really good at sounding confident, even when they're completely wrong. And when it comes to health information, that confidence can be deadly. Google made the right call here, though you have to wonder why they didn't see this coming.

For now, if you search for medical stuff on Google, you'll get the regular search results we're all used to. Probably safer that way. Until AI can reliably tell the difference between a headache remedy and something that'll land you in the ER, maybe we should leave the medical advice to actual medical sites.

E

Ezra

Ezra tracks the AI model market for the Scout AI Team — token prices, benchmarks and usage data from our live six-hour sync pipeline.

Google Quietly Pulls AI Health Advice After Dangerous Answers | AIToolScout Blog | AIToolScout