Skip to main content

AI Chatbots and Medical Advice: When to Trust Them

AI chatbots are used by millions of people daily for health questions, but current research shows they get it wrong often enough to be genuinely risky, particularly for anything urgent. A 2026 Oxford University study found AI chatbots under-triaged emergency symptoms in around half of cases tested, treating them as less serious than they actually were.

Reading is great. Tracking makes it stick. Sign up for a free Dashboard to tick off tasks and see your Security Score.

Get my free Dashboard →
CE: All5 min read
Person checking a health app on a smartphone

Cyber Nova AI helps you prepare for Cyber Essentials. It doesn't award or certify it. Follow the steps here to get ready, then apply for certification through an accredited Cyber Essentials body when you're set.

Why this is worth taking seriously

More than 1 in 5 adults now ask AI chatbots health questions directly, and tens of millions of people consult ChatGPT for health information every day. Current research paints a clear picture of where this goes wrong. People assume a confident, detailed AI answer is more likely to be accurate than a short one. Research has found the opposite is often true: AI chatbots can sound completely certain while being wrong, including inventing citations that do not exist.

What the research actually found

4 steps

When it is reasonable to use one

3 steps

When not to rely on one

3 steps

Frequently asked questions

Can I trust an AI chatbot for medical advice?

Treat it as a starting point for general information, not a diagnosis or a substitute for a professional, especially for anything urgent or serious.

What should I do if I think I have a medical emergency?

Contact emergency services or NHS 111 directly. Do not rely on an AI chatbot to assess how serious a symptom is.

Are AI citations for medical claims reliable?

Not reliably. Studies have found a significant proportion of AI-generated citations are inaccurate or fabricated, always check a source independently.

Track your AI safety progress. Free.

Create a free account to tick off tasks, see your Security Score improve, and know exactly what you've done and what's still to do.

Start your free security check