AI chatbots give misleading medical advice 50% of the time, study finds – nny360.com

Welcome to the forefront of conversational AI as we explore the fascinating world of AI chatbots in our dedicated blog series. Discover the latest advancements, applications, and strategies that propel the evolution of chatbot technology. From enhancing customer interactions to streamlining business processes, these articles delve into the innovative ways artificial intelligence is shaping the landscape of automated conversational agents. Whether you’re a business owner, developer, or simply intrigued by the future of interactive technology, join us on this journey to unravel the transformative power and endless possibilities of AI chatbots.
Please log in, or sign up for a new account and purchase a subscription to continue reading.
Please log in, or sign up for a new account and purchase a subscription to continue reading.
Join now to continue reading.
Your current subscription does not provide access to this content.
Don’t hesitate! Start your digital-only membership today and not only receive full access to our premier news website NNY360.com but also to the NNY360 mobile app, and the Watertown Daily Times eEdition!
Sorry, no promotional deals were found matching that code.
Promotional Rates were found for your code.
Sorry, an error occurred.

do not remove
Windy with a mix of clouds and sun. A stray shower or thunderstorm is possible. High 79F. Winds S at 20 to 30 mph..
Rain. Much colder. Low 37F. Winds WSW at 15 to 25 mph. Chance of rain 100%. Rainfall near an inch.
Updated: April 18, 2026 @ 12:16 pm
AI chatbots give misleading or incorrect medical advice about half the time, researchers say. Arsenii Palivoda/Dreamstime/TNS

AI chatbots give misleading or incorrect medical advice about half the time, researchers say. Arsenii Palivoda/Dreamstime/TNS

Artificial intelligence-driven chatbots are giving users problematic medical advice about half the time, according to a new study, highlighting the health risks of the technology that’s becoming increasingly integral in day-to-day life.
Researchers from the United States, Canada and the United Kingdom evaluated five popular platforms — ChatGPT, Gemini, Meta AI, Grok and DeepSeek— by asking each of them 10 questions across five health categories. Out of the total responses, about 50% were deemed problematic, including almost 20% that were highly problematic, according to findings published this week in medical journal BMJ Open.
The chatbots performed relatively better on closed-ended prompts and questions related to vaccines and cancer, and worse on open-ended prompts and in areas like stem cells and nutrition, according to the study.
Answers were often delivered with confidence and certainty, though no chatbot produced a fully complete and accurate reference list in response to any prompt, the researchers said. There were only two refusals to answer a question, both from Meta AI.
The results highlight the growing concern about how people are using generative AI platforms, which aren’t licensed to give medical advice and lack the clinical judgment to make diagnoses.
The explosive growth of AI chatbots has made them a popular tool for people seeking guidance on their ailments and OpenAI has said that more than 200 million people ask ChatGPT health and wellness questions every week. The platform announced in January health tools for both everyday users and clinicians, and Anthropic said the same month its Claude product is launching a new health care offering.
A major risk to the deployment of chatbots without public education and oversight is that they could amplify misinformation, the BMJ Open study authors said.
The findings “highlight important behavioral limitations and the need to reevaluate how AI chatbots are deployed in public-facing health and medical communication,” they wrote. These systems can generate “authoritative-sounding but potentially flawed responses,” they wrote.
Your comment has been submitted.

Reported
There was a problem reporting this.
Log In
Keep it Clean. Please avoid obscene, vulgar, lewd, racist or sexually-oriented language.
PLEASE TURN OFF YOUR CAPS LOCK.
Don't Threaten. Threats of harming another person will not be tolerated.
Be Truthful. Don't knowingly lie about anyone or anything.
Be Nice. No racism, sexism or any sort of -ism that is degrading to another person.
Be Proactive. Use the 'Report' link on each comment to let us know of abusive posts.
Share with Us. We'd love to hear eyewitness accounts, the history behind an article.
Get the most of NNY360, register today!
By providing your email address, you consent to receive emails and special offers from NNY360.com
Get Breaking News Alerts deliverd FREE to your inbox
Success! An email has been sent to with a link to confirm list signup.
Error! There was an error processing your request.
By providing your email address, you consent to receive emails and special offers from NNY360.com
Your browser is out of date and potentially vulnerable to security risks.
We recommend switching to one of the following browsers:

source

Scroll to Top