AI chatbots give wrong medical advice 50% of the time, study warns – Storyboard18

Welcome to the forefront of conversational AI as we explore the fascinating world of AI chatbots in our dedicated blog series. Discover the latest advancements, applications, and strategies that propel the evolution of chatbot technology. From enhancing customer interactions to streamlining business processes, these articles delve into the innovative ways artificial intelligence is shaping the landscape of automated conversational agents. Whether you’re a business owner, developer, or simply intrigued by the future of interactive technology, join us on this journey to unravel the transformative power and endless possibilities of AI chatbots.
ADVERTISEMENT
Artificial intelligence chatbots are providing misleading or problematic medical advice in around half of all cases, raising fresh concerns about their growing role in everyday health queries, according to a new study cited by Moneycontrol.
The study, published in BMJ Open, evaluated five widely used platforms — ChatGPT, Gemini, Meta AI, Grok and DeepSeek — by posing 10 questions across five health-related categories. Researchers from the United States, Canada and the United Kingdom assessed the responses and found that approximately 50 per cent were problematic, including nearly 20 per cent classified as highly problematic.
The findings indicated that chatbots performed relatively better when responding to closed-ended questions and topics such as vaccines and cancer. However, performance declined significantly for open-ended queries and in areas such as stem cell treatments and nutrition.
Researchers noted that responses were often delivered with a high degree of confidence and certainty, despite lacking complete accuracy. None of the platforms provided a fully accurate and comprehensive reference list for any of the prompts. Only two instances of refusal to answer were recorded, both from Meta AI.
The study underscores growing concerns around the increasing reliance on generative AI tools for health-related guidance. These systems are not licensed to provide medical advice and do not possess the clinical judgement required for diagnosis or treatment decisions.
The rapid adoption of AI chatbots has made them a widely used resource for individuals seeking information about their health. OpenAI has previously stated that more than 200 million users ask health and wellness-related questions on ChatGPT each week. The company also introduced new health tools for both consumers and clinicians in January, while Anthropic announced a healthcare-focused offering for its Claude model during the same period.
According to the study’s authors, the unchecked deployment of such tools, without adequate public education and oversight, risks amplifying misinformation. They stated that the findings highlight behavioural limitations in AI chatbots and the need to reassess how these systems are used in public-facing health communication, noting that they often generate authoritative-sounding but potentially flawed responses.
ADVERTISEMENT
As the creator economy explodes, influencer marketing agencies are emerging as the real power brokers reshaping how corporate India spends its advertising money.
ADVERTISEMENT
Storyboard18 Awards for Creativity 2026 honoured campaigns that blended storytelling, cultural relevance and measurable impact across platforms.
ADVERTISEMENT
Brand Marketing
Storyboard18 Creativity Awards 2026: Swiggy, Nestlé, HDFC, Flipkart, Puma, Lahori Zeera take center stage
Brand Makers
Key takeaways from Global Pioneers Summit 2026: Why trust, storytelling and attention will define India’s next decade
Brand Makers
From Flipkart to Swiggy, winners of Storyboard18 Awards 2026: See photos (Part 1)
Brand Makers
Storyboard18 Awards 2026 winners in pics: Fevicol, KitKat, Swiggy (Part 2)
Special Coverage
SAC 2026: Why Piyush Pandey remains the North Star for India’s evolving creative landscape
Digital
YouTube to pause ads during peak livestream moments to ‘protect the vibe’
Digital
OpenAI launches GPT-5.4-Cyber days after Anthropic’s Mythos reveal
Brand Makers
Omnicom Global Solutions bets on scale and strategy as it absorbs IPG’s GCC into a 7,000-strong India engine
Digital
AI dominates content creation in marketing, but strategy and ROI remain human-led
Digital
86% of Indian startups to increase AI spend; productivity emerges as top use case

source

Scroll to Top