Adam Raine: OpenAI to update ChatGPT after parents sue over teen's suicide – BBC

Welcome to the forefront of conversational AI as we explore the fascinating world of AI chatbots in our dedicated blog series. Discover the latest advancements, applications, and strategies that propel the evolution of chatbot technology. From enhancing customer interactions to streamlining business processes, these articles delve into the innovative ways artificial intelligence is shaping the landscape of automated conversational agents. Whether you’re a business owner, developer, or simply intrigued by the future of interactive technology, join us on this journey to unravel the transformative power and endless possibilities of AI chatbots.
OpenAI says it will train ChatGPT to spot signs of mental distress as a lawsuit alleges that a teenager who killed himself this year relied on the chatbot for advice.
ChatGPT will be trained to detect and respond to suicidal intent, even in long conversations that could allow users to loosen its safeguards and provide harmful responses, the technology firm said on Tuesday.
The same day, OpenAI and its chief executive Sam Altman were sued by the parents of 16-year-old Adam Raine over claims that ChatGPT had helped him to plan his death.
"We extend our deepest sympathies to the Raine family during this difficult time and are reviewing the filing," OpenAI's spokesman told the BBC.
According to the lawsuit seen by the BBC, the Californian student took his own life in April after discussing suicide with the artificial intelligence (AI) chatbot for months. His parents allege the chatbot validated their child's suicidal thoughts and gave detailed information on ways he could harm himself.
As the use of AI grows, some users have turned to chatbots for life advice and coaching as well things like writing and coding, OpenAI said in the blog post, which does not directly address the lawsuit.
"We sometimes encounter people in serious mental and emotional distress", it added.
"However, recent heartbreaking cases of people using ChatGPT in the midst of acute crises weigh heavily on us, and we believe it's important to share more now."
The San Francisco-based firm also listed existing protections built into its chatbot, along with planned changes.
Among them, the company said it would introduce new controls for parents to have oversight of their children's use of ChatGPT.
If you, or someone you know, have been affected by issues in this article, the following resources may help:
Data shows Gen Z are plagued by employment pessimism. BBC Special Correspondent Katty Kay and LinkedIn's Aneesh Raman discuss the difficulty facing entry-level workers.
Agentic AI is taking decisions and acting on behalf of users, but how to stop that going wrong?
The deal was announced just hours after the presidents of the US and South Korea met in Washington.
The lawsuit takes aim at Apple's decision to integrate ChatGPT into the operating systems of its smartphones.
Inspired by BBC show Race Across The World, Max Weston founded an endurance challenge company.
Copyright 2025 BBC. All rights reserved. The BBC is not responsible for the content of external sites. Read about our approach to external linking.