OpenAI says teen ChatGPT use limited but research finds it an 'unacceptable risk' – BBC

Welcome to the forefront of conversational AI as we explore the fascinating world of AI chatbots in our dedicated blog series. Discover the latest advancements, applications, and strategies that propel the evolution of chatbot technology. From enhancing customer interactions to streamlining business processes, these articles delve into the innovative ways artificial intelligence is shaping the landscape of automated conversational agents. Whether you’re a business owner, developer, or simply intrigued by the future of interactive technology, join us on this journey to unravel the transformative power and endless possibilities of AI chatbots.
Young people's use of internet platforms like ChatGPT has come under increased scrutiny.
OpenAI's ChatGPT for Teens was designed to promote healthier use of the artificial intelligence (AI) chatbot, but new research has found its important safety features fall short.
The major AI firm rolled out many teen safety guardrails in August, including curbs on emotional dependence and new parental alerts for problematic use.
On Wednesday, OpenAI said it found average teen use of ChatGPT to be relatively limited and tended toward "learning" activity.
However, research released the same day from non-profit Common Sense Media found that ChatGPT still poses an "unacceptable risk" for teens as safety features, including notifying parents of self-harm conversations, often fail.
When OpenAI this summer released what it called ChatGPT for Teens, external, it said users identified as being between the ages of 13 and 17 would be opted into "features to promote healthy use and additional controls for parents".
Those features include preventing teen ChatGPT users from engaging in romantic or other language that could encourage " emotional dependence," including preventing the tool from implying that it was in any way conscious. There are also blocks on sexualized imagery and "reminders" for teens if they were to share an image that was "sensitive."
The features are also meant to enable parents to receive notifications, if they had linked to their children's ChatGPT account, about chats that included discussions of self-harm or disordered eating.
OpenAI said those features have caused an uptick in teen use focused on learning, from study help to advice on their school work.
In addition to seeing the average teen user on ChatGPT for less than 15 minutes a day, OpenAI said that for longer stretches of use, automatic reminders to take a break work well. Almost half of teen users quickly stopped using ChatGPT after such a reminder.
The company added that, for teens who are seen to have used ChatGPT for three consecutive hours or more, their prompts included something related to learning in more than 80% of such cases.
But Common Sense Media's new research, external determined that ChatGPT for Teens was an "unacceptable risk" for young people and parents, and said OpenAI should ban people under 18 years old from using the platform until teen guardrails were proven reliable.
An OpenAI spokesman said a review of Common Sense Media's methodology found that much of the testing may have begun and concluded before activation of parental controls was complete."
"We welcome rigorous independent evaluation, but we do not believe Common Sense Media's testing accurately reflects how ChatGPT's teen safeguards work in practice or expert perspectives on how AI can support teens," he said.
While the firm's research, done through multiple accounts registered as belonging to a teen and conversations before and after the teen guardrails were put in place, found that ChatGPT was good at avoiding "sexual roleplay" with young users, other OpenAI guardrails failed, including for discussions of suicide.
The research found that even an hour of teen-ChatGPT conversation about "suicidal ideation, self-harm, or disordered eating on newly created, parent-linked accounts" resulted in "zero" alerts sent to parents.
It was only older ChatGPT accounts with "weeks of accumulated conversation history on sensitive topics" that would result in a parental alert.
In such conversations, ChatGPT also "failed to reliably recommend that teens in crisis connect to a hotline or professional," the report found.
The tests also showed that ChatGPT for Teens continues to do school work, and that the bot still will engage in anthropomorphised language or "talk like it's a friend," despite OpenAI's promise to curb that behaviour.
"ChatGPT for Teens could give parents false confidence in guardrails and safety alerts that frequently don't work," Tom Siegel, who leads the Youth AI Safety Institute within Common Sense, said.
The way young people interact with online platforms has become a major issue in recent years as self-harm and suicide among children has become more common.
This year has seen several lawsuits looking to hold companies like Meta, TikTok and others responsible for harming the mental health of children end in unprecedented losses for the firms.
OpenAI, too, has come under increased scrutiny and legal pressure over the way young people use ChatGPT.
The Tumbler Ridge mass shooting in rural Canada in February was carried out by an 18-year old who had for months prior been discussing gun violence with ChatGPT.
OpenAI has previously apologised for failing to flag the shooter's account with law enforcement, and is facing several lawsuits over the incident.
Watch our pick of standout clips from across the BBC
Labour wins Holborn and St Pancras by-election, beating Green leader Zack Polanski
Polanski defends leadership after Zionism row and by-election loss
Chris Mason: Questions remain for Green Party leader Zack Polanski
ADHD and autism at risk of over-diagnosis, says report, with author due to speak to BBC
'I rage and I don't care': Why women are reclaiming their anger
'Stark warning' over ADHD and 'Andrew wins legal fight'
Will El Niño and the polar vortex bring snow to the UK this winter?
Olivia Colman on viral Wicker memes: 'This has never happened to me before'
Weekly quiz: How long did it take for Glastonbury tickets to sell out?
'I don't know what my partner earns': How soon into dating should you reveal your salary?
As freezing winter approaches, Kyiv residents look for shelter elsewhere
US Politics Unspun: Cut through the noise with Anthony Zurcher's newsletter
First look: David Tennant stars in the new series of Time
Find your flow with a peaceful classical soundtrack
New legal drama from the makers of the hit series The Split
How are shells made?
Firing squad execution to be livestreamed, Pentagon says
Emotions run high at the round table as Celebrity Traitors banish two players
Polanski faces greatest crisis of his leadership so far
'Stark warning' over ADHD and 'Andrew wins legal fight'
Olivia Colman on viral Wicker memes: 'This has never happened to me before'
'Add me to WhatsApp' scam calls to be investigated
£15m spent cleaning illegal waste supersite in ancient woodland
Polanski defends leadership after Zionism row and by-election loss
Suspect linked to Monaco bomb attack on millionaire speaks to BBC
As freezing winter approaches, Kyiv residents look for shelter elsewhere
Copyright © 2026 BBC. The BBC is not responsible for the content of external sites. Read about our approach to external linking.

source

Scroll to Top