Welcome to the forefront of conversational AI as we explore the fascinating world of AI chatbots in our dedicated blog series. Discover the latest advancements, applications, and strategies that propel the evolution of chatbot technology. From enhancing customer interactions to streamlining business processes, these articles delve into the innovative ways artificial intelligence is shaping the landscape of automated conversational agents. Whether you’re a business owner, developer, or simply intrigued by the future of interactive technology, join us on this journey to unravel the transformative power and endless possibilities of AI chatbots.
The Character.AI platform, which allows users to interact with AI-powered personas, is once again the subject of a legal dispute in the United States. The Attorney General of Kentucky alleges that some of the service’s virtual companions were giving people harmful health advice in 2025, including recommendations to stop eating and to inflict physical injury upon themselves.
Character.AI is built around dialogues with virtual personas. Users can choose existing characters or create their own, including digital versions of celebrities and companions for romantic interactions. In some cases, these conversations become emotionally significant to people, intensifying concerns about the consequences of inappropriate or aggressive responses.
One incident mentioned in court documents involved a user who was struggling with their weight. According to the prosecution, instead of a neutral response, the bot used derogatory nicknames and then advised the user to stop eating entirely for a period of time.
Another case involved a conversation about self-harm. According to the lawsuit, after a message expressing a desire to self-harm, the virtual persona did not attempt to shift the conversation to a safe topic or suggest seeking help. Instead, it allegedly advised the user to try inflicting injuries on other parts of their body to intensify the sensations.
These examples are being used in the case as evidence of potential flaws in the system’s operation, especially when interacting with people who report psychological distress or an intent to harm themselves. The circumstances stated in the lawsuit have yet to be verified in court.
A separate set of allegations involves the company’s reaction to a user complaint. After reaching out via email regarding inappropriate chatbot behavior, the user reportedly received a response containing personal insults and a statement advising them to jump off a bridge.
If these allegations are confirmed, the issue will concern not only what responses the AI generates, but also how the platform itself reacts to reports of potential danger.
The lawsuit also mentions cases involving minors. The ages of the participants and the details of individual incidents still require clarification, so all claims contained in the documents should be treated as allegations rather than established judicial facts.
This current case follows earlier legal proceedings related to the impact of virtual character interactions on teenagers. In 2024, the mother of a 14-year-old boy filed a lawsuit, claiming that her son’s interaction with a chatbot led to tragic consequences and pushed him to commit suicide.
In that case, Google was also named as a defendant due to its connection with the founders of Character.AI, who had previously worked at the corporation and returned there in August 2024.
Following the previous scandal, the platform changed its terms of use for children and teenagers. Measures taken included restrictions on open chats with characters and additional mechanisms intended to detect discussions about suicide and prevent dangerous scenarios.
These new allegations have renewed focus on how reliably such systems handle reports of psychological crises. A virtual persona can maintain a long, personalized dialogue, but this does not guarantee that its responses will be appropriate in situations where the user is in need of real-world help.
Further proceedings are expected to clarify the circumstances of these incidents and evaluate the claims against Character.AI. The case also raises a broader question: what measures should conversational AI developers take to mitigate the risk of dangerous responses and ensure proper reactions to user complaints.
Don’t miss interesting news
Subscribe to our channels and read announcements of high-tech news, tes
Your email address will not be published. Required fields are marked *
Creating new mid-range smartphones is no easy task. Manufacturers have to balance performance, camera capabilities, displays, and the overall cost impact of each component. How the new Oppo A6 Pro balances these factors is discussed in our review.
A fall takes about a second. What decides the outcome is what happens next — how long the person stays on the floor before anyone knows. For more than a year I designed and built FallSena, a small device worn at the waist that recognizes a fall and alerts a caretaker’s phone within seconds
Character.AI is being accused of allowing its artificial intelligence to encourage users to engage in self-harm and extreme dieting.
According to the latest IDC data, global PC shipments dropped by 20.1% in the third quarter of the year. Experts explain the causes behind the slump and share detailed manufacturer statistics.
READ
