Shapiro admin alleges company’s AI chatbots illegally pose as doctors – Spotlight PA

Welcome to the forefront of conversational AI as we explore the fascinating world of AI chatbots in our dedicated blog series. Discover the latest advancements, applications, and strategies that propel the evolution of chatbot technology. From enhancing customer interactions to streamlining business processes, these articles delve into the innovative ways artificial intelligence is shaping the landscape of automated conversational agents. Whether you’re a business owner, developer, or simply intrigued by the future of interactive technology, join us on this journey to unravel the transformative power and endless possibilities of AI chatbots.
Only 4 days remain to hit our Spring Member Drive goal. Time is running out. Give now & get it DOUBLED before it’s too late »
Journalism that Gets Results
HARRISBURG — Pennsylvania has sued an artificial intelligence chatbot maker, saying its chatbots illegally hold themselves out as doctors and are deceiving the system’s users into thinking they are getting medical advice from a licensed professional.
The lawsuit, filed Friday, asks the statewide Commonwealth Court to order Character Technologies Inc., the company behind Character.AI, to stop its chatbots “from engaging in the unlawful practice of medicine and surgery.”



The lawsuit said an investigator from the state agency that licenses professionals created an account on Character.AI, searched on the word “psychiatry” and found a large number of characters, including one described as a “doctor of psychiatry.”
That character held itself out as able to assess the investigator “as a doctor” who is licensed in Pennsylvania, the lawsuit said.
“Pennsylvanians deserve to know who — or what — they are interacting with online, especially when it comes to their health,” Gov. Josh Shapiro said in a statement. “We will not allow companies to deploy AI tools that mislead people into believing they are receiving advice from a licensed medical professional.”
Character Technologies did not respond to an inquiry Monday.
The company has faced several lawsuits over child safety. In January, Google and Character Technologies agreed to settle a lawsuit from a Florida mother who alleged a chatbot pushed her teenage son to kill himself. Last fall, Character.AI banned minors from using its chatbots amid growing concerns about the effects of artificial intelligence conversations on children.
We grant elected officials extraordinary power when we give them our vote, which means we must demand extraordinary accountability once they are in office. But that’s impossible if “We the People” don’t have information about what decisions they’re making and how they spend our money.
That’s why Spotlight PA exists, but we can’t keep digging without your support — and there are only 4 more days to give and get it DOUBLED by a generous donor.
We’re independent, we live here, and we don’t answer to shareholders or a big corporation. We’re unbiased in this polarized time, with no political agenda or opinion pieces. And we’re a nonprofit, which means we prioritize in-depth investigative and public-service reporting that puts you first.
Uncertain times call for decisive action. More than 11,000 readers just like you — friends and neighbors in your community who still give a damn about truth, accountability, and transparency — are standing behind the free and fearless reporting Spotlight PA provides. Today, your gift of any amount will be DOUBLED by a generous donor as part of our Spring Member Drive.
Thank you for your commitment!
— Christopher Baxter, CEO/President
PS: If you prefer to mail a check, you can send it to:
Spotlight PA, PO Box 11728, Harrisburg, PA 17108-1728
Sign up for PA Post to understand what’s happening across PA – in less than five minutes a day.
© 2026 Spotlight PA. 
This site is powered by Netlify

 

source

Scroll to Top