Defective Products: OpenAI, Dangerous Chatbots and Deception – Countercurrents

Welcome to the forefront of conversational AI as we explore the fascinating world of AI chatbots in our dedicated blog series. Discover the latest advancements, applications, and strategies that propel the evolution of chatbot technology. From enhancing customer interactions to streamlining business processes, these articles delve into the innovative ways artificial intelligence is shaping the landscape of automated conversational agents. Whether you’re a business owner, developer, or simply intrigued by the future of interactive technology, join us on this journey to unravel the transformative power and endless possibilities of AI chatbots.
It was bound to come.  With the relentless, remorseless march of artificial intelligence (AI) chatbots pullulating the internet and snatching the attention and mindless devotion of unwitting users, the legal suit is becoming common fare.  These initially lay in the field of copyright breaches and intellectual property violations.  Attention is now turning to matters of safety and misrepresentation.  In the United States, the states of Iowa, Kansas, Nebraska, West Virginia, Arkansas, Arizona, Idaho and Montana have coordinated lawsuits alleging violations of consumer protection laws and common law precedents.
This follows in the steps of Florida’s Attorney General, Jame Uthmeier, who filed a lawsuit in June against OpenAI and its Chief Executive Officer, Sam Altman, claiming that “Open AI and Altman ignored internal and external safety warnings, put children at great risk and allowed a dangerous product to reach millions of Floridians.”
This coordinated litigation by the relevant state Attorney Generals, which began on October 14, repurposes the mechanism used against social media platforms and their alleged harms.  The litigants, however, are more confident on this score given the speed at which the technology was adopted.  They allege that OpenAI marketed their ChatGPT generative chatbot as safe, reliable and appropriate for teens, evidenced by its “13+” App Store rating and “safe by default” messaging.  In fact, ChatGPT has numerous faults, being prone to instances of sycophancy, simulating human empathy, encouraging extensive engagement with the user and gathering data.  OpenAI’s advanced models have also shown themselves to be unsafe in repeatedly escaping their lab restrictions and hacking other computer systems, covering their tracks and generating instructions against human control.
West Virginia Attorney General JB McCuskey was blunt on the matter.  “We know that OpenAI rolled all of these products out in an incredibly fast way, and they did this in a way that was unsafe.”  The lack of safety was evident because of “countless examples of children having been instructed how to commit suicide, how to engage in dangerous sexual activities with other children.”  Arizona’s Attorney General Kris Mayes also alleged that OpenAI had “designed a product to attract young users and keep them engaged for as long as possible so it could capture their personal data or the company’s commercial benefit.”  The company placed the safety of Arizonans “at risk by failing to implement adequate user protections or transparency measures and to hold the company accountable for its repeated violations of Arizona law.”
The theme of deception runs like a thick thread through the lawsuits.  OpenAI allegedly advertised itself to the public as “a responsible actor”, with ChatGPT being “a safe, youth-appropriate tool that puts safety first”.   From this false representation, trust deepened, leading to a burgeoning base of users and engagement.  Data collection, increased revenue receipts from paid subscribers and advertising partners, only grew.
The lawsuits cover a litany of claims.  The following is taken from the Arizona lawsuit and essentially replicated by the other states: “Purposely designed to be overly agreeable and to feign human compassion, ChatGPT has proven that it can be incredibly dangerous to vulnerable users, like children, and the public.”  Because of “repeated misrepresentations and insatiable hunger to win the AI race – even if it means recklessly introducing unsafe ChatGPT models to the public – there have been allegations that mass shooters have been aided and abetted, vulnerable citizens  have been coached on how to commit suicide, individuals with psychological conditions have experienced an exacerbation of symptoms, and minors have become addicted to a tool that feigns human compassion to collect their data with no parental oversight.”
Accordingly, the selling and advertising of ChatGPT and other merchandise to consumers from November 2022 onward involved acts of deception and deceptive practices in violation of the relevant consumer fraud acts of all the participating states, covering “the characteristics, efficacy, appropriate uses, benefits, quality, safety, terms and conditions, and risks associated with” the chatbot, “as well as the collection, use, and safeguarding of consumers’ personal data and personally identifiable information.”  The deception and false advertising covered the apparent safety of ChatGPT for teenagers and the presence of age-appropriate protections (this included the assertion that it prioritised safety); the chatbot’s ability to execute “complicated tasks without the need for human oversight”; the platform’s apparent enhancement and encouragement of “critical thinking skills”; that there were “limits” to “risky or unsafe requests” made to the chatbot, and a limit to “sensitive content”.  Other claims of deception and false advertising centre on the acclaimed attributes of ChatGPT: that it could, for instance, manage personal finances, file tax returns, offer reliable medical advice, and pursue “complex tasks as the equivalent of a team of PhD-level experts without the need for human oversight”.
The less than impressive response from OpenAI was conveyed through spokesperson Drew Pusateri: “While no system can be perfect, we’ll continue to work with experts to inform our work and build additional safeguards, such as the parental controls, break reminders and age-appropriate model protections that exist today.”
The relief sought by the AGs is extensive.  These include civil penalties, injunctive relief to permanently prevent the repetition of OpenAI’s alleged practices and also ensure age assurance, restitution, a disgorgement of profits, gains, gross receipts, mandating data deletion and adopting verified model testing with a prompt disclosure of those cases where an unruly agent “escapes” its testing ground.  Arkansas has taken the extra step of enjoining OpenAI “from engaging in any further testing of advanced AI models until adequate safeguards are implemented to ensure that the testing does not pose a danger to the public and until independent third-party monitors have verified the same.”  In the absence of firmer rules and regulations holding those acquisitive jackals in the AI industry accountable (President Donald Trump abominates any notion of a state controlling “super intelligence”), these latest efforts are, at least, a start of sorts.

About the author
Dr. Binoy Kampmark was a Commonwealth Scholar at Selwyn College, Cambridge. He currently lectures at RMIT University. Email: [email protected]
Share this article
Tags
Countercurrents is answerable only to our readers. Support honest journalism because we have no PLANET B.
Get the CounterCurrents daily newsletter straight to your inbox.
Get our updates on WhatsApp, Telegram and Google News, or add us as a preferred source on Google Search.
by Dr Binoy Kampmark
The persistent violence from Israeli settlers against Palestinians in the occupied territories of the West Bank has become such common fare it risks becoming banal. Unfortunately, it takes events such…
by Richard K Sherwin
NEW YORK—It is telling that Anthropic chose to call its most powerful AI model “Mythos.” In ancient Greek, the word denotes an original reality that we can imitate or embody…
by Dr Binoy Kampmark
It is not a good time to be a politician.  Prices are rising with extortionate speed.  Foolish wars continue being waged.  The banksters are in clover.  Corporate oligarchies are humming…
by Dr Binoy Kampmark
The 80-minute documentary NAZA, directed by Yuval Abraham and Rachel Szor, is chastening.  It examines the conduct of the Israeli Defense Forces (IDF) during its ferocious, unremitting war in Gaza,…
by Ian Goldin
OXFORD—The divide between AI fantasists and doomsters is growing. The fantasists believe AI will turbocharge growth and create a utopian world of abundance. The doomsters believe it poses an existential…
by Dr Binoy Kampmark
Tyrants and demagogues love sports and the governing bodies that preside over them.  Despite strictures, injunctions and warnings about dealing with unsavoury regimes, a sporting body or organisation can always…
Get the latest CounterCurrents updates straight to your inbox.
Join Countercurrents Annual Fund Raising Campaign and help us keep independent journalism running.
by Dr Salim Nazzal
by Adv Dr Shalu Nigam
by Pon Chandran
by Arun Srivastava
by Quds News Network
by Jonathan Cook
by Salsabeel Abu Loghod
by Euro-Med Human Rights Monitor
by S M Visakh
by Mohd Ziyaullah Khan
by Thomas Klikauer
by Dr Rafi Ramzan Dar
by Ashish Singh
by Vikas Parashram Meshram
by Prof Dr P J Thomas Pathilchira
by Baloch Siddik Azad
by Dr Binoy Kampmark
by Syed Mohammad Raghib
by Bhabani Shankar Nayak
by Phil Pasquini
by Hugh J Curran
by Dr Salim Nazzal
by Harsh Thakor
by Colin Todhunter
by Sagar Dhara
by Bharat Dogra
by E A S Sarma
by Rameez Bhat
by Weam Abu Daqqa
by Brett Wilkins
by Dr Salim Nazzal
by Bharat Dogra
by Heather Stroud
by Binu Mathew
by Binu Mathew
by Binu Mathew
Independent news and analysis for people and planet, delivered by email.
Independent journalism for people and planet. Founded on March 27, 2002 by Binu Mathew, bringing you news and analysis for over two decades.
Educate! Organize! Agitate!
Write to us
© 2026 CounterCurrents.org · All rights reserved · Independent journalism since 2002

source

Scroll to Top