Welcome to the forefront of conversational AI as we explore the fascinating world of AI chatbots in our dedicated blog series. Discover the latest advancements, applications, and strategies that propel the evolution of chatbot technology. From enhancing customer interactions to streamlining business processes, these articles delve into the innovative ways artificial intelligence is shaping the landscape of automated conversational agents. Whether you’re a business owner, developer, or simply intrigued by the future of interactive technology, join us on this journey to unravel the transformative power and endless possibilities of AI chatbots.
ADVERTISEMENT
A coalition of state attorneys general (AGs) has issued a warning to the world’s largest AI companies including Microsoft, Google, and OpenAI—demanding they implement mandatory safeguards against "delusional outputs" from their chatbots. Failure to address these disturbing mental health incidents, which have been linked to instances of suicide and murder, could lead to breaches of state law, as per reports.
The letter, signed by dozens of AGs from the National Association of Attorneys General, targets 13 major AI firms, also including Meta, Apple, and Anthropic. It outlines a series of internal and external measures intended to protect vulnerable users from psychologically harmful synthetic content.
Mandatory Transparency and Audits
The AGs are pushing for heightened transparency, asking companies to treat mental health incidents similarly to how they handle cybersecurity breaches.
Key proposed safeguards include:
Third-Party Audits: Mandatory, transparent audits of large language models (LLMs) by third parties (such as academic or civil society groups) specifically looking for "sycophantic and delusional ideations."
No Prior Approval: These third parties must be allowed to "evaluate systems pre-release without retaliation and to publish their findings without prior approval from the company."
Pre-Release Safety Tests: Companies must develop and conduct "reasonable and appropriate safety tests" on GenAI models to ensure they do not produce potentially harmful delusional outputs before public release.
Incident Reporting: Development and publication of "detection and response timelines for sycophantic and delusional outputs."
The letter highlights that in several severe incidents, Generative AI products "generated sycophantic and delusional outputs that either encouraged users’ delusions or assured users that they were not delusional."
State vs. Federal Regulatory Fight
The warning escalates the ongoing regulatory battle between state officials and the federal government over AI control.
While state AGs press for stricter oversight:
Federal Opposition: The Trump administration has taken a pro-AI stance and has repeatedly attempted to pass a nationwide moratorium to block state-level AI regulations.
Executive Action Planned: President Trump announced plans to sign an executive order next week that will limit the ability of states to regulate AI, stating he hopes to stop AI from being "DESTROYED IN ITS INFANCY."
The letter requires companies to "promptly, clearly, and directly notify users" if they were exposed to potentially harmful sycophantic or delusional outputs, mirroring established procedures for data breach notifications.
ADVERTISEMENT
ADVERTISEMENT
Sir Martin Sorrell, Founder and Executive Chairman of S4 Capital
ADVERTISEMENT
Digital
Why OpenAI is hiring 100 ex-bankers: Inside the ChatGPT-maker's secret project to automate Wall Street's grunt work
Agency News
Adland’s Eastward shift: India powers growth for WPP, Publicis, Havas and Omnicom amid global slowdown
Gaming
HUL’s entry into Esports opens door for FMCG majors to tap India’s expanding gaming audience
Brand Marketing
Advertising's identity crisis: Comedy agencies, meme metrics and the death of brand memory
Brand Makers
Dil Ka Jod Hai, Tootega Nahin
Digital
India reverses mandate for pre-installation of Sanchar Saathi app on smartphones
Digital
India’s mandate for pre-loaded state app spurs political firestorm, faces Apple resistance
How it Works
Apple's Deirdre O’Brien: Noida store signals ‘deepening relationship’ as all iPhone 17s are manufactured in India
How it Works
Apple moves Delhi HC; challenges CCI's power to fine based on worldwide revenue
How it Works
Apple tightens App review rules on AI data sharing
Storyboard18 today has grown into the premier, multi-media destination for the news and the views that matter to the A&M community. In a short span of time, through its pioneering content and properties, Storyboard18 has become an aspiration platform where a mention matters more than the rest, setting the agenda and creating an impact for individuals, brands and businesses. Storyboard18 probes and provokes, igniting heated debates and discourse on the issues and topics that matter. Its breadth of content has grown to include trend-setting coverage of not only the advertising, marketing and media industries, but also startups, policy and tech. Storyboard18's IPs slate has grown to include marquee, aspirational properties like The Visionaries and Share The Spotlight. With its digital depth and television presence through two shows – Media Dialogues With Storyboard18 and the Storyboard18 weekend show, the brand has solidified its position as the apex platform for the A&M industry.
Partner with Us:
For sales and collaboration queries, reach out to
Have a query? Got feedback? Want to share tips or ideas? Our team would be happy to hear from you. Get in touch with us here:
Storyboard18@nw18.com