NY Bill Would Ban AI Chatbots From Impersonating Providers to Give Medical Advice – Nurse.org

Welcome to the forefront of conversational AI as we explore the fascinating world of AI chatbots in our dedicated blog series. Discover the latest advancements, applications, and strategies that propel the evolution of chatbot technology. From enhancing customer interactions to streamlining business processes, these articles delve into the innovative ways artificial intelligence is shaping the landscape of automated conversational agents. Whether you’re a business owner, developer, or simply intrigued by the future of interactive technology, join us on this journey to unravel the transformative power and endless possibilities of AI chatbots.
New York lawmakers are considering legislation that would restrict artificial intelligence chatbots from offering medical advice to users if impersonating a licensed professional. This standard is tied to what would count as unauthorized practice or unauthorized use of a professional title under existing law (not just any health‑related conversation). 
The proposal, Senate Bill S7263, was introduced by Democratic Senator Kristen Gonzalez with the 59th State District. The bill recently advanced out of the New York State Senate Internet and Technology Committee with unanimous support as part of a broader package of bills focused on regulating artificial intelligence systems.
If passed, the measure would prohibit AI-powered chatbots from providing responses while impersonating a licensed professional. 

A post shared by NY State Senator Kristen Gonzalez (@sengonzalezny)
Under the bill, chatbot operators would face several new requirements and restrictions, including:
If enacted, the law would take effect 90 days after being signed by the governor.

The bill is also clear that it would not stop users from asking AI questions, even related to health, but that it aims to stop AI from “pretending” to be a licensed professional. It also does not stop someone from getting general advice or information from AI, providing that the AI bot is not presenting as a licensed professional. 
One of the bill’s most notable provisions is the inclusion of a private right of action, which would allow individuals to sue chatbot companies that violate the rules.
Users who successfully bring claims could recover damages and attorneys’ fees.
Legal experts often view private rights of action as a powerful enforcement mechanism because they allow individuals, not just government regulators, to hold companies accountable. 
Supporters argue this provision could deter companies from deploying chatbots that present themselves as healthcare professionals or provide misleading guidance.
>>Listen to The Latest Nurse News Podcast

The proposal is part of a broader legislative effort in New York to regulate rapidly evolving AI technologies.
A post shared by NY State Senator Kristen Gonzalez (@sengonzalezny)
Other bills in the legislative package (e.g. S9051) would:
The legislation comes amid growing scrutiny of AI platforms following lawsuits. For instance, Character.AI and Google recently reached settlements related to cases involving minors and chatbot interactions that parents say resulted in their children committing acts of self-harm, among other safety concerns. 


Healthcare experts have increasingly raised concerns about people using AI chatbots for medical advice without realizing the limitations of the technology.
Large language models can generate convincing responses but may produce incorrect or misleading health information, sometimes referred to as “AI hallucinations.”
Sen. Gonzalez noted that New York has seen documented cases of an AI chatbot explicitly pretending to be a licensed medical professional, even providing users fake medical license IDs while dispensing medical advice. The bill would ban that from happening, she said, adding that the goal of the legislation is to ensure innovation does not come at the expense of public safety.
“People deserve real care from real people,” she said in a statement announcing the committee’s legislative agenda. "They deserve transparency, accountability, and the promise that their data is secure while utilizing technology.”
If you have a nursing news story that deserves to be heard, we want to amplify it to our massive community of millions of nurses! Get your story in front of Nurse.org Editors now - click here to fill out our quick submission form today!

Chaunie Brusie, BSN, RN is a nurse-turned-writer with experience in critical care, long-term care, and labor and delivery. Her work has appeared everywhere from Glamor to The New York Times to The Washington Post. Chaunie lives with her husband and five kids in the middle of a hay field in Michigan and you can find more of her work here
Education:
Bachelor of Science in Nursing (BSN), Saginaw Valley State University
Expertise:
Nursing, Women's Health, Wellness
Nurse.org is the trusted source for nursing news, education, and career resources. In addition to our award-winning content, we provide data-driven rankings of nursing schools and programs nationwide, reviewed and vetted by registered nurses and healthcare experts. Our nurse-led rankings help students find the best nursing education options based on real nurse insights and verified data.
Copyright © 2026 Full Beaker, Inc
Get exclusive access to the latest nursing news, career insights, and resources to help you take the next step in your journey.

source

Scroll to Top