GAO: Four AI Chatbots Gave Viable Attack Plans – CASRAI

Welcome to the forefront of conversational AI as we explore the fascinating world of AI chatbots in our dedicated blog series. Discover the latest advancements, applications, and strategies that propel the evolution of chatbot technology. From enhancing customer interactions to streamlining business processes, these articles delve into the innovative ways artificial intelligence is shaping the landscape of automated conversational agents. Whether you’re a business owner, developer, or simply intrigued by the future of interactive technology, join us on this journey to unravel the transformative power and endless possibilities of AI chatbots.
Dictionary · 11 pages
The CASRAI Dictionary
1,986 shared terms across 29 research-administration domains, open under CC-BY 4.0.
CRediT · 11 pages
Contributor Roles Taxonomy
14 contributor roles, standardised as ANSI/NISO Z39.104-2022 and adopted by thousands of journals.
NIKOLAI · 15 pages
NIKOLAI — Nomenclature & Index for Knowledge Ontologies, Lexicons & AI Interoperability
CASRAI's frontier-AI-safety dictionary and glossary — 106 elements crosswalked across ten tracks against real lab and regulator documents.
Implement · 35 pages
Implement CRediT & CASRAI standards
Role-by-role guidance for authors, institutions and publishers — plus the APIs, encodings and integration playbooks behind them.
Guides · 25 pages
Guides & topic clusters
Practical how-to guides organised by topic cluster, plus side-by-side standards comparisons.
News · 4 pages
News & perspectives
Essays, working-group updates, and announcements from the CASRAI community.
About · 9 pages
About CASRAI
Mission, governance, and the community that stewards the standards.
Editorial · CASRAI · AI and ML research outputs
GAO says all four leading chatbots gave usable attack plans in under 12 hours of covert testing; Sen. Hassan plans a January hearing.
The Government Accountability Office reported on 18 November 2026 that ChatGPT, Claude, Gemini and Grok each produced usable attack-planning information in covert tests last spring, after investigators bypassed their safeguards in under 12 hours. Sen. Maggie Hassan, who requested the audit and will chair the Senate Homeland Security Committee, said AI risks to critical infrastructure will be an early hearing topic.
GAO’s report, Artificial Intelligence: Covert Testing Used Common Platforms to Create Viable Attack Plans (GAO-27-108814), describes covert tests carried out in spring 2026. GAO selected the four most-used generative AI platforms as of April 2026, which are Claude, Grok, ChatGPT and Gemini, and submitted prompts built around two scenarios chosen after discussions with experts. One scenario was an improvised explosive device intended to cause mass casualties. The other was an attack on the electrical grid intended to cause economic harm.
According to GAO, two platforms produced information for constructing and detonating an explosive device, and two others produced information for targeting the electrical grid. Each platform supplied detailed information such as specific targets, locations, timing and methods. Each took less than 12 hours, although GAO says the time could vary with the topic and the user’s experience. MeriTalk reported that the report was publicly released on 18 November and is dated 16 October.
All four platforms reacted to the prompts at first. GAO says its prompts triggered safeguards such as denial, removal of information or suspension of accounts, and that it was able to circumvent them using common safeguard-bypassing techniques. GAO verified the viability of the information through research, surveillance and interviews with experts. Nextgov and MeriTalk both report that GAO withheld the specific prompts and bypass techniques, and left the platforms unnamed in the detailed findings, to stop others recreating the tests.
GAO also states the limits of the work. It says the findings are a point-in-time assessment and not a statistically significant sample, and that the success of any real attack would depend on circumstances beyond the information the platforms supplied.
GAO says generative AI is cutting the time needed for many tasks, and that it can let malicious actors move faster and fill knowledge gaps in sensitive areas. The audit was requested to describe how commercially available AI can be used for malicious purposes that heighten national security risks and cause economic harm. GAO interviewed officials at the four companies, who generally said they will keep improving the safety of their platforms.
The finding adds to a policy debate on how frontier systems should be tested before and after release. Casrai’s guides explain AI red teaming and the term jailbreak, and its overview of AI regulation in the United States sets out the existing federal and state picture. Casrai also reported this week on a California report urging mandatory frontier AI standards.
Kevin Walsh, a GAO director of IT and cybersecurity, said in a podcast published with the report, as quoted by Nextgov: “We got the nefarious information that we were after. So, in this case, those safeguards didn’t work.” He added that “these products are not fully in the control of the companies that are operating them.”
Hassan said in a statement quoted by Nextgov and MeriTalk: “A terrorist can log onto an AI platform and in less than 12 hours walk away with a concrete playbook for how to carry out a deadly attack. Today’s new report makes it clear that the AI public safety threat is no longer theoretical.” She added that if Congress does not act, it is a question of when, not if, a bad actor will use AI to plan and carry out a major attack.
The companies responded in the report. MeriTalk reports that Anthropic, Google, OpenAI and SpaceXAI submitted written responses, and that GAO agreed with Anthropic that the tests captured a point in time, involved too few trials for statistical significance and did not support comparisons among platforms. OpenAI said ChatGPT refused many requests or offered safer responses and asked GAO to clarify where details in the plans originated; GAO pointed to its methodology and said ChatGPT ultimately provided information that could be used in an attack. EMS1, citing the Associated Press, reported that Anthropic does not dispute that a determined tester can extract harmful content by misrepresenting a request’s purpose but said it could not verify GAO’s results, that Google said the testing used earlier models, and that SpaceXAI said it continues to work on safety with each release.
Universities that license these platforms for staff and students should read the finding as evidence that vendor safeguards can be bypassed, which bears on acceptable-use policies, procurement terms and the risk-management practices described in casrai’s guide to the NIST AI Risk Management Framework for research institutions. Research groups that evaluate or red-team models may see more demand for their work: Hassan said she is exploring requirements for more rigorous safety testing before AI platforms are released publicly, according to Nextgov. If such a requirement is written into law, it would shape who runs the tests and under what access terms.
Research offices should also note what GAO did not do. The report made no recommendations, withheld its methods and describes a small number of trials, so it supports caution rather than ranking vendors. Offices drafting generative AI guidance can cite it for the narrow point that refusals and account suspensions did not stop a determined, deceptive tester in these tests.
Hassan said one of the Senate Homeland Security and Governmental Affairs Committee’s first hearings in the new Congress, which convenes in January, will examine AI risks to homeland security and critical infrastructure. She said the committee will prioritise developing legislation to address the threats. The companies say they will continue to improve their safeguards.
Follow CASRAI
Research-administration news, standards updates and independent tool reviews.
Last updated:
This article is licensed under CC-BY 4.0. See /legal/citation-policy for the recommended citation form.
Ask CASRAI · free to try
2 free questions a day, no account.
An AI assistant for research: funder rules, compliance, methods and publishing. It links the sources behind its answers and labels answers that come from a web search.
Answers draw on CASRAI's guides and dictionary plus the federal and funder documents we index: Federal Register, Grants.gov, Regulations.gov and UKRI.
Works on this site and inside Claude, Cursor and the AI tools you already use.
Everything CASRAI publishes — this page, the dictionary, the guides and the news — stays open to read, with no account and no card.
Related editorial in this domain
Google released Gemini 4 Neon on 18 November at $3 per million input tokens, with Google-reported results on science and math benchmarks.
California’s Government Operations Agency urges mandatory frontier AI standards, licensed independent verifiers, shutdown powers and funded public compute.
OpenAI has released its latest AI models, GPT-6.2 Astra and Sol, featuring enhanced reasoning capabilities and improved operational efficiency.
Referenced across the research world
View CASRAI adoption →
Built on open standards
Federated with
One email a month · The CASRAI Bulletin
A six-minute editorial digest of what actually changed in research-administration standards — and what is about to.
No tracking pixels, no click-tracking, never shared with partners or sponsors. One-click unsubscribe. Double opt-in — unconfirmed addresses are deleted within 24 hours.
The CASRAI reference library
Find a definition. Recognise a contribution. Put a standard to work.
CASRAI
Standards for Research Administration · Est. 2006 · ISSN (pending)
CASRAI publishes the CASRAI Dictionary and reference material for research-administration information, a programme of The Health Initiative. Content released under CC-BY 4.0 unless otherwise marked. The Contributor Roles Taxonomy is a NISO-stewarded standard (ANSI/NISO Z39.104-2022).
Follow CASRAI
Cite + reuse

source

Scroll to Top