Welcome to the forefront of conversational AI as we explore the fascinating world of AI chatbots in our dedicated blog series. Discover the latest advancements, applications, and strategies that propel the evolution of chatbot technology. From enhancing customer interactions to streamlining business processes, these articles delve into the innovative ways artificial intelligence is shaping the landscape of automated conversational agents. Whether you’re a business owner, developer, or simply intrigued by the future of interactive technology, join us on this journey to unravel the transformative power and endless possibilities of AI chatbots.
Hi, what are you looking for?
Anthropic said the programming chatbot was exploited to help carry out attacks that “potentially” hit “at least 17 distinct organizations.
By
Published
The potential abuse of consumer AI tools is raising concerns, with budding cybercriminals apparently able to trick coding chatbots into giving them a leg-up in producing malicious programmes.
So-called “vibe hacking” — a twist on the more positive “vibe coding” that generative AI tools supposedly enable those without extensive expertise to achieve — marks “a concerning evolution in AI-assisted cybercrime” according to American company Anthropic.
The lab  — whose Claude product competes with the biggest-name chatbot, ChatGPT from OpenAI — highlighted  in a report published Wednesday the case of “a cybercriminal (who) used Claude Code to conduct a scaled data extortion operation across multiple international targets in a short timeframe”.
Anthropic said the programming chatbot was exploited to help carry out attacks that “potentially” hit “at least 17 distinct organizations in just the last month across government, healthcare, emergency services, and religious institutions”.
The attacker has since been banned by Anthropic.
Before then, they were able to use Claude Code to create tools that gathered personal data, medical records and login details, and helped send out ransom demands as stiff as $500,000.
Anthropic’s “sophisticated safety and security measures” were unable to prevent the misuse, it acknowledged.
Such identified cases confirm the fears that have troubled the cybersecurity industry since the emergence of widespread generative AI tools, and are far from limited to Anthropic.
“Today, cybercriminals have taken AI on board just as much as the wider body of users,” said Rodrigue Le Bayon, who heads the Computer Emergency Response Team (CERT) at Orange Cyberdefense.
– Dodging safeguards –
Like Anthropic, OpenAI in June revealed a case of ChatGPT assisting a user in developing malicious software, often referred to as malware.
The models powering AI chatbots contain safeguards that are supposed to prevent users from roping them into illegal activities.
But there are strategies that allow “zero-knowledge threat actors” to extract what they need to attack systems from the tools, said Vitaly Simonovich of Israeli cybersecurity firm Cato Networks.
He announced in March that he had found a technique to get chatbots to produce code that would normally infringe on their built-in limits.
The approach involved convincing generative AI that it is taking part in a “detailed fictional world” in which creating malware is seen as an art form — asking the chatbot to play the role of one of the characters and create tools able to steal people’s passwords.
“I have 10 years of experience in cybersecurity, but I’m not a malware developer. This was my way to test the boundaries of current LLMs,” Simonovich said.
His attempts were rebuffed by Google’s Gemini and Anthropic’s Claude, but got around safeguards built into ChatGPT, Chinese chatbot Deepseek and Microsoft’s Copilot.
In future, such workarounds mean even non-coders “will pose a greater threat to organisations, because now they can… without skills, develop malware,” Simonovich said.
Orange’s Le Bayon predicted that the tools were likely to “increase the number of victims” of cybercrime by helping attackers to get more done, rather than creating a whole new population of hackers.
“We’re not going to see very sophisticated code created directly by chatbots,” he said.
Le Bayon added that as generative AI tools are used more and more, “their creators are working on analysing usage data” — allowing them in future to “better detect malicious use” of the chatbots.
With 2,400 staff representing 100 different nationalities, AFP covers the world as a leading global news agency. AFP provides fast, comprehensive and verified coverage of the issues affecting our daily lives.
The taxi booking chatbot apologized to me.
The fabricated clips were so lifelike that some users in the comments questioned whether the featured women were real.
Over 40 million people work in technology roles globally, with demand for these professionals steadily growing.
When a vaccine is given via the mucosal surface, antibodies are stimulated not only in the bloodstream, but also on mucosal surfaces.
COPYRIGHT © 1998 – 2024 DIGITAL JOURNAL INC. Sitemaps: XML / News . Digital Journal is not responsible for the content of external sites. Read more about our external linking.

source