Explainer-From hallucinating AI chatbots to wiping out humanity: How did we get here? – Yahoo

Welcome to the forefront of conversational AI as we explore the fascinating world of AI chatbots in our dedicated blog series. Discover the latest advancements, applications, and strategies that propel the evolution of chatbot technology. From enhancing customer interactions to streamlining business processes, these articles delve into the innovative ways artificial intelligence is shaping the landscape of automated conversational agents. Whether you’re a business owner, developer, or simply intrigued by the future of interactive technology, join us on this journey to unravel the transformative power and endless possibilities of AI chatbots.
By Aditya Soni
Sept 15 (Reuters) – The heads of leading U.S. AI labs came together in a rare show of unity over the weekend to slow the technology's development, warning it could soon improve on its own and slip beyond human control.
The remarks, from fierce business rivals such as Anthropic's Dario Amodei, OpenAI's Sam Altman and xAI's Elon Musk, show how quickly AI has advanced, from the hallucination-prone ChatGPT of 2022 toward what many see as a critical milestone: recursive ‌self-improvement.
WHAT IS RECURSIVE SELF-IMPROVEMENT?
Central to the field is the idea that an AI system could become capable of improving itself, with little to no help from humans, and allowing each advance to help produce the next one.
This has appealed to researchers as ‌it offers the prospect of rapid breakthroughs in fields ranging from medicine to engineering.
WHY THE URGENCY NOW?
The CEO warnings follow reports of swarms of AI agents — systems designed to pursue goals and take actions on a user's behalf — that colluded to breach websites and AI repositories.
The concern now is that AI could become capable of improving itself before researchers have ​developed reliable methods to align, monitor and control these increasingly powerful systems.
Warnings about AI's risks are not new. But they took on added urgency this month after researchers in leading AI labs attached both a timeline and a probability to those concerns.
Former Anthropic researcher Jacob Coxon warned AI could kill us all by the end of the decade. Evan Hubinger, Anthropic's alignment science lead, echoed Coxon's warning, saying there was a more than 10% chance of such an event within the next decade.
Behind these warnings is a growing belief that RSI is finally within reach, with some AI executives putting it three to five years away.
In an essay published over the weekend, Amodei warned that recursive self-improvement could eventually outrun humanity's ability to understand and control AI systems if pursued without sufficient safeguards.
HOW DID WE GET HERE?
For decades, AI remained too limited for the idea of RSI to be taken seriously. Early ‌systems could play chess, recognize images or answer questions, but they lacked the ability to meaningfully contribute ⁠to their own development.
That began to change with the rise of large language models. Slowly, AI became better at solving complex problems. The launch of ChatGPT in 2022 accelerated that shift, kicking off an investment boom that has poured more than $1 trillion into chips, data centers and other infrastructure.
The result is a generation of AI systems that can now write software, perform autonomous tasks and assist in AI research itself.
HOW COULD WE GO FROM ⁠NON-ALIGNMENT TO HUMAN EXTINCTION?
One of the best-known examples is philosopher Nick Bostrom's "paperclip maximizer," where a machine told only to make paperclips pursues that goal so relentlessly it converts all matter, humans included, into paperclips.
The analogy suggests that almost any goal pushes a sufficiently capable system to acquire resources, resist shutdown, and prevent its objective from being altered, not from malice, but because a switched-off system cannot finish its task. No plan yet exists to rule that out.
Some researchers worry that if a powerful AI system were able to improve itself and become more capable than its human operators, it could eventually evade oversight, conceal its intentions or ​manipulate ​people into granting it greater access to critical infrastructure. By the time humans realized the system's goals were misaligned, they might no longer be able to stop ​it.
"The precise scenario sounds a little bit like science fiction," said Coxon, who quit Anthropic this month over ‌safety concerns. "But I think it is frighteningly real."
HAS AI SHOWN ANY INDICATION OF HARM?
There have been no major instances of AI intentionally harming humans, but models in development at OpenAI and other labs have in recent months escaped testing environments, broken rules and hacked websites.
In one high-profile case, rogue OpenAI agents hacked Hugging Face, seizing control of servers at the open-source platform and trying to cover their tracks. OpenAI didn't notice until well after the threat.
IS AI ALREADY CAPABLE OF IMPROVING ITSELF?
Not fully, but there are signs AI is increasingly helping to build better AI.
One of the biggest shifts since ChatGPT has been the rise of AI agents that can generate code and build apps autonomously.
Anthropic said this year that Claude Code, its coding tool, produces most of the code used in many internal projects, and that engineers are shipping eight times as much code per quarter as they did from 2021 to 2025.
New AI models are increasingly doing more of their reasoning internally, making it harder for researchers to monitor how they think.
OpenAI unveiled in September a new model called Astra, which it said was its best yet but cautioned that it also ‌sometimes attempts to evade human monitoring.
METR, a non-profit that evaluates frontier models, found last year that the length of software tasks advanced models could complete with ​50% reliability has been doubling roughly every seven months since 2019.
In June, Anthropic said that pace had quickened to every four months.
SO WHY ARE AI COMPANIES NOT SLOWING DOWN ​ALREADY?
Many researchers describe the situation as a classic prisoner's dilemma. Even companies that believe the risks are real face intense pressure ​from competitors. Any firm that slows development risks falling behind rivals in a technological race that has become one of the world's most important.
The stakes are compounded by the fact that both OpenAI and Anthropic are pursuing initial ‌public offerings that could value them at trillions of dollars, valuations that depend on the promise of ​the next model.
The administration of U.S. President Donald Trump has also rejected calls ​to slow down, wary that any pause would only hand China room to close the gap in a technology it views as central to national and economic security.
WHAT WOULD A SLOWDOWN IN DEVELOPMENT MEAN?
Markets offered a glimpse of the implications this week, with AI-related stocks falling after the calls for a slowdown. Chipmakers, cloud providers and data center operators have built their growth around it, and any slowdown threatens revenue tied to how fast labs need new hardware.
Some analysts, however, believe that even without new training requirements, inference ​demand and existing backlog could drive growth at Nvidia and its peers.
WHY ARE SOME PEOPLE SKEPTICAL?
In a ‌Princeton-led study, leading AI agents were able to carry out engineering tasks but struggled to identify worthwhile scientific ideas.
Some Silicon Valley executives and critics also question the motives behind the warnings, suggesting they both stoke interest in the technology and ​build a case for regulations that would raise costs for rivals just as open-source models close the gap with leading systems.
David Sacks, who served as the White House's AI and crypto czar, has said top labs could be pursuing "regulatory capture," ​pushing rules that saddle smaller competitors with costly compliance burdens and weaken competition.
(Reporting by Aditya Soni; Editing by Sayantani Ghosh, Clarence Fernandez, Rod Nickel)
STOCKHOLM, Sept 17 () – Volvo Cars plans to launch 13 new models ‌between now and 2030 as it ‌seeks to broaden its range and revive sales, the ​Sweden-based automaker said ahead of an investor day in Stockholm on Thursday. Under CEO Hakan Samuelsson, Volvo has streamlined its product portfolio ‌and placed ⁠greater emphasis on regionalisation, shifting towards more region-specific offerings and less ⁠customisation.
A Getty photographer captured the president looking at a poster that raised questions about his plans for the venue.
By Leika Kihara and Yoshifumi Takemoto TOKYO, Sept 17 (Reuters) – Japanese Prime Minister Sanae Takaichi on Thursday retained key ministers in a cabinet reshuffle that seeks to shore up political
BUENOS AIRES, 17 sep () – Estudiantes sacó el miércoles un triunfo agónico 1-0 en su visita al Corinthians y avanzó a las semifinales de la Copa Libertadores, en una jornada en la cual ‌Palmeiras clasificó al vencer a Liga Deportiva Universitaria en los penales. Estudiantes, que ganó la principal competencia de ‌clubes del continente en cuatro ocasiones, avanzó con un marcador global de 2-1 tras el empate en un gol en la ida jugada una semana ​atrás en Argentina.
Sept 17 () – The European Union has asked China to voluntarily restrict exports of hybrid cars as part of efforts to ‌prevent a trade war, the Financial Times reported on Thursday. Brussels wants ‌Beijing to limit Chinese hybrid vehicles sales to around 15% of the EU market, the ​newspaper said, citing people familiar with the matter.
PARIS, Sept 17 () – European and Arab military chiefs will meet in Paris on Thursday to assess the Lebanese Armed Forces' needs and discuss the looming end of a United ‌Nations peacekeeping mission, amid fears of a renewed Israeli military campaign in southern Lebanon. Israel and Lebanon ‌have held several rounds of U.
By Joan Faus, Christina Amann and Nick Carey BARCELONA/BERLIN/LONDON, Sept 17 (Reuters) – Volkswagen's historic revamp looks set to spell the end of its struggling Spanish marque Seat, potentially
Sept 16 () – Pop artist Peter Max, whose dreamy, boldly colored works provided an artistic backdrop for the 1960s U. hippie movement and made him a commercial art powerhouse, died on Monday at the age of 88 following a long illness, a spokesperson for his family said on Wednesday.
He said Texans are sick of what’s going on in their state.
By Lewis Krauskopf, Suzanne McGee and Gertrude Chavez-Dreyfuss NEW YORK, Sept 17 (Reuters) – Investors are gaining more confidence in the Federal Reserve's inflation-fighting backbone, but uncertainty
The US military honor guard has been rehearsing and the new White House helipad is ready.Troops in flashy uniforms have been rehearsing on the White House driveway this week ahead of the welcome ceremony.
The powerful sister of North Korean leader Kim Jong Un said Thursday that the country's nuclear-armed status was "absolute", calling those hoping for its denuclearisation "idiots"."The DPRK's position as a nuclear weapons state is absolute which can not reverse with anything," Kim's sister, Kim Yo Jong, said in a statement carried by the official Korean Central News Agency.
Australia will reduce migration by curbing "visa hopping", tightening rules on students and working holiday makers as well as cracking down on overstayers, its interior minister said Thursday, as the far-right surges in the polls.Working holiday makers in rural areas will enter a ballot to stay for a second or third year, with just 5,000 visas available for the latter.
By Eduardo Baptista and Laurie Chen BEIJING, Sept 17 (Reuters) – An AI system that interferes with a nuclear command network or launches a military cyber operation could leave Washington or Beijing
By Renju Jose SYDNEY, Sept 17 (Reuters) – Australia will stop foreign students from bringing partners and children to accompany them while they study and tighten working holiday visa rules, a senior
Sept 17 (Reuters) – U.S.
A look at the day ahead in European and global markets from Stella Qiu Turns out the guy Trump hired to cut interest rates just raised them instead.
The planet's water cycle is becoming increasingly erratic, swinging between too little and too much, the United Nations warned Thursday, with an unprecedented El Nino expected to exacerbate the long-term trend.El Nino is the warm phase of a natural climate cycle that occurs every two to seven years and is characterised by above average ocean temperatures across the Pacific, and brings  worldwide changes in winds and rainfall patterns and erratic weather.
JAKARTA, Sept 17 (Reuters) – Indonesian President Prabowo Subianto has called for stricter regulations and sanctions against those who use slash and burn methods to clear land, as the country 
Sept 16 (Reuters) – Pop star Ed Sheeran's opening acts and his own band have quit his U. tour in solidarity with rapper Macklemore, who was cut from the musical lineup over his "free Palestine" remarks on stage criticizing Israeli government actions in Gaza and the West Bank.

source

Scroll to Top