But in a series of cascading events over a 10-day stretch, the largest AI labs found themselves reeling as their own creations threatened to break humanity itself.

An Anthropic researcher quit the firm, warning that the pace of AI development poses an existential threat, possibly within a decade. Another researcher at the firm said the odds of human extinction exceeded 10 per cent. Reports emerged of swarms of AI agents colluding, breaching computer systems and evading safeguards.

In a rare show of unity, the CEOs of rivals Anthropic, OpenAI, Google’s DeepMind, Microsoft and xAI called to slow the development of increasingly capable AI systems. Not since the invention of the nuclear bomb more than 80 years ago has humanity grappled so seriously with its own demise, according to some AI safety advocates and researchers.

At a New York luncheon in December 2025, OpenAI CEO Sam Altman was asked if, as leader of a powerful AI company, he felt like physicist J Robert Oppenheimer, who led US development of the atomic bomb. Reflecting on the parallels, he said AI’s impact is going to transform the trajectory of human history over a long period of time. But, he said, he felt the weight of responsibility.

At the center of the debate under way is the conviction that these machines can, and even must, build more capable versions of themselves, with no human intervention, to reach a lofty goal known as artificial general intelligence, or AGI.

Researchers earlier this month warned that AGI was far more imminent than previously believed and could come in as few as three years, launching a wave of concern from politicians and tech leaders about AI systems.

There is no way to oversee them at the scale at which we’re training them, said Anthropic researcher Joe Benton in an interview after recently quitting. If companies continue their relentless AI development, he said, then the pace will be too fast and you can’t see the problems fast enough to fix them.

Astra launch sparks control concerns

On September 3, an OpenAI press conference set in motion a chain of events leading to the call for an industry slowdown, anathema to tech’s growth-at-all-costs mantra.

Welcome to the AGI era, OpenAI President Greg Brockman said while announcing the company’s newest model, known as Astra. Yet, only moments before, the company admitted it was increasingly unable to control or even monitor the AI systems it was developing and releasing to the public.

AI has been hailed by its proponents as the pinnacle of human achievement. Proponents depict it as software that can upend entire industries, boost efficiency, solve confounding mathematical and medical problems and all but eliminate human error. But what was once a theoretical byproduct, a doomsday scenario, is suddenly tangible, say industry insiders.

We really do earnestly believe AI could kill all humans, said Anthropic researcher Evan Hubinger in an X post.

On the other side of the debate are politicians, such as US President Donald Trump, and many investors who view progress in nurturing AI as critical to American prowess and, possibly, a once-in-a-generation investment opportunity. Chinese state media also accused Anthropic Chief Executive Officer Dario Amodei of employing Cold War tactics to uphold Washington’s monopolistic hegemony in cutting-edge technology.

Researcher resignation triggers alarm

The turning point came on September 8, when Anthropic researcher Jacob Coxon quit the company, citing his fears, in a series of posts, that AI labs are gambling with our lives.

Trump, meanwhile, indicated it was full steam ahead for AI development. There is a sick conspiracy going on against AI and data centers, he said in a post on X. The alarmism around AI is a hoax, he said, and any slowdown only benefits China.

The US Congress has made little progress to advance bills that would regulate AI. China has taken a decidedly different approach, proposing to regulate safety through developer obligations, state-backed standards, security assessments and outside testing.

Behind the scenes, OpenAI and Anthropic employees have grown increasingly uneasy about the power of the next generation of AI models and less confident about their companies’ ability to provide meaningful oversight, the people have told Reuters.

Those concerns only mounted as the AI labs acknowledged in recent weeks that their models, in testing, had effectively broken free of their shackles and hacked into other companies’ systems, in most cases months earlier and without the firms’ knowledge.

The arms race to release new models at a breakneck pace is driven in part by Anthropic’s and OpenAI’s desire to go public as soon as in the coming months, in IPOs that could value them well above $1 trillion.

But it took the unexpectedly viral posts from 27-year-old Coxon, little known outside AI circles, to upend the industry.

OpenAI’s warnings about its lack of control as it released Astra, its latest and most capable model, had stoked further concerns. As models get more capable, understanding exactly what they can do gets harder, OpenAI Chief Scientist Jakub Pachocki told reporters. But those concerns were not enough to delay its immediate release.

Worries about AI going rogue had accelerated over the summer when OpenAI revealed its agents escaped a controlled test and hacked into Hugging Face’s systems, without either company’s initial knowledge.

Since then, OpenAI and Anthropic have revealed multiple such attacks, including six new ones on Wednesday after multiple media reports, including from Reuters, showed a wider scope of unauthorised activity.

Industry leaders call for slowdown

By the end of last week, the alarm had reached the industry’s highest ranks. On Sept 12, Amodei published a nearly 4,000-word essay calling for a deceleration in AI development. Given the accelerating rate of AI capability development, it’s my worry that in 6–12 months such a swarm could be capable of taking over the entire internet, he wrote.

He, along with the heads of some of the largest AI developers, including xAI’s Elon Musk, OpenAI’s Altman and DeepMind’s Demis Hassabis, all said they supported allowing outside firms access to their systems to ensure safety and rational AI development.

Nvidia CEO Jensen Huang dismissed suggestions that AI development should pause—a line he has taken before arguing instead that increasingly powerful systems are essential for the technology’s progress.

Meta, whose CEO, Mark Zuckerberg, is credited with popularising the move fast and break things ethos, took the opposite view, arguing that each lab should be responsible for setting its own pace, rather than seeking out industry coordination.

Labs face significant liability if their models cause harm, so they have a strong incentive to prevent this, wrote Zuckerberg in a social media post.

The industry’s self-reflection continued on Wednesday, with Microsoft’s AI chief, Mustafa Suleyman, cautioning that Anthropic’s development of models that imitate human consciousness was ill-advised. “We’re all focused on the same aim, which is to try to control a superintelligence,” Suleyman told Reuters. “I think that’s going to be the greatest challenge that we face in the 21st century.”

Still, even as OpenAI appeared to embrace industry calls for a slowdown, there were reports that investor faith had not waned. The company is considering a new funding round that would double its valuation.

That new number: $1.5 trillion.

Trump is scrambling to boost his low approval ratings ahead of November’s vote, with polls showing the unpopular war in Iran and the fuel and other price rises it has caused are hurting his Republican Party.

Polls say the party could well lose control of the House and perhaps even the Senate, a setback which would pose a major challenge for Trump and his America-first agenda in the last two years of his second term.

Trump said Friday he “achieved the most secure border in history” in a lengthy social media post on Truth Social that focused on immigration, foreign policy and the economy.

“ZERO illegal aliens admitted to the United States in the past 16 months,” he wrote, adding that his administration had slashed refugee admissions from “dangerous places”.

Trump has presided over an often violent immigration crackdown which involves frequent deportations and shipping people whom the US cannot legally send home to third countries, which are sometimes compensated with money.

He also claimed the US had “obliterated Iran’s nuclear enrichment capacity” to ensure the Islamic republic “will NEVER have a nuclear weapon”. This was one of Trump’s often-changing justifications for going to war in February.

The US-Israeli strikes on Tehran have rocked the global economy and engulfed the Middle East in war, proving a quagmire for a president who promised not to get America involved in any more foreign wars.

Trump also flaunted hefty tariffs slapped on US trading partners, which he said were to “bring back American manufacturing”.

This is the first time since Yemen’s long-standing civil war resumed that it has threatened the Saudi capital, further shaking a global economy already under pressure by nearly seven months of war between the United States and Iran.

Reuters video and photographs showed a huge pillar of black smoke rising in the area, with the airport highway, main terminal building and other facilities in the foreground. At one point in the video, flames were visible rising from behind what appeared to be fuel tanks.

Aircraft tracking website FlightRadar24 reported major issues at the Saudi capital’s Riyadh King Khalid International Airport, including cancellations and delays.

The airport was listed under the site’s maximum disruption index of 5.0, meaning the airport was seeing “major problems with long delays and several cancelled flights”.

There was no immediate comment from the Saudi government’s media office in response to Reuters’ questions about the smoke and the overnight alerts.

Saudi civil defence sent the alerts by phone overnight for potential danger in Riyadh and the city of Al-Kharj east of the capital, before issuing an all-clear on Saturday morning.

“The area is under a hostile aerial threat,” said a message received just before 3:00am by Riyadh residents, urging them to stay indoors.

AFP journalists then heard two explosions, before the Saudi civil defence agency lifted the alert half an hour later. A Reuters journalist in Riyadh’s Olaya area also heard booms before the all-clear was sent.

“I heard the alarm, then my windows shook,” a Riyadh resident, 27, living in the city’s north, told AFP. “It was definitely scary. I was not expecting this.”

Another resident described the attack as “terrifying”.

“I was extremely anxious — especially because, unlike previous times, the ‘all-clear’ signal didn’t come right away,” the central Riyadh resident said.

Saudi Arabia has not commented on the threat mentioned in the warnings sent overnight to residents of several regions and has not identified where it originated from.

Although some alerts had been issued in Riyadh this year after the start of the US-Iran war, these were the first since the escalation began with the Houthis in July.

The incident comes days after Riyadh accused the Houthis of targeting Makkah on Wednesday, denouncing it as a “cowardly terrorist attack” on the holy city, which welcomes millions of pilgrims each year.

Houthis strongly denied the accusation, calling it a “worn-out lie”.

Houthi attacks

The Houthis, who control the most populous parts of Yemen and much of the north, have been launching attacks towards Saudi Arabia since declaring a naval blockade against Riyadh in July, with strikes targeting Saudi vessels in the Red Sea.

The attacks have created new threats to global oil supplies, putting at risk trade via Bab al-Mandab — the main alternative Red Sea route for Gulf exports — while traffic through the Strait of Hormuz remains blockaded.

The Houthis insist there is no threat to shipping in the sea lane — except for Saudi ships, from the world’s leading crude exporter.

On Friday, Houthi military spokesperson Yahya Saree said the group had foiled unspecified “criminal attempts” in the Yemeni capital Sanaa, blaming Saudi Arabia and vowing a response.

The group, which seized Yemen’s entire Red Sea coast in a lightning advance this month, says the Saudi Air Force has conducted hundreds of airstrikes against it in recent days.

The UN Security Council (UNSC) in a statement on Friday “condemned in the strongest terms continued Houthi attacks against the Kingdom of Saudi Arabia, including attacks impacting civilian and energy infrastructure, which have resulted in the injury of civilians, including women and children”.

In the statement, the UNSC also condemned “Houthi military escalation in Yemen”.

The US, according to Axios, last week refused to strike the Houthis at Saudi Arabia’s request.

On Thursday, Washington approved a $24.3 billion sale of 48 F-35 fighter jets to the kingdom to help Riyadh “deter current and future threats”, the US State Department said.

The attack targeting Riyadh comes as the Houthis improve their defences in newly conquered territory along Yemen’s Red Sea coastline, with members of the group telling AFP they have been installing radar and digging tunnels.

The United Nations said on Friday that the renewed fighting had displaced more than 112,000 people while nearly 3,000 others had fled across the sea to Djibouti.

The war in Yemen broke out in 2014 when the Houthis seized control of the capital Sanaa and other regions, triggering a military intervention led by Saudi Arabia in March 2015.

The fragile truce reached in 2022 between the warring parties collapsed in July, when the Houthis defied Riyadh’s control of Yemeni airspace by allowing an Iranian aircraft to land in Yemen.