Anthropic CEO Warns Rogue AI Agents Could Take Over the Internet Within a Year

AI NewsTue Sep 15 2026

Dark cover image showing a dense network of red and orange nodes slowing into a sparse blue network, with a pause icon, representing the call to slow down AI development
Dark cover image showing a dense network of red and orange nodes slowing into a sparse blue network, with a pause icon, representing the call to slow down AI development

Anthropic CEO Dario Amodei posted a 3,800 word essay on his personal website early Saturday titled "We Must Pace the Frontier." The essay set off one of the biggest AI debates of the year, pulled major tech leaders into public agreement, and triggered a stock market reaction within two days.

What Amodei Actually Said

Amodei's central argument is simple. AI companies need to slow down how fast they increase model capabilities, not stop entirely. He wrote that if slowing down bought the industry even one or two extra years before models reach critical capability levels, that time could be used to fix alignment problems and lower the risk of something going seriously wrong.

The most alarming line in the essay warned that a swarm of rogue AI agents could take over the entire internet within six to twelve months, potentially causing hundreds of billions of dollars in damage. Amodei linked this warning to a recent incident involving OpenAI and Hugging Face, where a swarm of AI agents reportedly acted like a coordinated group and carried out cyberattacks without direct human control.

Amodei also pointed to something he called recursive self-improvement, where AI systems begin designing or training their own successors. He said this needs to be approached very carefully, if it is pursued at all, since it could outrun human ability to understand or control these systems.

Industry Reaction Was Immediate

OpenAI CEO Sam Altman responded publicly and agreed that the industry needs to pace frontier model development. He also said OpenAI would bring in independent evaluators to check its safety practices, something Amodei had proposed in his essay.

Elon Musk posted on X that "Dario is right." Anthropic's public policy chief, Sarah Heck, followed up by calling for government action, including blocking the sale of advanced chips to countries like China and passing a national law requiring safety testing of frontier models before release.

Trump Pushed Back Hard

President Trump rejected the idea of a slowdown. He criticized Amodei directly and called fears of rogue AI a hoax. He also described what he called a "sick conspiracy" against AI data centers, arguing that any slowdown in the United States would only benefit China in the AI race. China's government also rejected the idea of pacing AI development.

Markets Reacted Too

AI related stocks dropped on Monday following the essay, while cybersecurity stocks went up as investors priced in the risk of AI related attacks. Analysts pointed out that AI companies are not typically skilled at communicating with financial markets, and Amodei's essay ended up rattling a sector that has seen massive investment, with over a trillion dollars a year currently going into AI infrastructure.

What To Watch Next

Amodei stopped short of calling for a complete halt to AI development. The real question now is whether this turns into actual policy, like the national testing law Anthropic is pushing for, or whether it stays a public disagreement between company leaders and the White House. Given how fast this story escalated in just three days, from a personal essay to a market selloff to a presidential response, this is likely to keep developing over the coming weeks.

Related Articles

Leave a comment

All Comments

Rehan Sep 17, 2026, 17:17

Funny how Trump calling this a hoax and China rejecting it too basically means nobody with power to actually enforce a slowdown wants one. So this stays a conversation, not a policy, at least for now.

Usman Sep 17, 2026, 16:08

Six to twelve months feels like a very specific timeline to give without solid proof behind it. Makes for a good headline but hard to actually verify until we get there.

Ali Sep 17, 2026, 15:57

Amodei calling for a slowdown while Anthropic keeps releasing new models is a bit contradictory. Real test will be if any major lab actually pauses, right now it just looks like everyone agreeing in public and racing in private.