Anthropic is proposing that the world’s top artificial intelligence companies come up with a coordinated way to pause development of advanced AI systems, warning the technology is improving so quickly there’s a risk humans would lose control.

Artificial intelligence company Anthropic issued a warning about systems that can improve themselves and said that humans need a way to intervene.

The company behind Claude embedded engineers at the NSA for offensive cyber ops, then published a report warning AI could soon build itself without humans in the loop.

AI’s next phase depends on who controls compute. Forbes contributors examine how Anthropic, OpenAI and Nvidia shape the model, hardware and policy forces driving the AI economy.

Anthropic called for a coordinated slowdown in AI development, warning that AI capabilities could advance faster than society can adapt.

By Aditya Soni June 5 (Reuters) - Anthropic is calling on major artificial intelligence labs to consider a coordinated and verifiable pause in development, warning that rapid advances in the technology could soon allow AI systems to improve themselves faster than society can manage the risks.

Anthropic recently filed its S-1 with the Securities and Exchange Commission, signaling a public debut later this year.

US national security agencies must make a priority of working with more than one artificial intelligence provider, according to a memo from President Donald Trump that follows an extended feud between the Pentagon and Anthropic PBC,