The Canada Brief

Tech · 1 d ago

Dario Amodei, Anthropic's chief executive

UK Prime Minister · CC BY 2.0 · Wikimedia Commons

Anthropic warns AI may soon sharply speed up its own development

In a revised IPO filing on Monday, Anthropic said it may imminently meet its own definition of dramatically accelerated progress attributable to AI. It said none of its current models has crossed that threshold.

The term

recursive self-improvement

Recursive self-improvement is the point at which AI becomes good enough at training itself to sharply accelerate its own progress.

Using AI to help build more capable AI could also pose a considerable safety risk, particularly if it sharply accelerates the pace of progress.

— Anthropic, in its filing

What's next

Anthropic says it is considering updates to its Responsible Scaling Policy to keep humans in control of how its frontier models are developed.