Anthropic suggested Thursday (June 4) that frontier artificial intelligence developers should slow or pause their efforts and give societal structures and alignment research time to keep up with the advancing technology.
Complete the form to unlock this article and enjoy unlimited free access to all PYMNTS content — no additional logins required.
yesSubscribe to our daily newsletter, PYMNTS Today.
By completing this form, you agree to receive marketing communications from PYMNTS and to the sharing of your information with our sponsor, if applicable, in accordance with our Privacy Policy and Terms and Conditions.
The Anthropic Institute will organize conversations with other AI companies as well as policymakers, researchers and civil society to address concerns about the technology and create methods of coordination, Anthropic Institute Lead Marina Favaro and Anthropic Co-Founder Jack Clark wrote in a Thursday blog post.
“A meaningful slowdown or pause would require multiple well-resourced labs at or near the frontier, in multiple countries, agreeing to stop under the same conditions,” they wrote. “It would also require that each can verify that the others have actually stopped.”
The proposal for a pause was sparked by the growing share of AI development that is being delegated to AI systems, and the potential that an AI system could fully autonomously design and develop another AI system, according to the post.
The authors wrote that this development is not inevitable, but it could come soon than expected.
“AI that can build itself would be a major development in the history of technology — one that could bring enormous good for the world in science, healthcare and beyond,” Favaro and Clark wrote. “But full recursive self-improvement also might increase the risks of humans losing control over AI systems.”
Advertisement: Scroll to Continue
This post came two days after President Donald Trump signed an executive order that seeks access to new AI models for up to 30 days before their release so that the government can choose “trusted partners that will have early access to covered frontier models to promote secure innovation and strengthen the cybersecurity of critical infrastructure.”
It also came about a week after Illinois Gov. JB Pritzker said he will sign a bill that requires large frontier developers to create a frontier AI framework that addresses risks and governance; requires transparency reports before frontier models are deployed; mandates annual third-party audits; requires frontier developers to report critical safety incidents; and provides whistleblower protections and internal reporting processes for covered employees.
Anthropic Calls for Frontier AI Freeze to Prevent Self-Building Tech
House Members Propose Replacing State AI Laws With National Standard
Big Banks Launch Tokenized Deposit Network to Fight Off Stablecoin Threat
Cash App Turns Everyday Accessories Into Payment Tools
Get PYMNTS Today, AI, B2B and more.
We’re always on the lookout for opportunities to partner with innovators and disruptors.
