Anthropic CEO Dario Amodei has urged the artificial intelligence industry to slow the pace of development, warning that unchecked progress could outstrip humanity's ability to control the technology. The statement, published Saturday, garnered support from prominent tech figures, including Elon Musk and Sam Altman, but also faced pushback and calls for more robust oversight from whistleblowers and politicians.
"We must slow the pace at which we improve the capabilities of AI models," Amodei wrote in an essay. "Progress will still seem fast, and we must make wise use of the time we gain."
Musk, founder of xAI, echoed Amodei's sentiment on social media, stating, "Dario is right." OpenAI CEO Sam Altman also commented, "I agree with Dario that we need to pace the frontier."
However, former OpenAI researcher Daniel Kokotajlo, who resigned in 2024 citing concerns about AI safety, argued that voluntary measures within the industry might not be sufficient. "After they've accumulated all of the hard power in the world, they run the factories, they're integrated into the military, you know, they're sort of running the whole system, and humans are just sort of giving them orders," Kokotajlo said in an interview. "Then they stop taking orders at some points, and they kill off the humans."
Kokotajlo, who has been vocal about the rapid pace of AI development and a perceived lack of safety safeguards, suggested that more radical measures are needed. He dismissed claims that AI safety advocates are working with foreign actors or non-governmental organizations, emphasizing that warnings are coming from academics and industry veterans.
Some, like former White House AI advisor David Sacks, have voiced skepticism about the warnings, suggesting they could be a tactic to push for government control over AI. Sacks stated that such warnings are "designed to scare the public about AI so that these NGOs can implement their preferred approach to AI, which is a government takeover."
Concerns about AI regulation have also been raised by lawmakers. Rep. Anna Paulina Luna, R-Fla., called for Congress to convene a special session on AI, describing the technology as a "massive — uncontrolled currently — super weapon." She advocated for the implementation of a "kill switch" to protect humanity and stressed the importance of establishing strong safeguards, comparing the need for caution to that surrounding nuclear arms.
Luna also highlighted the geopolitical implications of AI development, warning that the United States must not fall behind other nations. "Whoever controls AI will control, effectively, the world," she stated. "Do we want that AI to be programmed and learned on our morals, our values as Americans, or do we want it done as dystopian China? I would argue that we have to win that race."
Despite the calls for caution and regulation, there is a counterargument that slowing down AI development could cede a crucial technological advantage to global adversaries. The debate underscores the complex balance between fostering innovation and ensuring the responsible development and deployment of advanced artificial intelligence.