Jacob Coxon, a former researcher at AI company Anthropic, has likened the development of superintelligent artificial intelligence to "summoning an alien species," expressing deep concerns about the industry's rapid progression.
Coxon, who recently resigned citing anxieties over AI development, stated on ABC’s “This Week” that the concept of an alien mind we don’t fully understand is inherently terrifying. He reiterated his belief, shared during his resignation, that AI developers are earnestly aware of the potential for AI to cause catastrophic harm within the decade. Coxon asserted that neither Anthropic nor OpenAI is acting responsibly, characterizing their efforts as a race towards self-improving superintelligence that gambles with human lives.
These concerns were underscored by a recent Anthropic report detailing potential misuse of its AI models, including scenarios where AI could aid in the development of bioweapons. In response to Coxon’s warnings and resulting public apprehension, Anthropic CEO Dario Amodei penned an essay advocating for a slowdown in AI capability advancement. OpenAI CEO Sam Altman publicly agreed with Amodei, citing AI safety concerns as a reason for delaying the company’s IPO.
Amodei has proposed a multi-faceted approach to AI safety, including the establishment of independent evaluators with access comparable to employees to verify safety practices. His plan also calls for collaboration among leading AI firms to set safety standards and for international cooperation to manage the risks associated with AI development.
Coxon viewed Amodei’s proposal as a “very sensible first step” and an encouraging move toward the slowdown he advocates. However, he noted that the current proposal could benefit from increased engagement with China.
Amodei also spoke with CBS’ “Face the Nation,” suggesting that the United States and China should consider an agreement to prevent the use of AI in biological weapons development. He further proposed exploring a “speed limit” on the pace of AI advancement in the long term. The reception of these calls for caution remains uncertain, particularly in light of recent remarks by former President Donald Trump, who has previously dismissed calls to slow AI progress.
Coxon emphasized that regardless of current activities, AI is poised to significantly impact everyone's lives. He urged the public to remain aware of AI's trajectory and not solely delegate responsibility to developers, who may prioritize engagement over comprehensive safety measures.
![Anthropic CEO Dario Amodei speaks during an interview on "The Circuit with Emily Chang" at the company’s headquarters in San Francisco on April 30, 2026.]( "Anthropic CEO Dario Amodei speaks during an interview on "The Circuit with Emily Chang" at the company’s headquarters in San Francisco on April 30, 2026.")