Anthropic Researcher Jacob Coxon Resigns, Calls for AI Regulation

Jacob Coxon, a researcher at Anthropic, announced his resignation due to concerns about the potential dangers of artificial intelligence, stating that the technology poses a risk to human life. In an interview on Fox News, Coxon emphasized the importance of regulation to prevent a possible AI-induced catastrophe within the next decade. He expressed hope that the situation is manageable, stating, "The problem is eminently solvable." Coxon, who previously worked at OpenAI and Anthropic for three years, criticized the current pace of AI development, describing it as a gamble with human lives. He highlighted the need for international oversight, suggesting that the technology is being utilized as a "superweapon" in a global arms race. Evan Hubinger, alignment science lead at Anthropic, supported Coxon's views, indicating that the risk of AI could exceed 10% within the next decade if self-improving superintelligence is not addressed. Both researchers acknowledged that while the current threat level is low, the rapid advancement of AI technology necessitates caution. Coxon called for a collaborative international approach to ensure safety in AI development, asserting that the industry is in urgent need of regulation. He noted that many technology leaders share this sentiment and are advocating for a slowdown in AI advancements to allow for careful consideration of the implications. Despite the risks, Coxon acknowledged the potential benefits of AI, stating that humanity is on the verge of significant discoveries but must proceed with moderation.