Second Anthropic Safety Researcher Resigns Over AI Extinction Risk

What separates the Coxon and Benton resignations from an ordinary corporate exit is that Anthropic's own leadership publicly agreed with them instead of walking the claims back. When Coxon told colleagues that frontier labs were 'gambling with our lives' by racing toward self-improving superintelligence, Anthropic's Alignment Science Lead Evan Hubinger responded by confirming it, writing that he personally believes there is 'greater than 10 percent' probability AI could kill all humans within the next decade ^[1][2]. A second Anthropic lead, Samuel Marks, added that concern about extinction risk tends to rise with seniority inside the company ^[1]. That figure is not wildly out of step with a 2022 AI Impacts survey, where a typical AI researcher assigned roughly 5 percent probability to human extinction from AI, rising to 10 percent for loss-of-control scenarios specifically ^[1]. But hearing that number volunteered by a sitting safety lead, rather than extracted from an anonymous poll, is what turns two individual resignations into a company-wide credibility problem.

Benton's resignation is not an isolated event - it is the third public, safety-motivated departure connected to Anthropic within seven months, and each one has been more explicit than the last. In February 2026, Mrinank Sharma, who had spent two years leading Anthropic's Safeguards Research team, resigned with a public letter warning that 'the world is in peril' from AI, bioweapons, and a series of interconnected crises ^[3][4]. Seven months later, on September 9, Jacob Coxon - three years into pretraining research split across Anthropic and OpenAI - resigned at age 27, telling colleagues neither company was 'acting responsibly' in the race toward self-improving AI ^[1][2]. Two days after that, Benton disclosed he had quietly left Anthropic's Scalable Oversight team, warning publicly that 'we may not survive' the current trajectory ^[5][6]. The trend line matters more than any single quote: safety researchers are leaving with increasingly blunt public language, not increasingly reassured silence.

Benton did not simply quit and go quiet. In his own public statement, he laid out a specific set of external-oversight demands: mandatory disclosure of progress toward recursive self-improvement, formal safety-incident reporting, and independent audits of safety standards at frontier labs. Separately, news coverage confirms his decision to join METR ^[5][6], a nonprofit that runs outside evaluations of frontier AI risk - a direct extension of that ask, betting that scrutiny from outside a lab now carries more weight than advocacy from inside one. Benton's framing effectively argues that the industry's current model - labs self-policing their own most dangerous capabilities - has already been tested and found wanting.

Both Benton and Coxon independently describe the same underlying dynamic driving their exits: frontier labs, Anthropic included, are directly racing to automate the process of AI research itself, pursuing systems that can improve their own successors faster than external checks can keep pace ^[2][5]. This is not framed as a hypothetical - Coxon says he remains 'optimistic about the potential for coordination' between labs even as he warns the current path is reckless ^[2], suggesting the problem is competitive incentive structure rather than any single company's malice. That framing is reinforced by broader industry unease: more than 1,300 employees across frontier AI labs signed a July letter calling for deliberate slowdowns in automated AI development ^[1], indicating the Anthropic departures sit inside a wider current of insider concern rather than standing apart from it.

The reaction outside Anthropic is far less unified than the reaction inside it. Alongside genuine alarm, some online commentators have framed these resignations as reputational theater rather than sincere warnings, suggesting dramatic extinction-risk language conveniently generates attention for a caution-first brand. Skeptics counter the extinction framing altogether, arguing that terms like 'AGI' and 'superintelligence' are poorly defined marketing language, and that the real near-term danger is mundane failure - buggy, poorly supervised software causing harm - rather than a superintelligent system choosing to act against humanity. Others engage with the risk framing on its own terms but debate it through game-theoretic race dynamics, weighing whether extinction odds differ meaningfully depending on which lab 'wins' the capability race. The 1,300-signature slowdown letter and Hubinger's own internal admission complicate the pure-cynicism read ^[1], but the split itself is real: even among people taking the warnings seriously, there is no consensus on whether the danger is superintelligence or simply careless deployment of the systems that already exist.