Jacob Coxon, a 27-year-old AI researcher and mathematics graduate, has resigned from Anthropic after three years of pretraining research at both Anthropic and OpenAI.
In his departure, Coxon warned that AI firms are racing toward the development of self-improving superintelligence, posing existential risks to humanity.
Anthropic’s Evan Hubinger echoed Coxon’s concerns, estimating a greater than 10% chance of AI-driven human extinction within the next decade.