Anthropic scientist puts the odds of AI destroying humanity above ten percent this decade
Anthropic's Evan Hubinger estimates over ten percent odds AI destroys humanity this decade, following pretraining lead Jacob Coxon's departure.
Jacob Coxon, who led pretraining work at Anthropic after three years at OpenAI, quit, arguing both labs are taking a hubristic gamble with civilization. Anthropic safety researcher Evan Hubinger responded that there is a greater than ten percent chance misaligned superintelligent AI destroys humanity within the decade. More than 1,200 researchers including Dario Amodei and Meta's Shengjia Zhao recently signed an open letter calling for a slowdown, and Coxon floated costly measures such as a temporary capabilities pause.
36