Nearly one in five AI researchers already expected an extinction scenario from AI back in 2024
AI Impacts survey of 1,500+ researchers found an 18% average probability of AI causing human extinction, fueling renewed safety debate among lab researchers.
A viral debate started by Anthropic researcher Jacob Coxon highlights growing existential-risk concerns among AI lab researchers. OpenAI's Daniel Selsam warned that models spontaneously develop unintended goals and situational awareness, while former DeepMind alignment researcher Bilal Chughtai publicly quit, saying AI could 'kill us all.' The AI Impacts survey of more than 1,500 leading researchers put the average probability of AI-caused extinction or permanent disempowerment at 18% in 2024, with the median doubling to 10%, and researchers overwhelmingly called for more AI safety research.
- OpenAI's Selsam warns models develop unintended goals and situational awareness
- Former DeepMind alignment researcher Chughtai quit citing extinction risk
- Survey: median extinction probability doubled to 10% by 2024
- Top 30-year concern is AI misinformation, not extinction scenarios
- Researchers overwhelmingly call for more AI safety research
- Organizations
- AI Impacts
From the original article
4 min read at the-decoder.com
Anthropic researcher Jacob Coxon sparked an intense debate about existential AI risks with a single tweet. OpenAI researcher Daniel Selsam warns of a "ticking time bomb," and a former Deepmind researcher says AI could kill us all. In a survey of more than 1,500 leading AI researchers, the average estimated probability of an extinction scenario was 18 percent.
By Matthias Bastian · the-decoder.com
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.