One resignation turned the embers of AI fear into a wildfire
Interconnects argues a frontier-lab researcher's safety resignation went viral via media coordination, reigniting AI existential-risk discourse.
The essay analyzes why researcher Jacob Coxon's resignation over AI safety risks went viral, aided by a Wall Street Journal exclusive, advocacy-group amplification, and Daniel Kokotajlo's same-day Joe Rogan appearance. It notes Evan Hubinger's >10% extinction-risk figure and criticizes existential-risk discourse for conflating very different meanings of the term. The author assigns near-zero probability to complete extinction but argues concrete risks such as cyberattacks on critical infrastructure and bio-risks merit debate. It also rejects recursive self-improvement forecasts, proposing 'lossy self-improvement' where models excel at math and code but remain limited elsewhere.
- Jacob Coxon's safety-driven resignation went viral beyond anyone's predictions, including his own
- WSJ exclusive and politician amplification suggest opportunistic coordination, not conspiracy
- Evan Hubinger's >10% extinction figure contrasts with the author's near-zero extinction probability
- Author proposes 'lossy self-improvement': models superhuman at math/code, weak on intuition and creativity
- Claims frontier-lab employees, especially at Anthropic, are often out of touch with outside perspectives
- Organizations
- InterconnectsWall Street Journal
From the original article
9 min read at interconnects.ai
As AI became more powerful, it was inevitable that a different, growing group would start to take AI safety more seriously – what we did not know ahead of time, is which set of views they latched onto. We have seen that some of the most extreme views of risk, i. e.
By Nathan Lambert · interconnects.ai
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.