Will AI kill us all within the next decade?
Anthropic alignment lead Evan Hubinger says he personally estimates a greater than 10% chance AI could kill all humans within the next decade.
A Wall Street Journal report says concerns are rising inside AI labs that competition is pushing companies toward self-improving models that could spiral out of human control. Anthropic's Alignment Science lead Evan Hubinger publicly endorsed researcher Jacob Coxon's warning, giving a personal estimate of a greater than 10% chance of AI causing human extinction within a decade, driven by recursive self-improvement. Hubinger described the risk from current models as low, focusing his concern on future systems with far greater autonomy. The piece argues for safeguards such as independent testing, limits on high-risk autonomous uses, transparency, and accountability.