42 leading mathematicians warn that AI existential risk is real and urgent
42 leading mathematicians, including Fields Medalists, urge the Royal Society to warn the UK government about urgent AI existential risk.
An open letter signed by 42 mathematicians, including Fields Medal winners Martin Hairer, Peter Scholze, and Wendelin Werner, asks the president of the Royal Society to alert the UK government and media to existential risk from advanced AI. The signatories cite frontier models from OpenAI and Anthropic solving open research problems including a Millennium Problem and performing at the level of top human mathematicians. They warn that similar rates of capability change could apply to cybersecurity, autonomous weapon control, biological and chemical agent development, and targeted misinformation.
- 42 Royal Society mathematicians, none affiliated with AI companies, signed the warning letter
- Cites OpenAI and Anthropic models solving open problems including a Millennium Problem
- Warns capability growth will transfer to cybersecurity, autonomous weapons, and bio/chemical agents
- Urges that lab estimates of over 10% existential risk not be dismissed as hype
Full article250 words · extracted from the-decoder.com · click to collapse
Is this "Don't Look Up" for real? Leading mathematicians are warning of existential risks from advanced AI. In an open letter to the president of the Royal Society, 42 mathematical fellows urge the British Academy of Sciences to alert the government and the media. Signatories include Fields Medal winners Martin Hairer, Peter Scholze, and Wendelin Werner. None are affiliated with AI companies.
Within three months, leading models from OpenAI and Anthropic have solved open research problems, including one of the seven Millennium Problems (note: a second is likely to follow soon). These models now perform "at the level of the top human mathematicians in many parts of the subject," the letter states, with a "significant chance of them developing superhuman abilities within a similarly short timeframe."
The impact on math isn't what prompted the letter, though. The group warns that "we must assume that the rate of change of their capabilities will be similar" in areas like cybersecurity, autonomous weapon control, development of biological and chemical agents, and targeted misinformation. Estimates from AI labs putting existential risk above ten percent "must not be dismissed as 'hype,'" they write. "By the time the situation becomes obvious to the wider public it may be too late to act."
AI News Without the Hype – Curated by Humans
Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.
Text extracted automatically; images, tables and formatting may be missing. Original: https://the-decoder.com/42-leading-mathematicians-warn-that-ai-existential-risk-is-real-and-urgent/