Open letter calls for prohibition on superintelligent AI, highlighting growing mainstream concern

Learn more.

An open letter released Wednesday has called for a ban on the development of artificial intelligence systems considered to be “superintelligent” until there is broad scientific consensus that such technologies can be created both safely and in a manner the public supports. 

The statement, issued by the nonprofit Future of Life Institute, has been signed by more than 700 individuals, including Nobel laureates, technology industry veterans, policymakers, artists, and public figures such as Prince Harry and Meghan Markle, the Duke and Duchess of Sussex.

The letter reflects deep and accelerating concerns over projects undertaken by technology giants like Google, OpenAI, and Meta Platforms that are seeking to build artificial intelligence capable of outperforming humans on virtually every cognitive task. According to the letter, such ambitions have raised fears about unemployment due to automation, loss of human control and dignity, national security risks, and the possibility of far-reaching social or existential harms.

“We call for a prohibition on the development of superintelligence, not lifted before there is broad scientific consensus that it will be done safely and controllably, and strong public buy-in,” the statement reads.  

Signatories include AI pioneers Yoshua Bengio and Geoffrey Hinton, both recipients of the Turing Award, Apple co-founder Steve Wozniak, businessman Richard Branson, and actor Joseph Gordon-Levitt. On the political front, names range from Steve Bannon, former White House chief strategist under Donald Trump, to Susan Rice, former national security adviser in the Obama administration, and former chairman of the U.S. Joint Chiefs of Staff Mike Mullen.

The open letter notes that while there is recognition of AI’s “unprecedented” potential for improving health and prosperity, the development of superintelligent systems brings forth risks that have not yet been sufficiently addressed. Proponents of the letter argue that the race among major technology corporations could push development past a point of no return, making oversight and control impossible. Concerns about national security, civil liberties, and potential human disempowerment are front and center, as are warnings about unforeseen consequences if human-level or greater intelligence is achieved in machines.

The Future of Life Institute previously published a widely circulated letter in 2023 calling for a pause in the development of powerful AI models, a request that was not heeded by leading technology companies. Organizers of the latest campaign say the issue is now more urgent, citing polls indicating broad public skepticism about pursuing superintelligence before ensuring safety and strong oversight. The question of whether governments will intervene in time or companies will self-regulate remains open.

You see the full list of signatories on the Future of Life’s website. 

100-plus companies call for ‘global surge’ in AI-powered cyber defense

OpenAI, Anthropic, Google, Microsoft, and others say there’s a narrow “defenders’ window” to strengthen security before AI-powered attacks become more sophisticated.

OpenAI: Agent behavior that led to Hugging Face intrusion formed in May

The push to designate AI as the next critical infrastructure sector

Government

• The G7 tells industry to hurry up and prep for post-quantum encryption

• Jail time for Maine child in 764 marks turning point in federal law enforcement

• FCC proposes public scorecard to rate telecoms on anti-robocall efforts

• Dogged Russia-based botnet dismantled after 23-year run

Technology

• European parliament members call for slowdown of Serbia’s EU entry over spyware use

• Pegasus, NoviSpy variant spyware found on devices of Serbian activists

• Wyden seeks upgraded NSA security guidance on commercial VPN use

• The Collective Cyber Defense letter wrote your next vendor questionnaire

Threats

• Chinese espionage groups swarm to exploit triple-link chain of zero-days

• Microsoft discloses two actively exploited zero-days among 974 vulnerabilities

• Russian national extradited to US for alleged involvement in bank-account takeover scheme

• Attackers exploit zero-days in consistently besieged SonicWall product

Policy

• Whistleblower says USPS deploying new, ‘untested’ IT systems governing mail-in ballots

• ‘Watershed 250’ test program in Texas looks to private sector for water cybersecurity help

• Former sexual abuse victims say Grok used their images, videos to train deepfake capabilities

• Cyber threats nudge Trump to sign executive order on foreign equipment in U.S. energy infrastructure