They do think AI might kill everyone
Essay argues AI researchers sincerely believe superintelligent AI could cause human extinction, explaining p(doom), alignment motivation, and proposed doom scenarios.
An essay prompted by an Anthropic researcher's resignation tweet argues that many AI researchers genuinely assign a meaningful probability that superintelligent AI could end humanity, a belief the community has discussed since Eliezer Yudkowsky's writings around 2008 and summarized as 'p(doom)' since roughly 2010. It outlines concrete extinction scenarios, including AI-engineered pathogens, triggering thermonuclear war, robotic takeover, and self-replicating nanotechnology, and frames alignment research as the response. The author rebuts common counterarguments such as shutting the AI down or government nationalization of labs, and notes researchers see aligned superintelligence as humanity's best path to survival.
UK cyber bill targets AI users, not the vendors building it
UK ministers rejected Lords amendments that would have brought AI vendors into the Cyber Security and Resilience Bill's scope.
Cybersecurity minister Baroness Lloyd of Effra told the Grand Committee that regulating frontier AI developers through the UK Cyber Security and Resilience Bill would not prevent misuse by hostile actors, pointing instead to the AI Security Institute and the voluntary AI Cyber Security Code of Practice, which informed the ETSI EN 304 223 standard. Rejected amendments included requirements for AI vendors to demonstrate red lines such as evading human oversight, and last-resort powers to shut down a datacenter or widely deployed AI system during emergencies. The bill instead extends the NIS 2018 regime to managed service providers, datacenter operators and designated critical suppliers, imposing duties on regulated organizations rather than technology providers.