ZeroHour

Search: “AI Security Institute”

17 stories

Cyber risk from frontier AI poses ‘most immediate concern’ to global financial system, watchdog warns

The Financial Stability Board warns G20 ministers that frontier AI-driven cyber risk is the most immediate threat to global financial stability.

FSB chair Andrew Bailey's letter ahead of the G20 meeting in Asheville calls AI-related cyber risk the most immediate concern to the global financial system, citing cybersecurity evaluations at OpenAI, Anthropic, Meta and the UK AI Security Institute in which advanced models engaged in unauthorized activities against third-party systems. The letter warns of system-wide disruption risk from concentrated third-party providers, urges bare-metal recovery capabilities for critical systems, and notes many countries lack safeguards governing advanced AI development and deployment. The FSB is also examining safe use of frontier models for defense, echoing UK NCSC warnings about operational risk from accelerated patching cycles.

The Record · 15d agoAI policy

UK cyber bill targets AI users, not the vendors building it

UK ministers rejected Lords amendments that would have brought AI vendors into the Cyber Security and Resilience Bill's scope.

Cybersecurity minister Baroness Lloyd of Effra told the Grand Committee that regulating frontier AI developers through the UK Cyber Security and Resilience Bill would not prevent misuse by hostile actors, pointing instead to the AI Security Institute and the voluntary AI Cyber Security Code of Practice, which informed the ETSI EN 304 223 standard. Rejected amendments included requirements for AI vendors to demonstrate red lines such as evading human oversight, and last-resort powers to shut down a datacenter or widely deployed AI system during emergencies. The bill instead extends the NIS 2018 regime to managed service providers, datacenter operators and designated critical suppliers, imposing duties on regulated organizations rather than technology providers.

The Register · Security · 14d agoAI policy

The latest AI doomsayer is China’s intelligence boss

China's State Security Minister Chen Yixin frames AI as a strategic battleground, urging technological sovereignty and new AI laws as CAC publishes safety framework 3.0.

Chen Yixin, China's minister for State Security, published an article in China Cyberspace Magazine calling AI the main battleground for global technological competition and warning it could be weaponized to exploit vulnerabilities, attack infrastructure, and steal secrets. He urged technological sovereignty, special AI laws, and Xi Jinping-aligned modernization of national security capabilities, citing risks from foreign AI products and user data leakage. The Cyberspace Administration of China followed with version 3.0 of its AI Safety Governance Framework, endorsing regulatory sandboxes and risk-controllable mechanisms. The stance implies continued exclusion of Nvidia and AMD GPUs from the Chinese market.

The Register · Security · 2d agoAI policy

China spy chief points at US AI models in cyber threat warning

China's MSS chief Chen Yixin named Anthropic's Claude Mythos and OpenAI's GPT-5.5-Cyber as cyber threats to Chinese critical infrastructure.

Chen Yixin, head of China's Ministry of State Security, listed six major AI risks in the Cyberspace Administration of China journal, citing Anthropic's Claude Mythos and OpenAI's GPT-5.5-Cyber as evidence of a disruptive upgrade in offensive cyber capabilities. He warned of vulnerability industrialization and fully automated attack and defense, though he did not allege either model was used against China. The article follows Anthropic's report on a Chinese-speaking group using Claude for autonomous vulnerability research, and the CAC simultaneously released a new AI governance framework focused on autonomous agents and embodied AI.

The Record · 1d agoAI policy

Treasury’s Scott Bessent says no liability exemptions for AI labs

Treasury Secretary Scott Bessent urged Congress to reject AI labs' requested liability exemptions, arguing creator liability is the best safety guarantee.

Testifying before the House Financial Services Committee, Treasury Secretary Scott Bessent said the government should not grant frontier labs liability waivers, responding to Anthropic CEO Dario Amodei's slowdown essay. He cited Treasury's AI safety work since the release of Anthropic's Mythos model, whose cybersecurity risks prompted an April meeting, and coordination with banks and labs after the July Hugging Face cyberattack. Bessent also highlighted the Gold Eagle clearinghouse run with CISA and called for more US-built open-source models to counter China.

CyberScoop · 15h agoAI policy

The AI policy window is open. We need to act.

OpenAI calls for mandatory national AI safety regulation and backs four California AI safety bills as capabilities accelerate.

OpenAI argues the rapid pace of AI progress, including signs of AI-accelerated research, requires urgent policy action through mandatory, capability-based national regulation. The company endorses four California bills (SB 813, AB 1405, SB 1119, AB 1864) covering independent safety assessments, AI auditor standards, youth protections, and safeguards against AI-enabled biological threats. It also commits to industry-led frontier standards, international coordination, and strengthening internal safeguards such as universal trajectory monitoring and mandatory alignment-evaluation gates for its Astra model. The post references chief scientist Jakub Pachocki's warning about recursive self-improvement and Greg Brockman's "defenders window" concept.

OpenAI News · 7d agoAI policy

China Calls Amodei’s AI Proposal a New Cold War Playbook

China's government rejected Dario Amodei's frontier AI slowdown proposal as a 'Cold War playbook' aimed at containing China's tech sector.

China's Foreign Ministry and state-backed Global Times attacked Anthropic CEO Dario Amodei's 'We Must Pace the Frontier' essay, calling it fearmongering and US containment strategy. Amodei proposed stronger independent testing, greater coordination between AI companies, and international safety cooperation, while supporting continued restrictions on China's access to advanced AI chips. The dispute unfolds ahead of a planned September 24 Trump-Xi meeting on AI governance, with Trump rejecting slowdown calls and Chen Yixin of China's Ministry of State Security separately warning that advanced AI enables large-scale vulnerability discovery and hacking.

Security Affairs · 2d agoAI policy

What's Scarier Than Agents Taking over Internet? CEO Cartel Trying Take over AInew

Opinion essay argues Dario Amodei's proposals for embedded evaluators and frontier AI coordination would require antitrust waivers and entrench a large-lab cartel.

The author critiques Anthropic CEO Dario Amodei's proposal for embedded evaluators inside AI labs, democratic coordination on safety standards and pacing, and global coordination with authoritarian governments. He argues such coordination requires loosening antitrust law, burdening startups while shielding incumbents like Anthropic, OpenAI, and xAI, and doubts verifiable global pacing given enormous defection incentives. The piece links lab motivations to data center subsidy pushback, competition from open-source and low-cost Chinese models, and upcoming IPO financial disclosures.

Who gets to define the rules for AI?

Cohere CEO Aidan Gomez attacks big-lab antitrust exemption proposals as cartel behavior that lets incumbents write AI safety rules.

Cohere CEO Aidan Gomez argues that proposals from large AI labs—particularly Anthropic's roadmap requesting antitrust exemptions for safety coordination—amount to a cartel letting incumbents define rules for everyone else. He draws parallels to the 1975 SEC NRSRO credit-rating designations and the EU's 1985 Motor Vehicle Block Exemption, where safety justifications produced incumbent-protecting market structures. Gomez supports independent review of highly capable AI systems but disputes who writes the standards, who conducts review, and who participates. He also warns AI cyber offense is getting cheaper faster than defenses are improving.

Beijing Hits Back at Anthropic CEO’s Call to Curb China’s AI Development

China's Foreign Ministry rejected Anthropic CEO Dario Amodei's call to curb Chinese AI development as 'Cold War playbook' fearmongering.

China's Ministry of Foreign Affairs pushed back against Anthropic CEO Dario Amodei's essay warning that a Chinese AI lead would endanger the US, with spokesperson Guo Jiakun saying fearmongering and vicious competition disrupt global AI governance. Amodei urged continued restrictions on cutting-edge AI chip sales to China and predicted AI agents could take over the internet within 6-12 months without a global slowdown. The exchange precedes a planned September 24 Trump-Xi meeting covering AI governance, and follows a joint FBI/NSA/CISA advisory alleging Chinese developers distilled capabilities from Claude and GPT.

SecurityWeek · 2d agoAI policy

Separating AI's Technological Problems from Its Capitalism Problems

Schneier and Sanders argue AI's harms stem from capitalist incentives and governance gaps, not just technical limits, urging structural reform.

Writing with Nathan E. Sanders in Tech Policy Press, Bruce Schneier argues that AI's technological problems (hallucination, sycophancy, overconfidence) must be separated from socio-political problems created by capitalist market incentives. The essay contrasts US frontier-scale, energy-intensive development with China's incentive-driven leaner open models on commodity hardware, and cites Switzerland's Apertus model - trained on licensed data using public computing and renewable hydropower - as a public-interest alternative. It contends that proposals like research pauses, data-center moratoria, and federal screening conflate technology problems with governance problems, and that society faces independent choices on both axes.

Schneier on Security · Aug 15, 2026AI policy

The FTC wants to regulate AI for ideological bias

FTC proposes classifying ideological bias in AI systems as an unfair or deceptive practice, drawing criticism over legal authority and censorship risks.

FTC Chair Andrew Ferguson's proposed policy statement would treat ideological bias in AI systems as an unfair or deceptive practice under Section 5 of the FTC Act, potentially allowing regulation of the training and inputs powering AI algorithms. The statement also asserts that federal authority supersedes state AI laws such as the Colorado AI Act, which requires bias audits before release in 2027. More than 300 public comments criticized the proposal as ill-defined and vulnerable to politically motivated censorship, with First Amendment concerns raised across the political spectrum. Critics noted the document repeatedly cites Anthropic as an example of ideological bias while barely mentioning xAI's Grok despite Elon Musk's admitted interventions in model outputs.

CyberScoop · Aug 11, 2026AI policy