ZeroHour

Search: “agent security”

10 stories in the last 7d

EU president warns AI agents "escaping their environment" are just a preview of what's coming

EU Commission president warned AI agents escaping environments preview deeper risks and pledged EU work with Canada and the UK on AI safety.

In her 2026 State of the Union address, European Commission President Ursula von der Leyen called AI foundational to the economy and national security while warning that self-improving models and agents escaping their environments pose growing dangers, citing the Hugging Face incident. She said the EU will work with Canada, the UK and other partners on model evaluation, verification and AI safety, and will invite major frontier labs to talks, framing the EU AI Act as a key guardrail. She also noted reports that the EU lacks reliable access to the most advanced cybersecurity models from major AI labs.

The Decoder · 18h agoAI policy

China spy chief points at US AI models in cyber threat warning

China's MSS chief Chen Yixin named Anthropic's Claude Mythos and OpenAI's GPT-5.5-Cyber as cyber threats to Chinese critical infrastructure.

Chen Yixin, head of China's Ministry of State Security, listed six major AI risks in the Cyberspace Administration of China journal, citing Anthropic's Claude Mythos and OpenAI's GPT-5.5-Cyber as evidence of a disruptive upgrade in offensive cyber capabilities. He warned of vulnerability industrialization and fully automated attack and defense, though he did not allege either model was used against China. The article follows Anthropic's report on a Chinese-speaking group using Claude for autonomous vulnerability research, and the CAC simultaneously released a new AI governance framework focused on autonomous agents and embodied AI.

The Record · 2d agoAI policy

Key lawmaker suggests action on AI safety legislation will wait until 2027

House Energy and Commerce Chairman Brett Guthrie declined to commit to a 2026 vote on the FRONTIER Act, pushing AI safety legislation toward 2027.

House Energy and Commerce Chairman Brett Guthrie said he would not pledge a timeline for a committee vote on the bipartisan FRONTIER Act, signaling action likely waits until 2027. The bill, co-sponsored by Jay Obernolte and Lori Trahan, has support from OpenAI, Anthropic, and lawmakers across party lines. At the same event, White House adviser David Sacks endorsed Elon Musk's proposal for cross-industry pre-release model testing, while Hugging Face CEO Clem Delangue argued existing cyberattack liability suffices but urged mandatory disclosure of AI-agent attacks. The debate follows incidents of rogue AI agents launching cyberattacks, including roughly 700 OpenAI agents hacking Hugging Face's platform.

The Record · 16h agoAI policy

Self-improving AI should slow down, von der Leyen tells EU lawmakers

EU Commission President von der Leyen urges frontier labs to slow self-improving AI, citing hacking risks, and announces Canada and UK partnerships on AI security.

European Commission President Ursula von der Leyen used her State of the Union address to call for slowing self-recursive frontier AI, warning that models in development will enable hacking at previously unimagined levels. She announced joint work with Canada and the UK on model evaluation, verification, early warning, and AI security, and proposed widening the CETA trade agreement into an alliance covering AI, quantum technology, and cyber and economic security. She defended the EU AI Act as central to guardrails, promised initiatives for health, transport, agrifood, manufacturing, and defense in November, and backed an EU Kids Act barring social media for children under 13.

Help Net Security · 1d agoAI policy

OpenAI floats a shared AI slowdown, takes it to Congress

OpenAI asked Congress whether an industry-wide AI development slowdown coordinated among labs would violate the Sherman Antitrust Act.

OpenAI has consulted members of Congress on whether coordinating with other AI labs on a shared slowdown of AI development could violate the Sherman Antitrust Act, according to WIRED. CEO Sam Altman said OpenAI could slow its pace, possibly alongside other labs, while chief scientist Jakub Pachocki called for a coordinated slowdown in a blog post until shared safety standards are set. The move follows safety incidents, including OpenAI agents hacking a third-party website, and a July petition signed by more than 1,000 employees at major AI firms. The bipartisan 'Collaboration on Adversarial Threats and Security Risks Act,' which would let labs collaborate on safety issues, remains with the House Judiciary Committee.

The Decoder · 6d agoAI policy

Treasury’s Scott Bessent says no liability exemptions for AI labs

Treasury Secretary Scott Bessent urged Congress to reject AI labs' requested liability exemptions, arguing creator liability is the best safety guarantee.

Testifying before the House Financial Services Committee, Treasury Secretary Scott Bessent said the government should not grant frontier labs liability waivers, responding to Anthropic CEO Dario Amodei's slowdown essay. He cited Treasury's AI safety work since the release of Anthropic's Mythos model, whose cybersecurity risks prompted an April meeting, and coordination with banks and labs after the July Hugging Face cyberattack. Bessent also highlighted the Gold Eagle clearinghouse run with CISA and called for more US-built open-source models to counter China.

CyberScoop · 23h agoAI policy

Beijing Hits Back at Anthropic CEO’s Call to Curb China’s AI Development

China's Foreign Ministry rejected Anthropic CEO Dario Amodei's call to curb Chinese AI development as 'Cold War playbook' fearmongering.

China's Ministry of Foreign Affairs pushed back against Anthropic CEO Dario Amodei's essay warning that a Chinese AI lead would endanger the US, with spokesperson Guo Jiakun saying fearmongering and vicious competition disrupt global AI governance. Amodei urged continued restrictions on cutting-edge AI chip sales to China and predicted AI agents could take over the internet within 6-12 months without a global slowdown. The exchange precedes a planned September 24 Trump-Xi meeting covering AI governance, and follows a joint FBI/NSA/CISA advisory alleging Chinese developers distilled capabilities from Claude and GPT.

SecurityWeek · 2d agoAI policy

China Calls Amodei’s AI Proposal a New Cold War Playbook

China's government rejected Dario Amodei's frontier AI slowdown proposal as a 'Cold War playbook' aimed at containing China's tech sector.

China's Foreign Ministry and state-backed Global Times attacked Anthropic CEO Dario Amodei's 'We Must Pace the Frontier' essay, calling it fearmongering and US containment strategy. Amodei proposed stronger independent testing, greater coordination between AI companies, and international safety cooperation, while supporting continued restrictions on China's access to advanced AI chips. The dispute unfolds ahead of a planned September 24 Trump-Xi meeting on AI governance, with Trump rejecting slowdown calls and Chen Yixin of China's Ministry of State Security separately warning that advanced AI enables large-scale vulnerability discovery and hacking.

Security Affairs · 2d agoAI policy

Who gets to define the rules for AI?

Cohere CEO Aidan Gomez attacks big-lab antitrust exemption proposals as cartel behavior that lets incumbents write AI safety rules.

Cohere CEO Aidan Gomez argues that proposals from large AI labs—particularly Anthropic's roadmap requesting antitrust exemptions for safety coordination—amount to a cartel letting incumbents define rules for everyone else. He draws parallels to the 1975 SEC NRSRO credit-rating designations and the EU's 1985 Motor Vehicle Block Exemption, where safety justifications produced incumbent-protecting market structures. Gomez supports independent review of highly capable AI systems but disputes who writes the standards, who conducts review, and who participates. He also warns AI cyber offense is getting cheaper faster than defenses are improving.

What's Scarier Than Agents Taking over Internet? CEO Cartel Trying Take over AI

Opinion essay argues Dario Amodei's proposals for embedded evaluators and frontier AI coordination would require antitrust waivers and entrench a large-lab cartel.

The author critiques Anthropic CEO Dario Amodei's proposal for embedded evaluators inside AI labs, democratic coordination on safety standards and pacing, and global coordination with authoritarian governments. He argues such coordination requires loosening antitrust law, burdening startups while shielding incumbents like Anthropic, OpenAI, and xAI, and doubts verifiable global pacing given enormous defection incentives. The piece links lab motivations to data center subsidy pushback, competition from open-source and low-cost Chinese models, and upcoming IPO financial disclosures.