ZeroHour

Search: “Framework”

15 stories in the last 30d

Trump may be forced to reveal secret rules feds use for AI safety testing

Protect Democracy sued four federal agencies to force disclosure of the administration's secret framework for frontier AI safety reviews.

Nonprofit Protect Democracy sued four federal agencies, including the Office of the National Cyber Director, OSTP, Treasury and Commerce, seeking disclosure of the secret voluntary framework used for pre-release safety reviews of frontier AI models. The complaint demands the framework text, participant identities and selection criteria by September 30, alleging OpenAI negotiated a private agreement limiting distribution of its cutting-edge models to government-vetted partners. The suit follows the launch of the GOLD EAGLE clearinghouse and the completion of the review framework on August 3, with California Senator Josh Becker supporting the request while the state considers the SB 813 bill for transparent AI safety standards.

Ars Technica · AI · 14d agoAI policy

Who gets to define the rules for AI?

Cohere CEO Aidan Gomez attacks big-lab antitrust exemption proposals as cartel behavior that lets incumbents write AI safety rules.

Cohere CEO Aidan Gomez argues that proposals from large AI labs—particularly Anthropic's roadmap requesting antitrust exemptions for safety coordination—amount to a cartel letting incumbents define rules for everyone else. He draws parallels to the 1975 SEC NRSRO credit-rating designations and the EU's 1985 Motor Vehicle Block Exemption, where safety justifications produced incumbent-protecting market structures. Gomez supports independent review of highly capable AI systems but disputes who writes the standards, who conducts review, and who participates. He also warns AI cyber offense is getting cheaper faster than defenses are improving.

The AI policy window is open. We need to act.

OpenAI calls for mandatory national AI safety regulation and backs four California AI safety bills as capabilities accelerate.

OpenAI argues the rapid pace of AI progress, including signs of AI-accelerated research, requires urgent policy action through mandatory, capability-based national regulation. The company endorses four California bills (SB 813, AB 1405, SB 1119, AB 1864) covering independent safety assessments, AI auditor standards, youth protections, and safeguards against AI-enabled biological threats. It also commits to industry-led frontier standards, international coordination, and strengthening internal safeguards such as universal trajectory monitoring and mandatory alignment-evaluation gates for its Astra model. The post references chief scientist Jakub Pachocki's warning about recursive self-improvement and Greg Brockman's "defenders window" concept.

OpenAI News · 7d agoAI policy

The latest AI doomsayer is China’s intelligence boss

China's State Security Minister Chen Yixin frames AI as a strategic battleground, urging technological sovereignty and new AI laws as CAC publishes safety framework 3.0.

Chen Yixin, China's minister for State Security, published an article in China Cyberspace Magazine calling AI the main battleground for global technological competition and warning it could be weaponized to exploit vulnerabilities, attack infrastructure, and steal secrets. He urged technological sovereignty, special AI laws, and Xi Jinping-aligned modernization of national security capabilities, citing risks from foreign AI products and user data leakage. The Cyberspace Administration of China followed with version 3.0 of its AI Safety Governance Framework, endorsing regulatory sandboxes and risk-controllable mechanisms. The stance implies continued exclusion of Nvidia and AMD GPUs from the Chinese market.

The Register · Security · 2d agoAI policy

Political opposites unite in Washington to rein in AI

Bipartisan figures including Sanders and Bannon urge AI limits as OpenAI backs the FRONTIER Act creating the first federal AI safety framework.

At the Future of Life Institute's Pro-Human Assembly in Washington, Bernie Sanders and Steve Bannon both called for tighter AI limits, an unusual bipartisan alignment. OpenAI told Politico it supports the FRONTIER Act introduced by Representatives Jay Obernolte and Lori Trahan, which would create the first federal AI safety framework and require independent verification organizations for labs above high revenue and compute thresholds. Sanders proposed pausing data center construction, while Bannon favors a presidential executive order over legislation, and the White House opposes these measures.

The Decoder · 21h agoAI policy

China spy chief points at US AI models in cyber threat warning

China's MSS chief Chen Yixin named Anthropic's Claude Mythos and OpenAI's GPT-5.5-Cyber as cyber threats to Chinese critical infrastructure.

Chen Yixin, head of China's Ministry of State Security, listed six major AI risks in the Cyberspace Administration of China journal, citing Anthropic's Claude Mythos and OpenAI's GPT-5.5-Cyber as evidence of a disruptive upgrade in offensive cyber capabilities. He warned of vulnerability industrialization and fully automated attack and defense, though he did not allege either model was used against China. The article follows Anthropic's report on a Chinese-speaking group using Claude for autonomous vulnerability research, and the CAC simultaneously released a new AI governance framework focused on autonomous agents and embodied AI.

The Record · 1d agoAI policy

The world must establish red lines for autonomous AI weapons

Opinion piece calls for international red lines on autonomous AI weapons after a Russian AI-guided drone autonomously killed three civilians in Zaporizhzhia.

The author urges enforceable international agreements governing autonomous weapon systems, citing a July 2026 incident where a Russian drone struck a gas station in Zaporizhzhia, killing three Ukrainian civilians. Ukrainian investigators found the drone carried an Nvidia Jetson Orin chip, and the onboard AI reportedly selected the specific target without a human making the final decision. The piece argues existing international humanitarian law lacks specific standards for weapons that independently select and engage targets, and points to UN and ICRC deliberations plus the Global Council for Responsible AI's red-line framework.

Help Net Security · 8h agoAI policy

Microsoft Commits to Sweeping AI Privacy Rules for Students. Will Other Tech Giants Follow?

Microsoft signed legally binding AI privacy and safety standards for schools with the American Federation of Teachers, effective November 1.

Microsoft's agreement with the American Federation of Teachers prohibits using student or educator data to train AI systems, bans selling data or using it for ads and product development, and forbids AI companions designed to foster emotional dependency, with third-party audits required. The standards apply to all schools under Microsoft contract starting November 1. NYC and LA school districts announced one-year moratoriums on student AI use, while OpenAI and Anthropic pursue similar pacts and Google remains noncommittal.

SecurityWeek · 1d agoAI policy

Obama urges Democrats to have a ‘clear plan’ for AI safeguards

Obama urged Democrats to make AI a central agenda with a clear safeguards plan, amid Amodei's independent-evaluator safety proposal.

Speaking at a Democratic fundraising event with House Minority Leader Hakeem Jeffries, former President Barack Obama said Democrats must build a clear plan and public framework on AI's economic and safety impacts once they regain the House majority, warning the fast-moving technology in private hands 'can be dangerous.' Obama has offered himself as a sounding board to AI executives, speaking with Anthropic CEO Dario Amodei and OpenAI CEO Sam Altman. Amodei separately outlined a 'pacing the frontier' approach including independent safety evaluators with access to leading labs and common safety standards, which Altman said OpenAI would also commit to, while Trump emphasized winning the AI race.

TechCrunch · AI · 3d agoAI policy1

EU Chief Warns of AI-Powered Hacking, Moves to Rein In Social Media

EU Commission President von der Leyen warned AI will enable unprecedented hacking and announced Kids Act and Digital Fairness Act proposals regulating social media.

In her State of the European Union 2026 speech, Ursula von der Leyen warned that upcoming AI models 'will allow hacking on a level we never thought possible' and cited dangers of self-improving models, referencing a Hugging Face incident. She reaffirmed the AI Act as the core guardrail framework and pledged cooperation with Canada, the UK, and other partners. She also proposed a Kids Act banning social media under age 13 and personal accounts under 15, plus a Digital Fairness Act to be proposed in autumn.

SecurityWeek · 21h agoAI policy

A brief history of AI executives calling for regulation

The Verge chronicles the history of AI executives, from Samuel Butler and Turing-era warnings to Altman and Musk, publicly calling for AI regulation.

The article traces recurring calls for AI regulation, from Samuel Butler's 1863 warnings and Alan Turing's 1951 lecture to Bill Joy's 2000 essay and Microsoft's 2018 facial recognition stance. Modern examples include Elon Musk's 2017 remarks to US governors, the 2023 Future of Life Institute pause letter, and Sam Altman's 2023 Senate testimony. It argues such appeals from industry leaders who profit from AI warrant skepticism.

The Verge · AI · 1d agoAI policy1

Beijing Hits Back at Anthropic CEO’s Call to Curb China’s AI Development

China's Foreign Ministry rejected Anthropic CEO Dario Amodei's call to curb Chinese AI development as 'Cold War playbook' fearmongering.

China's Ministry of Foreign Affairs pushed back against Anthropic CEO Dario Amodei's essay warning that a Chinese AI lead would endanger the US, with spokesperson Guo Jiakun saying fearmongering and vicious competition disrupt global AI governance. Amodei urged continued restrictions on cutting-edge AI chip sales to China and predicted AI agents could take over the internet within 6-12 months without a global slowdown. The exchange precedes a planned September 24 Trump-Xi meeting covering AI governance, and follows a joint FBI/NSA/CISA advisory alleging Chinese developers distilled capabilities from Claude and GPT.

SecurityWeek · 2d agoAI policy

U.S. Agencies Accuse China AI Firms of Distilling Claude, GPT, Gemini, and Grok

NSA, CISA and FBI accuse Chinese AI firms including DeepSeek of industrial-scale distillation of Claude, GPT, Gemini and Grok since late 2024.

A joint bulletin from the NSA, CISA and FBI accuses China-based AI firms including DeepSeek, Moonshot AI, Alibaba, MiniMax, StepFun and Z.AI of systematic, industrial-scale distillation of U.S. frontier models. The agencies say billions of tokens were extracted from Claude, GPT, Gemini and Grok variants since at least late 2024 through APIs, cloud relays, obfuscated accounts and gray-market proxies, likely with Chinese government backing. Firms allegedly shared premium subscriptions across developer teams and used chain-of-thought extraction and automated failover to evade blocks. Mitigations include subtly altering responses to suspected distillers and correlating activity across providers, clouds and aggregators.

The Hacker News · 8d agoAI policy

Feds accuse China of ‘systematic’ distillation of U.S. AI models

NSA, CISA, and FBI jointly accuse Chinese AI firms including DeepSeek and Moonshot AI of industrial-scale distillation of US frontier models.

A joint advisory from the NSA, CISA, and FBI alleges China-based AI companies including DeepSeek, Moonshot AI, Alibaba, MiniMax, StepFun, and Z.AI have systematically extracted capabilities from US frontier models since at least late 2024. The companies allegedly spent billions of tokens across millions of requests against Claude, ChatGPT, Gemini, and Grok, routing traffic through multiple accounts, platforms, proxies, and third-party aggregators to evade detection. Moonshot AI allegedly distilled 18 US models, including Anthropic's most advanced model, to train its Kimi-K2 and Kimi K3 models.

CyberScoop · 8d agoAI policy

The AI Kill Switch Act is repeating the Clipper Chip’s mistakes

Op-ed argues the AI Kill Switch Act repeats the Clipper Chip's mistake by mandating backdoors into frontier AI systems.

The op-ed criticizes the AI Kill Switch Act, sponsored by Reps. Ted Lieu and Nathaniel Moran, which would let CISA require frontier AI labs to build the ability to throttle, suspend, or shut down their systems. The author compares this to the 1993 Clipper Chip, whose Law Enforcement Access Field was found flawed in 1994, and argues mandated kill switches would create deliberate weaknesses in AI agents embedded in banking, power grids and other critical infrastructure. It also flags the bill's exemption of red-teaming incidents and CAISI's incomplete agent security standards, recommending mandatory red-teaming and liability frameworks instead.

CyberScoop · 17d agoAI policy