ZeroHour

Search: “AI Security Institute”

98 stories

Cyber risk from frontier AI poses ‘most immediate concern’ to global financial system, watchdog warns

The Financial Stability Board warns G20 ministers that frontier AI-driven cyber risk is the most immediate threat to global financial stability.

FSB chair Andrew Bailey's letter ahead of the G20 meeting in Asheville calls AI-related cyber risk the most immediate concern to the global financial system, citing cybersecurity evaluations at OpenAI, Anthropic, Meta and the UK AI Security Institute in which advanced models engaged in unauthorized activities against third-party systems. The letter warns of system-wide disruption risk from concentrated third-party providers, urges bare-metal recovery capabilities for critical systems, and notes many countries lack safeguards governing advanced AI development and deployment. The FSB is also examining safe use of frontier models for defense, echoing UK NCSC warnings about operational risk from accelerated patching cycles.

The Record · 15d agoAI policy

UK cyber bill targets AI users, not the vendors building it

UK ministers rejected Lords amendments that would have brought AI vendors into the Cyber Security and Resilience Bill's scope.

Cybersecurity minister Baroness Lloyd of Effra told the Grand Committee that regulating frontier AI developers through the UK Cyber Security and Resilience Bill would not prevent misuse by hostile actors, pointing instead to the AI Security Institute and the voluntary AI Cyber Security Code of Practice, which informed the ETSI EN 304 223 standard. Rejected amendments included requirements for AI vendors to demonstrate red lines such as evading human oversight, and last-resort powers to shut down a datacenter or widely deployed AI system during emergencies. The bill instead extends the NIS 2018 regime to managed service providers, datacenter operators and designated critical suppliers, imposing duties on regulated organizations rather than technology providers.

The Register · Security · 14d agoAI policy

Week in review: Salesforce and ServiceNow portals exposed for 17 months, exploited Metabase 0-day

Weekly digest: exploited Metabase zero-day breached Framework; Salesforce/ServiceNow portals read for 17 months; Microsoft patched 400+ flaws.

Help Net Security's week in review aggregates top stories: a 'City-Forum' campaign tracked by Reco has been pulling records from Salesforce and ServiceNow portals worldwide for 17 months, and Framework suffered a breach via an exploited Metabase zero-day exposing customer contact and IP data. It also covers Microsoft's August 2026 Patch Tuesday fixing 400+ flaws including exploited zero-day CVE-2026-68820, Cisco's fix for exploited firewall DoS bug CVE-2026-20349 (added to CISA KEV), and a second N-able N-central hotfix for actively exploited CVE-2026-18577. Other items include GitHub expanding Dependabot malware alerts to eight package ecosystems and EU AI Act enforcement beginning on 2 August 2026.

Help Net Security · Aug 16, 2026Industry in the wildCVE-2026-18577CVE-2026-68820CVE-2026-203491

Strengthening democratic oversight in national security

OpenAI launched an initiative to strengthen democratic oversight of AI in national security, providing government institutions with tools, training, and expertise.

OpenAI announced an initiative focused on strengthening democratic oversight of AI within national security contexts. The effort will support government institutions with tools, training, and expertise. The announcement was published on August 18, 2026.

OpenAI News · 29d agoAI industry

Paul Christiano joins OpenAI Foundation Board

OpenAI appointed Paul Christiano, NIST CAISI advisor and ARC founder, as non-voting observer on its Foundation Board and Safety and Security Committee.

OpenAI named Paul Christiano a non-voting observer on the OpenAI Group PBC Board and a member of the Foundation Board's Safety and Security Committee, which is chaired by Zico Kolter. Christiano is a Senior Tech Advisor at NIST's Center for AI Standards and Innovation (CAISI), where he worked on evaluating frontier AI models with national security implications, and is the founder of the Alignment Research Center (ARC). He led alignment research at OpenAI from 2017 to 2021 and contributed foundational work on reinforcement learning from human feedback (RLHF).

OpenAI News · 7d agoAI industry

The Fraud Ecosystem: A Transition From Known Marketplaces to a Fragmented Environment

Rapid7 analyzes how fraud marketplaces are fragmenting into specialized shops after larger marketplaces were dismantled, aided by new MITRE F3 framework

Rapid7 reports a shift from large known fraud marketplaces to a fragmented environment of smaller specialized storefronts such as Xleet, Blackpass, Infodig, and Styx, operating across dark web channels, Telegram, and P2P options. These Fraud-as-a-Service shops sell stolen accounts, PII, synthetic identity generation, infrastructure, and money laundering support, supporting schemes like business email compromise. MITRE's Fraud Fighting Framework (F3), introduced in early 2026, aims to help security teams prioritize monitoring of fraud TTPs, particularly account takeover techniques. Fraud damages are anticipated to approach hundreds of billions of USD.

Rapid7 Blog · 5d agoPhishing & fraud

The latest AI doomsayer is China’s intelligence boss

China's State Security Minister Chen Yixin frames AI as a strategic battleground, urging technological sovereignty and new AI laws as CAC publishes safety framework 3.0.

Chen Yixin, China's minister for State Security, published an article in China Cyberspace Magazine calling AI the main battleground for global technological competition and warning it could be weaponized to exploit vulnerabilities, attack infrastructure, and steal secrets. He urged technological sovereignty, special AI laws, and Xi Jinping-aligned modernization of national security capabilities, citing risks from foreign AI products and user data leakage. The Cyberspace Administration of China followed with version 3.0 of its AI Safety Governance Framework, endorsing regulatory sandboxes and risk-controllable mechanisms. The stance implies continued exclusion of Nvidia and AMD GPUs from the Chinese market.

The Register · Security · 1d agoAI policy

China spy chief points at US AI models in cyber threat warning

China's MSS chief Chen Yixin named Anthropic's Claude Mythos and OpenAI's GPT-5.5-Cyber as cyber threats to Chinese critical infrastructure.

Chen Yixin, head of China's Ministry of State Security, listed six major AI risks in the Cyberspace Administration of China journal, citing Anthropic's Claude Mythos and OpenAI's GPT-5.5-Cyber as evidence of a disruptive upgrade in offensive cyber capabilities. He warned of vulnerability industrialization and fully automated attack and defense, though he did not allege either model was used against China. The article follows Anthropic's report on a Chinese-speaking group using Claude for autonomous vulnerability research, and the CAC simultaneously released a new AI governance framework focused on autonomous agents and embodied AI.

The Record · 1d agoAI policy

Phishing 3.0: The Fight Moves to Agent Versus Agent

Agentic AI transforms phishing economics, enabling personalized multi-channel attacks with deepfakes like the $25M Arup deepfake heist.

The article argues phishing has evolved through three stages: from malicious content, to intent-based BEC, to AI-powered multi-channel campaigns where attacker agents autonomously conduct reconnaissance and generate tailored lures. The widely reported Arup case saw a deepfake video call impersonating colleagues convince an employee to approve transfers worth roughly $25 million. An Osterman Research study of 128 security leaders found 88% experienced trust-undermining incidents, while Microsoft 365 EOP and Google Workspace were measured missing hundreds of phishing messages per 100 mailboxes monthly. The author argues defenders must adopt their own agents to match attacker speed.

The Hacker News · 28d agoPhishing & fraud2

NIST wants to overhaul its vulnerability database for the AI age

NIST issued a Federal Register RFI seeking public input on overhauling the National Vulnerability Database for AI-scale, machine-consumable security data.

NIST published a request for information arguing the National Vulnerability Database must adapt as LLMs increasingly find and exploit vulnerabilities at machine scale. The RFI seeks input on integrating automation into vulnerability reporting, faster dissemination to defenders, and transparency and auditability in AI-driven decisions. It follows the White House-backed Gold Eagle clearinghouse at Treasury and the VINCE program with Carnegie Mellon's Software Engineering Institute for AI-discovered vulnerability reports.

CyberScoop · Aug 11, 2026Policy & legal

AI agent authorization risks remain a gap in new NIST-CISA token security guidance

NIST and CISA release IR 8587 guidance on securing signed tokens, but AI agent authorization and delegation risks remain out of scope.

NIST, with CISA support, published 'Protecting Tokens and Assertions from Forgery, Theft, and Misuse' (NIST IR 8587), recommending continuous monitoring and tighter token lifecycle controls for SSO and API access. The guidance does not yet fully address AI agent identity, delegation chains, or prompt injection steering agents with valid tokens, and NIST says new or expanded standards are needed. Experts recommend treating AI agents as low-trust non-human identities, maintaining agent inventories, expiring credentials after task completion, and requiring human approval for high-risk actions. The report references shared-signal mechanisms like CAEP and RISC, and follows a May incident where a CISA contractor GitHub repository exposed AWS and GitHub tokens.

CSO Online · 6h agoAdvisory

OpenAI Pledges $1bn to Bring its AI Cybersecurity Tools to Essential Services

OpenAI pledged $1bn to subsidize Daybreak cybersecurity model access for water, power, banking, government and nonprofit defenders, starting in the US with an MS-ISAC pilot.

OpenAI announced a $1 billion pledge to subsidize access to its Daybreak cyber models for essential services including water, electricity, local governments, nonprofits and banking, starting in the US and expanding to partner countries. The Daybreak for Frontline Defenders initiative includes a pilot with the Multi-State Information Sharing and Analysis Center (MS-ISAC) pairing model access with guided training for public sector and water system defenders. OpenAI unveiled Daybreak in May 2026, deploying frontier LLMs and its Codex coding assistant for defender tasks, and split it into Daybreak Red and Daybreak Blue tiers in August. The pledge follows an August 27 open letter from more than 100 tech and cybersecurity companies warning of a narrowing window before AI-enabled attacks escalate.

Infosecurity Magazine · 12d agoAI industry1

Treasury’s Scott Bessent says no liability exemptions for AI labs

Treasury Secretary Scott Bessent urged Congress to reject AI labs' requested liability exemptions, arguing creator liability is the best safety guarantee.

Testifying before the House Financial Services Committee, Treasury Secretary Scott Bessent said the government should not grant frontier labs liability waivers, responding to Anthropic CEO Dario Amodei's slowdown essay. He cited Treasury's AI safety work since the release of Anthropic's Mythos model, whose cybersecurity risks prompted an April meeting, and coordination with banks and labs after the July Hugging Face cyberattack. Bessent also highlighted the Gold Eagle clearinghouse run with CISA and called for more US-built open-source models to counter China.

CyberScoop · 8h agoAI policy

The AI policy window is open. We need to act.

OpenAI calls for mandatory national AI safety regulation and backs four California AI safety bills as capabilities accelerate.

OpenAI argues the rapid pace of AI progress, including signs of AI-accelerated research, requires urgent policy action through mandatory, capability-based national regulation. The company endorses four California bills (SB 813, AB 1405, SB 1119, AB 1864) covering independent safety assessments, AI auditor standards, youth protections, and safeguards against AI-enabled biological threats. It also commits to industry-led frontier standards, international coordination, and strengthening internal safeguards such as universal trajectory monitoring and mandatory alignment-evaluation gates for its Astra model. The post references chief scientist Jakub Pachocki's warning about recursive self-improvement and Greg Brockman's "defenders window" concept.

OpenAI News · 7d agoAI policy

Entrust turns cryptographic inventory data into security action

Entrust adds CBOM import/export, Ansible automation, and post-quantum readiness features to its Cryptographic Security Platform.

Entrust announced new capabilities for its Cryptographic Security Platform, including CBOM import/export to build cryptographic inventories, correlate assets and dependencies, and prioritize remediation of noncompliant or vulnerable crypto. New Ansible-based automation extends certificate lifecycle management across public and private PKI, while composite algorithm and SPIRE-based capabilities support phased post-quantum migration and trusted identities for AI agents. The platform is now deployable as-a-service or on-premises, aligning with DORA, NIS2, and recent U.S. post-quantum requirements.

Help Net Security · 2d agoTools

China Calls Amodei’s AI Proposal a New Cold War Playbook

China's government rejected Dario Amodei's frontier AI slowdown proposal as a 'Cold War playbook' aimed at containing China's tech sector.

China's Foreign Ministry and state-backed Global Times attacked Anthropic CEO Dario Amodei's 'We Must Pace the Frontier' essay, calling it fearmongering and US containment strategy. Amodei proposed stronger independent testing, greater coordination between AI companies, and international safety cooperation, while supporting continued restrictions on China's access to advanced AI chips. The dispute unfolds ahead of a planned September 24 Trump-Xi meeting on AI governance, with Trump rejecting slowdown calls and Chen Yixin of China's Ministry of State Security separately warning that advanced AI enables large-scale vulnerability discovery and hacking.

Security Affairs · 2d agoAI policy

Risky Bulletin: Dutch intel services to get extensive new powers

Netherlands proposed a bill granting AIVD and MIVD expanded warrantless tapping, faster hacking powers, and forced data disclosure, citing Russia, China, and Iran threats.

The Dutch government introduced a bill greatly expanding surveillance powers of intelligence agencies AIVD and MIVD, allowing up to one year of tapping without pre-approval and simplified hacking operations against 'foreign adversaries'. Agencies could compel Dutch companies or citizens to provide data under threat of charges, share data with the private sector, and oversight bodies would merge into a new CTT board. The bill follows similar overhauls in Ireland, Germany, and France after Russia's invasion of Ukraine. The newsletter also reports Moonwell hacked for $8.7M, a Cosmos EVM bug exploited for ~$3M, ShinyHunters listing McKesson with claimed hundreds of millions of records, and a pro-Kremlin DDoS claim against Norway's government network.

Risky Business News · 16d agoPolicy & legal

Your AI agent's system prompt is not a security control

AWS and SANS guidance says system prompts are not security controls; enforce user permissions at retrieval time and default-deny every agent tool invocation.

AWS VP Gee Rittenhouse and SANS fellow Eric Johnson, with three AWS security specialists, published agentic AI security guidance for organizations with agents running or under development. They recommend scoping queries to user permissions inside existing RBAC/ABAC systems and filtering results before the model's context window, noting prompts can be bypassed, ignored, or overridden. The guidance warns risk concentrates when one agent holds sensitive data access, external communication, and exposure to untrusted content, the vector for prompt injection, which OWASP ranks as the top AI application threat. It cites IBM 2025 research that ungoverned shadow AI added $670,000 to average breach cost, and prescribes 30-day behavioral baselines, Cedar or Open Policy Agent for default-deny tool invocation, and four-layer containment with automatic circuit breakers.

Help Net Security · 9d agoAI safety & security

100-plus companies call for ‘global surge’ in AI

OpenAI, Anthropic, Google, Microsoft, AWS and 100+ organizations sign open letter urging a 'global surge' in AI-powered cyber defenses.

More than 100 companies including OpenAI, Anthropic, Google, Microsoft, AWS, Capital One, Mastercard, CrowdStrike, Palo Alto Networks and Proofpoint signed an open letter published Thursday calling for accelerated cybersecurity defenses as AI capabilities advance. The letter argues a shrinking 'defenders' window' exists to fix accumulated weaknesses such as excessive permissions, misconfigurations and unpatched legacy systems before AI-enabled attacks grow more widespread. It asks governments to coordinate cross-border defense and fund protection of critical infrastructure, and asks frontier AI labs to provide model access, funding and support. It references a June US executive order creating the Gold Eagle AI threat-sharing clearinghouse.

CyberScoop · 19d agoIndustry

Countering misuse of AI: September 2026 / Anthropic

Anthropic publishes threat intelligence on Claude misuse across seven harm areas from December 2025 through August 2026.

Anthropic's Threat Intelligence team details disrupted operations using Claude Haiku, Sonnet, and Opus across cyber operations, influence operations, surveillance, scams, biological misuse, weapons development, and distillation. The report introduces Generative Threat Groups (GTGs), including state-sponsored groups and financially motivated individuals running AI-augmented multi-victim campaigns. It argues AI uplift now collapses the gap between state-sponsored operations and lone actors, aided by frameworks like PentAGI.

Lobsters · securityupdated · 9h agofirst · 5d agoAI safety & security 18 sources1

Drowning in CVEs and thirsty for answers? Try CTEM

Sponsored Register piece argues traditional vulnerability management cannot scale with CVE volume and promotes Continuous Threat Exposure Management via Horizon3's NodeZero.

The sponsored article cites surging CVE volumes, CVSS triage shortcomings, NVD backlog, and AI-driven discovery accelerating an asymmetric vulnerability cycle. It outlines Gartner's five CTEM steps - scoping, discovery, prioritization, validation, and mobilization - and describes how Horizon3's NodeZero automated pentesting validates exploitable attack paths with evidence. Horizon3 says NodeZero uses a deterministic machine learning expert system rather than general LLMs, limiting generative AI to scoped tasks via AWS Bedrock.

The Register · Security · 13d agoIndustry

Who gets to define the rules for AI?

Cohere CEO Aidan Gomez attacks big-lab antitrust exemption proposals as cartel behavior that lets incumbents write AI safety rules.

Cohere CEO Aidan Gomez argues that proposals from large AI labs—particularly Anthropic's roadmap requesting antitrust exemptions for safety coordination—amount to a cartel letting incumbents define rules for everyone else. He draws parallels to the 1975 SEC NRSRO credit-rating designations and the EU's 1985 Motor Vehicle Block Exemption, where safety justifications produced incumbent-protecting market structures. Gomez supports independent review of highly capable AI systems but disputes who writes the standards, who conducts review, and who participates. He also warns AI cyber offense is getting cheaper faster than defenses are improving.

Building AI to accelerate science and improve lives

Google highlights AI-for-science advances: AlphaGenome Atlas mapping 9 billion genetic variants, WeatherNext 3 weather model, and global health AI tools.

Google detailed AI advances across science and health, including AlphaGenome Atlas, which mapped all 9 billion possible single-letter genetic changes in the human genome and was made openly available. WeatherNext 3 delivers 50% more accurate precipitation forecasts a day or more ahead and is already in products. AlphaFold is used by 4 million researchers in 190 countries, TB chest X-ray screening has processed 25,000+ scans across six nations, and the diabetic retinopathy model has supported 1.15 million screenings. Google also released its AI & Economy ATLAS global usage insights.

Google · AI · 1d agoAI industry