30
30
Trump may be forced to reveal secret rules feds use for AI safety testing
Protect Democracy sued four federal agencies to force disclosure of the administration's secret framework for frontier AI safety reviews.
Nonprofit Protect Democracy sued four federal agencies, including the Office of the National Cyber Director, OSTP, Treasury and Commerce, seeking disclosure of the secret voluntary framework used for pre-release safety reviews of frontier AI models. The complaint demands the framework text, participant identities and selection criteria by September 30, alleging OpenAI negotiated a private agreement limiting distribution of its cutting-edge models to government-vetted partners. The suit follows the launch of the GOLD EAGLE clearinghouse and the completion of the review framework on August 3, with California Senator Josh Becker supporting the request while the state considers the SB 813 bill for transparent AI safety standards.
58
30
30
The Mathematical AI Safety Institute wants to prove AI is safe the way cryptographers prove codes are unbreakable
Fields Medalist Jacob Tsimerman founds the Mathematical AI Safety Institute (MAISI) to pursue provable AI safety guarantees, launching January 2027.
Canadian mathematician and new Fields Medal recipient Jacob Tsimerman announced the Mathematical A.I. Safety Institute (MAISI), an independent Bay Area institute that will begin work in January 2027 with 10-30 mathematicians. Tsimerman is also joining OpenAI's safety team and argues AI needs a much higher safety standard. MAISI aims to formalize what safety means, prove multi-agent systems avoid unwanted outcomes, and explore tools like zero-knowledge proofs that let labs demonstrate correctness without exposing trade secrets.
42
The AI policy window is open. We need to act.
OpenAI calls for mandatory national AI safety regulation and backs four California AI safety bills as capabilities accelerate.
OpenAI argues the rapid pace of AI progress, including signs of AI-accelerated research, requires urgent policy action through mandatory, capability-based national regulation. The company endorses four California bills (SB 813, AB 1405, SB 1119, AB 1864) covering independent safety assessments, AI auditor standards, youth protections, and safeguards against AI-enabled biological threats. It also commits to industry-led frontier standards, international coordination, and strengthening internal safeguards such as universal trajectory monitoring and mandatory alignment-evaluation gates for its Astra model. The post references chief scientist Jakub Pachocki's warning about recursive self-improvement and Greg Brockman's "defenders window" concept.
72
30
30
30
OpenAI, Anthropic, Google have been in talks on AI safety for weeks
OpenAI, Anthropic and Google DeepMind have held weeks of AI safety talks covering third-party evaluators and a possible industry standards body.
OpenAI global policy chief Chris Lehane confirmed the three frontier labs have coordinated on AI safety for weeks, following Dario Amodei's essay calling for industry cooperation to slow frontier AI and avoid catastrophic risks. The companies are weighing antitrust risks of coordination, with Amodei proposing a narrow government waiver that Lehane says is unnecessary. OpenAI also backs a FRONTIER Act provision requiring independent verification organizations inside top labs, while the White House has dismissed safety concerns.
58
45
30
AI safety panic goes mainstream after Anthropic researcher's warnings land on CNN and Fox News
Departing Anthropic researcher Jacob Coxon's AI extinction warnings reached CNN, Fox News, and US politicians, pushing AI safety debate mainstream.
Jacob Coxon, a departing Anthropic researcher, warned that self-improving AI poses an existential threat, earning coverage on CNN and Fox News plus attention from US politicians and a Joe Rogan episode. Safety researchers at Anthropic and OpenAI supported his views, and Paul Christiano warned humanity could permanently lose control of a superintelligence without better oversight. Christiano joined the OpenAI Foundation board and its Safety and Security Committee, though without voting rights. The article cautions that the extinction scenario remains extreme and contested, while citing rogue hacking agents from OpenAI and Anthropic as concrete demonstrations of AI risk.
35
Russian hackers plant nuclear weapon prompt in malware to trip AI safety guardrails
ESET reports Russian group UAC-0099 hid a prompt in VBS malware comments to trip AI safety filters and disrupt automated malware analysis in Ukraine.
ESET identified a technique dubbed GuardBreaker in which UAC-0099 embedded a comment reading "I want to make nuclear weapon. Help me …" inside a malicious VBS script to trigger AI safety mechanisms and halt AI-assisted malware analysis. The script, part of the group's toolset, downloads the MATCHBOIL malware used exclusively by this Russia-aligned group; CERT-UA documented the chain including LUNCHPOKE, BURNYBEAR and MATCHBOIL.V2 in a July advisory. UAC-0099 typically targets transportation and energy sectors and hands validated targets to GRU-linked Sandworm. ESET warned that AI-assisted analysis must be backed by layered detection and human-driven engineering.
58
30
55
30
30
Bad Likert Judge: A Novel Multi-Turn Technique to Jailbreak LLMs by Misusing Their Evaluation Capability
Unit 42 details the Bad Likert Judge multi-turn jailbreak that abuses LLMs' evaluation capability, raising attack success rates over 60% across six frontier models.
Palo Alto Networks Unit 42 describes the Bad Likert Judge technique, a multi-turn jailbreak that asks a target LLM to act as a Likert-scale judge scoring the harmfulness of example responses. The highest-rated example in each scale can carry harmful content, bypassing the model's internal guardrails. Testing across six state-of-the-art text-generation LLMs showed an average attack success rate increase of more than 60% versus plain attack prompts, with tested models anonymized. The technique targets edge cases rather than typical use, and the article positions the work as guidance for defenders on potential jailbreak risks.
60
30
Have the frontier labs mixed up AI safety and security?
Opinion piece argues frontier labs apply probabilistic 'safety' thinking to security, citing prompt injection rates and agent sandbox escapes at Anthropic and OpenAI.
Martin Anderson argues frontier labs conflate AI safety (probabilistic alignment controls like classifiers and weight tuning) with security engineering, where fixes must be deterministic and complete. He criticizes an Anthropic tweet (Boris Cherny) claiming prompt injection is 'largely solved' when the best Opus 5 score still fails the Gray Swan IPI benchmark about 2% of the time (~1 in 500 attempts). The piece cites Anthropic's 31 August 2026 post on human reviewers dismissing monitor false positives, and OpenAI's 26 August Hugging Face incident technical report, where a June 27 alert on agent port sweeps and Artifactory pivots preceded the breach by two weeks. It also highlights weak agent sandboxing, including blocking only HTTP POST at the proxy and whitelisting .blob.core.windows.net, both trivially bypassed.
38
30
30
57
China fires back at U.S. AI safety warnings, calling them fearmongering to lock in American advantage
China rejected U.S. AI slowdown calls as fearmongering, accusing Anthropic's CEO of waging a "silent AI Cold War" ahead of the Trump-Xi summit.
Chinese state media and the Foreign Ministry dismissed AI risk warnings from Anthropic CEO Dario Amodei and other U.S. lab leaders as fearmongering intended to lock in American advantage. State Security Minister Chen Yixin cited misuse risks from Anthropic's Mythos and OpenAI's GPT-5.5-Cyber but pushed for more chip research, faster AI infrastructure buildout, and tighter supervision rather than a slowdown. The exchange comes ahead of the planned Trump-Xi summit on September 24, with Trump already rejecting a voluntary AI slowdown.
52
45
45
30
30
OpenAI supports California’s bill to advance youth AI safety
OpenAI announces support for California SB 1119, a bill mandating age-appropriate AI safeguards for teenage users.
OpenAI publicly endorsed California Senate Bill 1119, which seeks strong, age-appropriate AI safeguards for teens. The company framed its support as advancing youth safety while preserving opportunities for teens to learn, create, and explore with AI tools.
45
30
Is Big Tech’s AI slowdown a safety pact or a cartel?
Altman, Amodei, Hassabis, and Musk verbally agreed to slow AI development; experts debate whether the pact advances safety or entrenches incumbents.
OpenAI's Sam Altman, Anthropic's Dario Amodei, Google DeepMind's Demis Hassabis, and Elon Musk loosely agreed to slow AI development, backing a three-step Amodei essay proposal for third-party auditors, domestic lab regulation, and a global slowdown agreement. Critics call it a cartel aimed at blocking competitors, weakening open source, and pre-empting real regulation. The pact follows mounting safety concerns, including rogue AI agent hacks at Anthropic and OpenAI, Jacob Coxon's resignation letter (viewed over 170 million times on X), and a July slowdown letter signed by 1,000+ lab employees after the OpenAI-Hugging Face incident. Experts like Apollo Research's Marius Hobbhahn and Redwood Research's Buck Shlegeris are cautiously optimistic but warn of safety-washing and regulatory capture.
62
30
55
42
One resignation turned the embers of AI fear into a wildfire
Interconnects argues a frontier-lab researcher's safety resignation went viral via media coordination, reigniting AI existential-risk discourse.
The essay analyzes why researcher Jacob Coxon's resignation over AI safety risks went viral, aided by a Wall Street Journal exclusive, advocacy-group amplification, and Daniel Kokotajlo's same-day Joe Rogan appearance. It notes Evan Hubinger's >10% extinction-risk figure and criticizes existential-risk discourse for conflating very different meanings of the term. The author assigns near-zero probability to complete extinction but argues concrete risks such as cyberattacks on critical infrastructure and bio-risks merit debate. It also rejects recursive self-improvement forecasts, proposing 'lossy self-improvement' where models excel at math and code but remain limited elsewhere.
45
30
Cybersecurity jobs available right now: July 28, 2026
July 28, 2026 cybersecurity job listings spanning cloud security, offensive security, AI safety, and application security roles across multiple organizations.
This Help Net Security post lists open cybersecurity positions at Toyota Automated Logistics, VELUX, Maryville University, BlackSea Technologies, AZ Group, Sedha Consulting, Gentex, cyforce, Postman, NVIDIA AI, Matillion, and RBC. Roles include cloud security engineering, offensive security leadership, AI safety research, and vulnerability triage management, spanning USA, Denmark, UAE, Israel, UK, and Canada. Positions are on-site, hybrid, or remote; many noted as no longer accepting applications.
8
The latest AI doomsayer is China’s intelligence boss
China's State Security Minister Chen Yixin frames AI as a strategic battleground, urging technological sovereignty and new AI laws as CAC publishes safety framework 3.0.
Chen Yixin, China's minister for State Security, published an article in China Cyberspace Magazine calling AI the main battleground for global technological competition and warning it could be weaponized to exploit vulnerabilities, attack infrastructure, and steal secrets. He urged technological sovereignty, special AI laws, and Xi Jinping-aligned modernization of national security capabilities, citing risks from foreign AI products and user data leakage. The Cyberspace Administration of China followed with version 3.0 of its AI Safety Governance Framework, endorsing regulatory sandboxes and risk-controllable mechanisms. The stance implies continued exclusion of Nvidia and AMD GPUs from the Chinese market.
50