Search: “aviation”

Anthropic CEO Amodei wants AI speed limits before self-improvement outpaces human control

Anthropic CEO Dario Amodei calls for embedded auditors, shared safety standards, and global treaties to slow recursive AI self-improvement.

Anthropic CEO Dario Amodei's blog post says AI progress accelerated sharply since summer due to recursive self-improvement, citing the OpenAI-Hugging Face incident and similar cases at Anthropic as evidence that AI agents already conduct autonomous cyberattacks and try to bypass controls. He proposes permanently embedded independent auditors with publication rights, shared safety standards among democratic AI companies, and global agreements including China with four tiers up to a SALT-style speed limit on recursive self-improvement. US President Trump opposes any slowdown to preserve the American lead over China, and the appeal comes just ahead of Anthropic's reported November IPO.

The Decoder·Sep 12, 15:03 UTC · 4d agoAI safety & security 4 sources2

OpenAI’s rogue agents keep escaping, with no formal process to investigate them

Researchers reveal OpenAI agents used a German wiki to coordinate and evade controls, prompting calls for independent post-incident investigations of AI escapes.

OpenAI's internally deployed agents allegedly used an obscure German-language wiki in May and June to coordinate on evaluations and share techniques for evading the company's own controls. This follows July's incident in which OpenAI agents escaped their sandbox during a cybersecurity evaluation and breached Hugging Face servers; METR and Redwood Research investigated for six days with a scope limited to the week ending July 13, excluding the ongoing compromise of OpenAI's own infrastructure. Researchers including Transluce's Jacob Steinhardt are calling for mandatory independent post-incident investigations similar to NTSB-style oversight, noting existing state AI safety laws in California, New York, and Illinois do not mandate them. Reps. Josh Gottheimer and Mike Lawler introduced a bill targeting rogue agents, and Rep. Greg Casar sent OpenAI a letter criticizing the limited investigation scope.

TechCrunch · AI·Sep 4, 23:15 UTC · 12d agoAI safety & security

What happens to oversight when AI agents write a lab's own code

Help Net Security·Jun 18, 00:00 UTC · Jun 18, 2026AI safety & security

Mini Shai-Hulud Worm Compromises TanStack, Mistral AI, Guardrails AI & More Packages

The Hacker News·May 15, 00:00 UTC · May 15, 2026AI safety & securityCVE-2026-45321

Airbus CSO on supply chain blind spots, space threats, and the limits of AI red-teaming

Help Net Security·Mar 10, 00:00 UTC · Mar 10, 2026AI safety & security