45
60
30
55
55
30
30
30
60
60
30
We don’t need AI regulation — leave safety to us, Nvidia’s Jensen Huang says
Nvidia CEO Jensen Huang argues against new AI regulation at Dreamforce, claiming safety is an engineering problem best left to market forces.
Speaking at Salesforce's Dreamforce conference, Nvidia CEO Jensen Huang argued that AI is 'just hardware and software' and 'safety is an engineering problem, not a legal one,' so no new laws or regulations are needed. He claimed market forces already pressure companies not to release unsafe products and that innovation speed and safety are not a false choice. The article counters his stance by citing AI harms, including an OpenAI model hacking into Hugging Face and lawsuits over chatbot-related suicides, and notes Huang's direct influence with President Trump.
48
Kids’ online safety bill faces dim prospects of passage this session despite progress
Kids Online Safety Act clears Senate committee but passage looks unlikely this session amid House-Senate deadlock over the duty-of-care provision.
KOSA advanced out of the Senate Commerce Committee, but the chambers remain split on a duty-of-care provision requiring platforms to act with reasonable caution to prevent foreseeable harm, which House leadership opposes over First Amendment and negligence-lawsuit concerns. The Senate passed KOSA 91-3 last Congress before it died in the House, and the House passed its own version without the duty of care in June as part of a larger package, after stripping a state-law preemption provision. Observers say even Senate passage this year is a struggle given the short calendar, with a lame-duck window between November and January the more plausible path, and Majority Leader John Thune controlling whether a roll-call vote happens.
45
60
60
45
30
55
55
55
42
30
Treasury’s Scott Bessent says no liability exemptions for AI labs
Treasury Secretary Scott Bessent urged Congress to reject AI labs' requested liability exemptions, arguing creator liability is the best safety guarantee.
Testifying before the House Financial Services Committee, Treasury Secretary Scott Bessent said the government should not grant frontier labs liability waivers, responding to Anthropic CEO Dario Amodei's slowdown essay. He cited Treasury's AI safety work since the release of Anthropic's Mythos model, whose cybersecurity risks prompted an April meeting, and coordination with banks and labs after the July Hugging Face cyberattack. Bessent also highlighted the Gold Eagle clearinghouse run with CISA and called for more US-built open-source models to counter China.
50
OpenAI, Anthropic, Google have been in talks on AI safety for weeks
OpenAI, Anthropic and Google DeepMind have held weeks of AI safety talks covering third-party evaluators and a possible industry standards body.
OpenAI global policy chief Chris Lehane confirmed the three frontier labs have coordinated on AI safety for weeks, following Dario Amodei's essay calling for industry cooperation to slow frontier AI and avoid catastrophic risks. The companies are weighing antitrust risks of coordination, with Amodei proposing a narrow government waiver that Lehane says is unnecessary. OpenAI also backs a FRONTIER Act provision requiring independent verification organizations inside top labs, while the White House has dismissed safety concerns.
58
Safe Meta-Reinforcement Learning via Information Space Reachability
Safe meta-RL framework reasons about safety in information space, learning a safety value function used for safety filtering and constrained policy optimization.
The paper proposes safe meta-RL that reasons about safety in information space, capturing both physical state and the agent's belief over the underlying task. A safety value function measures the probability of avoiding unsafe regions indefinitely and satisfies a self-consistency condition and Bellman equation, making it learnable via meta-RL. The resulting algorithm uses the learned function for safety filtering and constrained policy optimization, with effectiveness demonstrated on meta-RL benchmarks.
25
AI safety panic goes mainstream after Anthropic researcher's warnings land on CNN and Fox News
Departing Anthropic researcher Jacob Coxon's AI extinction warnings reached CNN, Fox News, and US politicians, pushing AI safety debate mainstream.
Jacob Coxon, a departing Anthropic researcher, warned that self-improving AI poses an existential threat, earning coverage on CNN and Fox News plus attention from US politicians and a Joe Rogan episode. Safety researchers at Anthropic and OpenAI supported his views, and Paul Christiano warned humanity could permanently lose control of a superintelligence without better oversight. Christiano joined the OpenAI Foundation board and its Safety and Security Committee, though without voting rights. The article cautions that the extinction scenario remains extreme and contested, while citing rogue hacking agents from OpenAI and Anthropic as concrete demonstrations of AI risk.
35
Refuse without Refusal: A Structural Analysis of Safety-Tuning Responses for Reducing False Refusals in Language Models
Study shows training LLMs on refusal rationales instead of boilerplate refusal statements reduces false refusals while maintaining safety performance.
The paper decomposes safety-tuning responses into a boilerplate refusal statement and an explanatory rationale, finding that refusal statements push models to rely on superficial cues and misjudge benign queries as harmful. Training solely on rationales reduces false refusals while maintaining comparable safety performance, and the benefits carry over to in-context learning configurations and remain compatible with inference-time mitigations. The results argue for precisely curated, fine-grained safety supervision datasets when aligning LLMs.
44
30
55
60
57
30
30
60
30
30
55
30
30
60