ZeroHour

Search: “firefox”

2 stories in the last 30d

Most of the bugs Claude Mythos found have never been checked by a human

Echo's analysis found only 1,900 of 23,019 Claude Mythos-found vulnerabilities were externally reviewed, 90.8% held up, but the model overstated most severities.

Echo analyzed results from Anthropic's Claude Mythos Preview vulnerability sweep across 281 open-source projects, which produced 23,019 candidate vulnerabilities, of which only 1,900 were externally reviewed. Of those, 90.8% held up as real, 1,451 of 1,596 maintainer reports were acknowledged, 97 fixes landed upstream, and 88 became advisories, but 14 of the 27 CVE-assigned severity ratings mismatched independent scoring, mostly overstated. On Anthropic's SpiderMonkey benchmark, Claude Mythos turned known crashes into working code execution exploits in 72.4% of 250 trials, versus below 1% for Claude Opus 4.6. Echo cautions the reviewed sample likely was not randomly drawn, so the accuracy figure may not generalize to the other 21,119 unreviewed candidates.

Help Net Security · 13d agoAI research

Import AI 470: No rights for machines; automating environment generation with SPADE; and building better GPU kernels with Hawkeye

METR analysis finds AI accelerating cyber vulnerability discovery, while SPADE self-play environment generation improves Qwen3 reasoning benchmark scores at 30B scale.

Import AI 470 discusses a METR research note reporting differential acceleration from AI: major acceleration in reported cyber vulnerabilities (cURL, OpenSSL, Firefox, Microsoft, NVD, OSV), minor acceleration in mathematics, and no measurable acceleration in AI-research optimization benchmarks. It also covers SPADE, a self-play framework from a multi-university team (University of Washington, Stanford, MIT, CMU, and others) that co-evolves executable training environments and agent capability using Environment Designer and Reasoning Agent roles with hint-based regret rewards. Trained on Qwen3-4B-Instruct-2507, Qwen3-8B, and Qwen3-30B-A3B-Instruct-2507 via GRPO (400 rollouts of 25 environments), SPADE lifted the 30B-A3B game-environment suite average to 58.3, +8.1 over base, and improved tool-use results across backbones. The issue also references Hawkeye for building better GPU kernels.

Import AI · 24d agoAI research1