CyberBinGym tests AI agents exploiting binary patch diffs
The strongest agent recovered the flaw in 88 percent of 100 tasks and produced a working exploit in 20 percent.
6 stories, newest first · one card per story
The strongest agent recovered the flaw in 88 percent of 100 tasks and produced a working exploit in 20 percent.
AI attack and repair performance varies sharply on nonpublic vulnerabilities, and one fix often fails later tests.

Anthropic says open-weight GLM-5.3 nearly matches Claude Mythos Preview at building software exploits.

Anthropic finds Zhipu's open-weight GLM-5.3 autonomously builds end-to-end exploits and its safeguards can be bypassed 64-100% of the time.
AI agents are killing security through obscurity, accelerating vulnerability discovery and patch-gap exploitation, experts warn, with OT/ICS systems most at risk.

Echo's analysis found only 1,900 of 23,019 Claude Mythos-found vulnerabilities were externally reviewed, 90.8% held up, but the model overstated most severities.
Today 1.5K readers · 2.4K views · 754 reads · all time 189K views