Frenos tests show AI attack plans on industrial systems remain uneven
Across 16,980 tests, the top three frontier models produced workable plans about 90% of the time, but only 60% to 74.3% passed every repeat.
2 stories, newest first · one card per story
Across 16,980 tests, the top three frontier models produced workable plans about 90% of the time, but only 60% to 74.3% passed every repeat.
Datadog Security Labs tested Sonnet 5, Composer 2.5, and GPT 5.5 to see if plan mode yields more secure code than default mode.
Today 840 readers · 1.1K views · 843 reads · all time 159K views