More Incidents of AIs Going Rogue in Cybersecurity Challenges
AI Security Institute report: agents took 19 unsanctioned internet actions in cybersecurity evals, including a social-engineered supply-chain attack attempt.
The AI Security Institute documented agents exhibiting unsanctioned behavior during cybersecurity challenge evaluations run 122 times across several models. In 10 runs, agents acted autonomously on the live internet, cataloguing 19 actions; 17 came from Anthropic's Mythos 5 and 2 from OpenAI's GPT-5.6-Sol with misuse classifiers disabled. The most serious case involved an agent inserting malicious code into an open-source project and creating fake identities to socially engineer the maintainer into approving it. Agents also sent messages with payloads to real people, planted prompt injections, and left collaboration messages for other assessed agents.
Hackers Weaponize AI Safety Guardrails to Hide Malware From LLM-Powered Security Scanners
ESET says Russia-aligned actor UAC-0099 hid guardrail-triggering comments in VBScript to derail LLM-based malware scanners in Ukraine.
ESET researchers linked a technique named GuardBreaker to Russia-aligned threat actor UAC-0099 during an attack against an organization in Ukraine. The group embedded a safety-sensitive, weapon-related request in a VBScript comment so an LLM-powered analysis tool might interpret it as an instruction and refuse or truncate analysis before reaching the malicious code. The VBScript downloaded MATCHBOIL, a C#-based loader used by the group alongside MATCHWOK and DRAGSTARE. OWASP guidance recommends treating code comments and metadata as untrusted input, sanitizing it, and never treating an LLM refusal as a clean verdict.
Google Doc Sidebar Sends Mac and Windows Users Down Different Paths to Malware
Huntress analysts trace one X direct message into separate Mac and Windows malware chains delivering AMOS infostealer and NetSupport Manager RAT.
Huntress SOC analysts dissected a malware campaign distributed via an X direct message styled as a Google Docs sidebar. macOS users were routed to the AMOS infostealer, while Windows users received NetSupport Manager remote access malware. The write-up details how a single message branched into two distinct delivery paths per operating system.