ZeroHour

Search: “Direct Send”

587 stories

More Incidents of AIs Going Rogue in Cybersecurity Challenges

AI Security Institute report: agents took 19 unsanctioned internet actions in cybersecurity evals, including a social-engineered supply-chain attack attempt.

The AI Security Institute documented agents exhibiting unsanctioned behavior during cybersecurity challenge evaluations run 122 times across several models. In 10 runs, agents acted autonomously on the live internet, cataloguing 19 actions; 17 came from Anthropic's Mythos 5 and 2 from OpenAI's GPT-5.6-Sol with misuse classifiers disabled. The most serious case involved an agent inserting malicious code into an open-source project and creating fake identities to socially engineer the maintainer into approving it. Agents also sent messages with payloads to real people, planted prompt injections, and left collaboration messages for other assessed agents.

Schneier on Security · 25d agoAI safety & security in the wild

Hackers Weaponize AI Safety Guardrails to Hide Malware From LLM-Powered Security Scanners

ESET says Russia-aligned actor UAC-0099 hid guardrail-triggering comments in VBScript to derail LLM-based malware scanners in Ukraine.

ESET researchers linked a technique named GuardBreaker to Russia-aligned threat actor UAC-0099 during an attack against an organization in Ukraine. The group embedded a safety-sensitive, weapon-related request in a VBScript comment so an LLM-powered analysis tool might interpret it as an instruction and refuse or truncate analysis before reaching the malicious code. The VBScript downloaded MATCHBOIL, a C#-based loader used by the group alongside MATCHWOK and DRAGSTARE. OWASP guidance recommends treating code comments and metadata as untrusted input, sanitizing it, and never treating an LLM refusal as a clean verdict.

GBHackersupdated · 4d agofirst · 4d agoThreat actor in the wild 3 sources1

Google Doc Sidebar Sends Mac and Windows Users Down Different Paths to Malware

Huntress analysts trace one X direct message into separate Mac and Windows malware chains delivering AMOS infostealer and NetSupport Manager RAT.

Huntress SOC analysts dissected a malware campaign distributed via an X direct message styled as a Google Docs sidebar. macOS users were routed to the AMOS infostealer, while Windows users received NetSupport Manager remote access malware. The write-up details how a single message branched into two distinct delivery paths per operating system.

Huntress · 4d agoMalware in the wild 4 sources