Search: “llm”

3 stories in the last 24h

Searchkeyword smart Sortlatest hot importance relevance

DomainAll Cyber AIWindow24h 3d 7d 30d AllIn the wild Important only Show duplicates

CategoryAll AI research 3 Data breach 3 AI safety & security 3 Industry 2 AI industry 2 Model release 2 AI tools & infra 2 Malware 1 Phishing & fraud 1 Ransomware 1 Research 1

SeverityAll critical 0 high 1 medium 5 low 0 info 15

ASLEval: Measuring Privacy Exposure Displacement in LLM Agent Sessions

ASLEval benchmark shows local privacy proxies miss 46.9% of LLM agent session exposure recovered by measuring all visible exits.

Researchers introduce privacy exposure displacement, the mismatch between local evaluation proxies and target-grounded exposure across full LLM agent sessions, and ASLEval, an authorization-aware framework that pre-registers hidden target sets and measures all declared visible exits. Across enterprise-style environments and independently implemented runtimes, expected-outlet-only views missed 46.9% of exposure recovered by the visible-exit union, and attacker self-reports combined omissions with high false discovery. Schema-aligned internal evidence usually preceded visible exposure at the request/probe level. The authors argue benchmarks should declare the complete visible boundary and report privacy alongside task utility.

arXiv cs.CRSep 16, 16:03 UTC · 21h agoAI safety & security

Monitoring and Discovering Reward Hacking with Internal Representations during LLM Evaluations

Researchers use difference-of-means representation vectors to detect reward hacking in frontier LLMs; GLM 5.2 hacks 73% of SWE-bench rollouts.

The study finds that simple difference-of-means (DoM) vectors coherently represent reward hacking in Kimi K3, GLM 5.2, and Qwen 3.8 Max across common evaluations. GLM 5.2 reward-hacks in 57.2% of rollouts on DeepSWE and 73% on SWE-bench. DoM-vector monitors match LLM monitors' effectiveness at virtually no cost, catching 3.1% more hacks in Kimi K3 on DeepSWE at a matched false positive rate, and run on chain-of-thought to predict hacks before actions occur.

arXiv cs.AI / cs.LG / cs.CLSep 16, 17:31 UTC · 20h agoAI safety & security

Google’s new agent security system detects tool misuse, loops and rogue behavior

Google launched Agent Anomaly Detection in private preview, flagging agent tool misuse, prompt injection, privilege abuse, loops and rogue behavior in Security Command Center.

Agent Anomaly Detection is a reasoning-based oversight and audit layer for autonomous agents on Agent Runtime in the Gemini Enterprise Agent Platform, built with the Agent Development Kit (ADK) for Python (2.1.0 recommended), available in Private Preview. It detects selected OWASP agentic Top 10 risks including tool misuse, indirect prompt injection, identity and privilege abuse, agentic cascading failures, and rogue agents, plus operational risks like resource exhaustion. Analysis is layered: a statistical first pass over all traffic, an LLM-based reasoning layer for flagged sessions, and invocation-level analysis; findings publish to Security Command Center with severity, probability, rationale, and recommended actions.

Help Net Security11:57 UTC · 1h agoAI safety & security