Benign-trained probes miss tool-action errors under adversarial conditions
Scalar uncertainty beat the probe on AUROC and average precision for Qwen2.5-14B-Instruct under system override.
6 stories, newest first · one card per story
Scalar uncertainty beat the probe on AUROC and average precision for Qwen2.5-14B-Instruct under system override.
The guide covers JSON-RPC shapes, deprecated batching, and defenses for tool poisoning, shadowing, and injection.
Research finds 22.9% attack success rate with 2,113 vulnerable cells across 12 frameworks and 45 scenarios.
Across 18 model-server pairs, attack success is 62.64–100%, and defenses still exceed 55% ASR on GitHub MCP with GPT-4o.
ToxicBench finds poisoned tool outputs cut data-agent success 26 to 39 points, with wrong answers adopted after checks.
A measurement study of 179 remote MCP servers finds heavy infrastructure concentration (HHI 0.736) and a security-observability tradeoff in platform OAuth.
Today 1.5K readers · 2.4K views · 754 reads · all time 189K views