Web-agent harnesses stay vulnerable across prompt and page attacks
WebTrap Farm separates defensive failures from task limits and finds harness design, not only the model, shapes outcomes.
16 stories, newest first · one card per story
WebTrap Farm separates defensive failures from task limits and finds harness design, not only the model, shapes outcomes.
Baya achieves 0% attack success on WASP benchmark compared to 25.5% for browser-only ReAct.
ANGLER near-miss-guided framework boosts end-to-end attack success on web agents to 20.36% while lowering benign task success from 61.9% to 44.4%.
On leading LLM backbones, average task success falls from 89.4% to 43.7% when non-transient barriers block the primary path.
Fine-tuning Qwen3.5-9B on 5,856 trajectories lifts WebArena-Verified overall success by 13.33 points.
The framework beats harness-only and model-only adaptation on within-domain and cross-domain workflow shifts.
DeepSeek Flash and Pro keep most source programs under replay tests, while panel errors track failed deliveries.
The best of 12 frontier models scores 39.0%; humans score 21.1% across 1,000 attempts.
On 1,091 attacked pages, 12.8% of injections reached the planner versus 73.1% for a conventional planner.
WebShell unifies search, browsing, and evidence reuse so LLM agents can complete long web tasks more cheaply.
WebFovea placed second in WebRetriever 2026 after harness fixes lifted its score from 31.0 to 57.0.
AdvSim2Real co-trains a 4B web agent against adaptive prompt injection, lifting completion 33.6% under an unseen adversary.
CLIFT turns judge feedback into conformal self-verification for web-agent training and judge-free test-time trajectory selection.
CLIFT turns judge feedback into reusable rewards and judge-free test-time selection for web agents.
HyperBrowseComp stress-tests web agents with 423 hard multilingual, multimodal questions needing obscure public evidence.
RiskChainBench benchmark evaluates models restoring obfuscated abuse messages and investigating risky websites, revealing execution failures as the main bottleneck.
Today 1.5K readers · 2.4K views · 754 reads · all time 189K views