Agents That Edit Documents: Measuring Agentic PDF Forgery Against a Non-Agentic Control
AI agents can forge financial documents with high success rates and low costs, though the threat is overestimated by a factor of two.
A study on AI agents forging documents shows agents can alter financial documents like invoices, achieving high forgery success rates and low costs, though the threat is overestimated by a factor of two.
- AI agents can forge financial documents by editing amounts, dates, and addresses
- 1,419 out of 1,750 agent-forgery tests pass the verifier
- 808 out of 1,250 tests survive stricter filters
- deterministic scripts achieve 98% forgery success
- agents achieve 124% forgery success
- cost of verified forgery is 2.4 cents
Full article189 words · extracted from arxiv.org · click to collapse
AI agents that carry a multi-step computer task through on their own became ordinary tools in the past year, and the same autonomy is available to anyone whose task is harmful. We ask what that means for a relying party -- an insurer, a lender, an auditor -- whose evidence is a filed PDF. AgentForge-Bench measures how reliably an off-the-shelf coding agent, driving one of seven open-weight models with a shell and the stock Python PDF stack, alters one dollar amount, date or address in a real filed financial document from a single sentence of intent, graded by rules rather than by a model. Across 1,750 cells, 1,419 (81.1%) satisfy the verifier, and 808 (46.2%) also survive every stricter filter: visible, localized, typeface-matched, original value gone document-wide. A deterministic script with no model in it solves 98 of the 125 documents; the agents solve 124, and none the script solves alone. Agents misreport 41% of their wrong edits as done, no model refused, and the cheapest verified forgery costs 2.4 cents. The raw rate overstates the threat by about a factor of two; the strict rate is still large.
Text extracted automatically; images, tables and formatting may be missing. Original: https://arxiv.org/abs/2609.23953