Deployed multi-agent system finds and repairs documentation drift
Original title: Mind the Gap: A Deployed Multi-Agent System for Documentation Maintenance
In 43 shadow-mode days, TriAgent triaged 499 tickets and judges called 81.1% of verifiable assertions correct.
Authors deployed a multi-agent documentation system built around a triage agent named TriAgent. It extracts signals from resolved support tickets and code-documentation mismatches, then turns reviewed insights into documentation fixes. LLM judges from independent model families scored 245 of 302 assertions correct. After a repair, blinded judges preferred the agent's re-answer 71.4% of the time on 35 tickets.
Unconfirmed: Correctness and preference rates come from the authors' judge panel, not an independent replication.
- The panel preferred TriAgent on 70.5% of length-comparable pairs and humans on 23.2%.
- Human and agent replies were often complementary rather than duplicates.
- A blinded human audit reported strong alignment on self-improvement.
- Each reviewed human insight becomes a documented gap and then a fix.
From the original article
1 min read at arxiv.orgThe "AI revolution" has enabled teams across the technology industry to deliver software features at unprecedented velocity. While code evolves faster than ever, customer-facing documentation often struggles to stay up to speed.
By Lorenzo Masoero · arxiv.org
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.