Skip to content
NewA calmer, faster ZeroHour

The Decomposition Tax: LLM Pipelines Lose Up to 40 Accuracy Points at Their Own Interfaces

arXiv cs.AI / cs.LG / cs.CLby Tianqi Bu ()1 min read2 · 1 read
AI summary · grok-4.7Summaries by Vani AI

LLM pipelines lose up to 40.5 accuracy points at stage interfaces; re-grounding after the loss helps.

The authors define a decomposition tax: the accuracy lost when stages of a fixed LLM pipeline can no longer see the original problem. Across 21 open-weight models on GSM-Hard and MATH-500, the largest primary-family drop is 40.5 points for gemma-3-12B on MATH-500, and gemma-4-12B still loses 37.0 points. They find re-grounding the stage after a lossy interface outperforms repairing the stage before it, and that quantity-listing stages should be told to retain relationships.

Key facts
  • A four-stage pipeline loses up to 40.5 points at its interfaces.
  • Largest drop is gemma-3-12B on MATH-500; gemma-4-12B still loses 37.0.
  • Tests cover 21 open-weight models on GSM-Hard and MATH-500.
  • Re-ground the stage after a lossy interface, and keep stated relationships.
Explain this AI news with Vani AIWhat was announced, what is new and why it matters, in a new chat

From the original article

1 min read at arxiv.org

A four-stage LLM pipeline gives up as much as 40. 5 accuracy points at its own interfaces (gemma-3-12B on MATH-500, Holm-corrected p = 1. 66e-19; the largest tax in the primary family).

arXiv cs.AI / cs.LG / cs.CL

By Tianqi Bu · arxiv.org

Read the full article at arXiv cs.AI / cs.LG / cs.CL

A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.