The Decomposition Tax: LLM Pipelines Lose Up to 40 Accuracy Points at Their Own Interfaces
LLM pipelines lose up to 40.5 accuracy points at stage interfaces; re-grounding after the loss helps.
The authors define a decomposition tax: the accuracy lost when stages of a fixed LLM pipeline can no longer see the original problem. Across 21 open-weight models on GSM-Hard and MATH-500, the largest primary-family drop is 40.5 points for gemma-3-12B on MATH-500, and gemma-4-12B still loses 37.0 points. They find re-grounding the stage after a lossy interface outperforms repairing the stage before it, and that quantity-listing stages should be told to retain relationships.
- A four-stage pipeline loses up to 40.5 points at its interfaces.
- Largest drop is gemma-3-12B on MATH-500; gemma-4-12B still loses 37.0.
- Tests cover 21 open-weight models on GSM-Hard and MATH-500.
- Re-ground the stage after a lossy interface, and keep stated relationships.
From the original article
1 min read at arxiv.orgA four-stage LLM pipeline gives up as much as 40. 5 accuracy points at its own interfaces (gemma-3-12B on MATH-500, Holm-corrected p = 1. 66e-19; the largest tax in the primary family).
By Tianqi Bu · arxiv.org
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.