Rationale contrastive decoding reduces CoT query shortcuts
The training-free method improved answer accuracy on five reasoning benchmarks and made answers depend more on the rationale.
Stories per day · 30 days
Relatedhuginn2loopcd2looped-transformers2ouro2chain-of-thought1decoding1efficiency1inference1inference-efficiency1large-language-models1reasoning1
3 stories, newest first · one card per story
Stories tagged #contrastive-decoding
Decoding Looped Transformers Better for (Almost) Free
Training-free LoopCD improves looped Transformer decoding and can cut recurrent compute by up to 48%.
Decoding Looped Transformers Better for (Almost) Free
LoopCD uses earlier recurrent states for contrastive decoding, boosting looped Transformers while cutting inference FLOPs.