SparseDecoding: Decoding-Aware Pruning for Accurate and Efficient LLM Inference
SparseDecoding prunes LLMs using decoding activations, speeding generation up to 1.48x.
52
SparseDecoding prunes LLMs using decoding activations, speeding generation up to 1.48x.
Today 248 readers · 264 views · 66 reads · all time 199K views