SQS: Bayesian DNN Compression through Sparse Quantized Sub-distributions
SQS unifies weight pruning and low-bit quantization via Bayesian variational learning, compressing Llama3.2 and Qwen2.5 at higher rates with comparable accuracy.
1 stories, newest first · one card per story
SQS unifies weight pruning and low-bit quantization via Bayesian variational learning, compressing Llama3.2 and Qwen2.5 at higher rates with comparable accuracy.
Today 1.5K readers · 2.4K views · 757 reads · all time 189K views