T2Quant allocates precision by task and timestep in diffusion LMs
On three diffusion language models and six benchmarks, the method raises average accuracy by up to 6.7 points at a fixed bit budget.
Stories per day · 30 days
Relatedquantization2diffusion1diffusion-language-models1drunet1model-compression1post-training-quantization1t2quant1
2 stories, newest first · one card per story
Stories tagged #mixed-precision
Layerwise Error Attribution for Fast and Robust Mixed-Precision Post-Training Quantization
Layerwise error scores speed mixed-precision quantization up to 2,570x and resist corrupted calibration data.