MACaQ quantizes weights and activations to MXFP4 layer by layer
On Qwen3-32B in vLLM it adds 2.3% overhead, and a 122B model was quantized in 64 minutes using 32.5GB GPU RAM.
Stories per day · 30 days
1 stories, newest first · one card per story
Stories tagged #mxfp4