6-bit Qwen3 weights plus order averaging beat extra bits
Four cyclic answer orders recover 12.6 points at 4 bits on Qwen3-0.6B, versus 5.3 points at fp16.
1 stories, newest first · one card per story
Four cyclic answer orders recover 12.6 points at 4 bits on Qwen3-0.6B, versus 5.3 points at fp16.
Today 121 readers · 129 views · 26 reads · all time 199K views