4-bit rounding error, not bit width, shifts chat-model refusal
Qwen2.5-3B continues harmful replies more often, while Llama-3.2-3B complies 10.3 points less on held-out jailbreaks.
1 stories, newest first · one card per story
Qwen2.5-3B continues harmful replies more often, while Llama-3.2-3B complies 10.3 points less on held-out jailbreaks.
Today 2.4K readers · 2.6K views · 142 reads · all time 206K views