One KV-cache bit flip turns correct LLM answers wrong
On Qwen3-8B in vLLM, mantissa or sign flips made correct TriviaQA answers wrong about 0.59 to 0.60 of the time, versus about 0.02 on MBPP+.
1 stories, newest first · one card per story
On Qwen3-8B in vLLM, mantissa or sign flips made correct TriviaQA answers wrong about 0.59 to 0.60 of the time, versus about 0.02 on MBPP+.
Today 2.4K readers · 2.6K views · 142 reads · all time 206K views