
AI auditors detect most agent misbehavior but introduce false alarms
GPT-5 caught 98 percent of reward hacking cases at 5 percent false alarm rate.
1
3 stories, newest first · one card per story

GPT-5 caught 98 percent of reward hacking cases at 5 percent false alarm rate.
PIR reads internal states to separate concealed model knowledge from genuine ignorance across eight language models.
PIR reads internal model states to detect concealed knowledge, distinguishing sandbagging from genuine ignorance across Gemma, Qwen, Llama, Mistral and Phi models.
Today 1.6K readers · 2.5K views · 778 reads · all time 189K views