Searching for "Harmful Refusal": A Psychometric Audit of an AI Safety Benchmark
A psychometric audit finds HarmBench and HELM Safety do not isolate a single harmful-refusal attribute.
48
A psychometric audit finds HarmBench and HELM Safety do not isolate a single harmful-refusal attribute.
Safety-router benchmarks overstate routing gains by picking the best model on test data.
Today 1.2K readers · 1.8K views · 1.4K reads · all time 160K views