Simulated Control Evaluations Predict AI Safeguard Performance
SCEs using language models to simulate environments predict safety with 3.6 percentage point RMSE, outperforming BashArena by explaining 78-85% of variance.
1 stories, newest first · one card per story
SCEs using language models to simulate environments predict safety with 3.6 percentage point RMSE, outperforming BashArena by explaining 78-85% of variance.
Today 1K readers · 1.5K views · 1.1K reads · all time 159K views