Prediction-Powered Smoothing and Validation for Disaggregated AI Evaluation
Researchers propose prediction-powered smoothing (PP-S/PP-TS), Bayesian small-area estimators that improve disaggregated AI evaluation accuracy and validation.
Stories per day · 30 days
2 stories, newest first · one card per story
Stories tagged #small-area-estimation
Prediction-Powered Smoothing and Validation for Disaggregated AI Evaluation
Paper proposes prediction-powered smoothing (PP-S/PP-TS) and a design-based cross-validation score to improve disaggregated AI evaluation estimates when labeled data is scarce.