Benchmark plants 100 errors in psychology papers to test AI review
The best system found 71 errors and the pooled systems found 93; seven missed errors were all omissions.
Stories per day · 30 days
4 stories, newest first · one card per story
Stories tagged #ensembling
Multi-Epoch Pretraining Scaling Theory Shows Ensembling Benefits
Logit averaging in ensembles reduces late-training overfitting and delays optimal stopping in fixed-data pretraining.
Algorithmic stability via ensembling
Theoretical work derives a general framework quantifying stability guarantees for averaging-based ensembles under arbitrary data perturbations via covariance operator norms.
Unifying Conformal Language Tasks with In-Context Ensembles
Researchers propose Conformal Relevance, which builds conformal score functions via in-context example curation and ensembling to improve conciseness across seven NLP tasks.