AfriBED evaluates gender and speaker-type bias in Bemba and Nyanja ASR
The set holds about 9 hours of Bemba and 18 hours of Nyanja from 80 and 127 speakers.
Stories per day · 30 days
2 stories, newest first · one card per story
Stories tagged #bias-evaluation
Tri-PvP: Exposing Modality Bias in Omni-Modal Large Language Models through Perceptual-Propositional Evidence Conflicts
Tri-PvP is a new benchmark revealing robust modality bias in omni-modal LLMs, with vision favoring perceptual signals and audio favoring propositional ones.