Paper sets risk gates for financial document recognition
The contribution is methodological and claims no new model, dataset, or empirical performance result.
Stories per day · 30 days
2 RSS
Relatedcer1document-recognition1error-severity1financial-documents1human-review1multilingual1ocr1selective-automation1semcer1vision-language1
6 stories, newest first · one card per story
Stories tagged #evaluation-metrics
Equal CER, Unequal Damage: Severity-Weighted Character Error Rate for OCR
semCER weights OCR character edits by judged severity, matching readers better than standard CER.
What Should World Models Forget? Stratified Retention for Continual Adaptation
Paper proposes stratified retention for continual world models, separating never-revisable invariants like physics from instance-level facts, plus a differential retention metric.
Reporting Practice Matters: The Impact of Reference Choice on Chest X-ray Report Evaluation
Study shows radiology reporting-style variations in reference reports can flip rankings of chest X-ray report generation models; releases MIMIC-CXR-Ext-ReRef dataset.
Studying Image Tokenizers as Visual Languages in Unified Multimodal Models
A controlled pure-autoregressive testbed shows task-specific validation losses rank image tokenizers differently, with I2T loss the most consistent signal.
LexFlip: A Dissociation Diagnostic for Legal Meaning Preservation Metrics
LexFlip releases 373 minimal perturbations of Quebec statutory French that reverse legal force while preserving tokens, exposing weaknesses in embedding-based meaning preservation metrics.