Climate-ModernBERT: Revisiting Corpus Composition for Domain-Adaptive Continued Pretraining
Climate-ModernBERT domain-adapted encoders reach 76.3 average F1 across nine climate benchmarks, 2.8 points above vanilla ModernBERT-Base.
1 stories, newest first · one card per story
Climate-ModernBERT domain-adapted encoders reach 76.3 average F1 across nine climate benchmarks, 2.8 points above vanilla ModernBERT-Base.
Today 1.6K readers · 2.4K views · 776 reads · all time 189K views