Per-option encoders beat joint scoring on closed-set decisions
At 32 million parameters, per-option scoring gains 5.8 skill points but needs 5 to 13 times more passes.
Stories per day · 30 days
2 RSS
3 stories, newest first · one card per story
Stories tagged #deberta
Knowledgator Releases GLiFormer: A 575M-Parameter Encoder That Hits 91.10 F1 on Nested JSON Extraction Without Generating Tokens
Knowledgator released GLiFormer, an Apache-2.0 encoder (264M/575M) handling NER, classification, relations, and nested JSON extraction, scoring 91.10 F1.
6
Augustinian BabyLM: What Ostensive Definition Can and Cannot Teach a Small Language Model
Study shows visually grounded token embeddings in a small masked LM persist through training and improve object-property knowledge, but escape standard BabyLM benchmarks.