Type Diversity Enables Transformers to Generalise Compositionally
Researchers show lexical-versus-structural compositional generalization gaps in Transformers stem from type diversity imbalance in datasets, not architectural limits.
1 stories, newest first · one card per story
Researchers show lexical-versus-structural compositional generalization gaps in Transformers stem from type diversity imbalance in datasets, not architectural limits.
Today 1.6K readers · 2.5K views · 779 reads · all time 189K views