Change the Product, Keep the Parameters: Associative Algebra Layers for Transformers
Algebraic feed-forward layers lift small Transformer throughput 6–8% but cut downstream scores.
Stories per day · 30 days
2 stories, newest first · one card per story
Stories tagged #associative-algebra
Change the Product, Keep the Parameters: Associative Algebra Layers for Transformers
Algebraic Transformer layers raise small-model generation throughput 6.2-7.8% but lower downstream scores.