Change the Product, Keep the Parameters: Associative Algebra Layers for Transformers
Algebraic Transformer layers raise small-model generation throughput 6.2-7.8% but lower downstream scores.
1 stories, newest first · one card per story
Algebraic Transformer layers raise small-model generation throughput 6.2-7.8% but lower downstream scores.
Today 1.6K readers · 2.5K views · 779 reads · all time 189K views