Loopback Transformer beats baselines with fewer parameters
On ClimbMix it uses 40-75% of baseline Transformer parameters and posts higher mean accuracy at 1.4B and 3B.
1 stories, newest first · one card per story
On ClimbMix it uses 40-75% of baseline Transformer parameters and posts higher mean accuracy at 1.4B and 3B.
Today 1.2K readers · 1.4K views · 193 reads · all time 203K views