Test-time Regression Improves Sequence Compression
TTR-Compressor uses end-to-end learned regression for sequence compression, outperforming pooling and projections in language and multimodal models.
Stories per day · 30 days
2 stories, newest first · one card per story
Stories tagged #sequence-compression
TTR-Compressor uses test-time regression for sequence compression
On visual token merging it matches an MLP merger while using 55.6% fewer visual tokens.