One Block, Multiple Depths: Recurrent Vision Transformers with Depth-Programmed Experts
A recurrent vision Transformer matches full-depth accuracy with one block and about 70% fewer parameters.
40
A recurrent vision Transformer matches full-depth accuracy with one block and about 70% fewer parameters.
A recurrent vision Transformer matches full-depth encoder accuracy with about 70% fewer stored parameters.
Today 923 readers · 1K views · 271 reads · all time 109K views