PixelUMM: Encoder-Free Unified Image and Video Understanding and Generation
PixelUMM unifies encoder-free image and video understanding and generation in raw pixel space.
Stories per day · 30 days
Relatedmultimodal2compute1image-generation1mixture-of-transformers1mllm1pixel-space1pretraining1scaling-laws1video-generation1vision1
2 stories, newest first · one card per story
Stories tagged #encoder-free
How Far Are We from Removing the Visual Encoder? Scaling Laws for Encoder-Free Multimodal Pretraining
Scaling laws suggest encoder-free multimodal models catch encoder-based ones near 10^22 FLOPs as the visual prior matters less.