SLA Model Scales Spatial Understanding via Continual Pre-training
SLA optimizes action prediction and spatial alignment from frozen 3D perception for robotic manipulation.
Stories per day · 30 days
2 RSS
5 stories, newest first · one card per story
Stories tagged #continual-pretraining
Cross-Lingual Alignment for Decoder-Only Models using MoE Routers
Aligning MoE router outputs improved cross-lingual transfer in four open-source decoder-only models.
SpectralShift: Effective Context Window Extension of Gated DeltaNet via Spectral Reparameterization
SpectralShift extends Gated DeltaNet context windows via spectral reparameterization of alpha projections, improving long-context capabilities without architectural changes.
Studying Image Tokenizers as Visual Languages in Unified Multimodal Models
A controlled pure-autoregressive testbed shows task-specific validation losses rank image tokenizers differently, with I2T loss the most consistent signal.
Studying Image Tokenizers as Visual Languages in Unified Multimodal Models
A controlled autoregressive testbed shows validation losses must be analyzed per task, and image tokenizer choice affects joint multimodal text modeling.