Soft-MTP drops a noisy residual in multi-token prediction training
From 167M to 1.2B parameters, Soft-MTP lowers next-token perplexity and speeds speculative decoding without new parameters.
Stories per day · 30 days
1 stories, newest first · one card per story
Stories tagged #language-model-training