Soft-MTP drops a noisy residual in multi-token prediction training
From 167M to 1.2B parameters, Soft-MTP lowers next-token perplexity and speeds speculative decoding without new parameters.
1 stories, newest first · one card per story
From 167M to 1.2B parameters, Soft-MTP lowers next-token perplexity and speeds speculative decoding without new parameters.
Today 1.6K readers · 2.4K views · 774 reads · all time 189K views