DNeo claims 1.3x faster speculative decoding than DFlash-2
The paper says Mixture-of-Features Attention keeps drafter size and generation quality unchanged.
1 stories, newest first · one card per story
The paper says Mixture-of-Features Attention keeps drafter size and generation quality unchanged.
Today 2.7K readers · 2.9K views · 145 reads · all time 207K views