DLoop: Looped Speculative Decoding
DLoop loops speculative decoding so draft models propose more tokens before one joint verification, cutting target-model passes.
Stories per day · 30 days
3 stories, newest first · one card per story
Stories tagged #eagle-3
AgSpec: Pushing the Limits of Retrieval-Based Speculative Decoding in Coding Agent Pipelines
AgSpec speeds coding-agent generation via retrieval and adaptive speculative drafts, up to 4.76× throughput.
Speculative Decoding in vLLM on AMD GPUs
vLLM benchmarks speculative decoding on AMD Instinct MI300X and MI355X GPUs across five drafting methods including EAGLE-3 and native MTP.