Flash-dLLM: IO-Aware KV Caching and Parallel Decoding for Fast, Memory-Efficient Diffusion LLMs
Flash-dLLM speeds diffusion LLM inference with I/O-aware KV caching and parallel draft-and-verify decoding.
2 stories, newest first · one card per story
Flash-dLLM speeds diffusion LLM inference with I/O-aware KV caching and parallel draft-and-verify decoding.
Flash-dLLM accelerates diffusion LLM inference with I/O-aware KV caching, up to 11 times faster than Elastic-Cache.
Today 1.6K readers · 2.5K views · 779 reads · all time 189K views