Exponential residual flows give an ODE sampler for discrete diffusion
The construction preserves the original diffusion's marginals and is specialized to masked and uniform diffusion.
Stories per day · 30 days
1 RSS
Relatedautoregressive-models1consistency-distillation1generative-models1image-generation1inpainting1llamagen1ode1sampling1
8 stories, newest first · one card per story
Stories tagged #discrete-diffusion
Recipe adapts pretrained autoregressive image models to any token order
On LlamaGen and RAR, the method beat MaskGIT inpainting FID 6.21 to 10.44 at 13-33% extra compute.
IDRF: Inverse-Distilled Reward Fine-tuning of Masked Discrete Diffusion Models
IDRF reward-fine-tunes few-step masked discrete diffusion models via inverse-distillation regularization, achieving high reward with up to 32x fewer denoising steps while mitigating reward hacking.
Learning to Re-Draft: A Variational Stackelberg Game for Discrete Diffusion
VSDD learns a corruption process so discrete diffusion models can re-draft tokens more effectively.
Why Deterministic PRM Guidance Underperforms in Discrete Diffusion Reasoning
Deterministic PRM guidance for discrete diffusion LLMs loses to simpler ORM reranking at matched compute.
Schedule optimization for tau-leaping in masked discrete diffusion
A theory paper derives optimal denoising schedules for tau-leaping samplers in masked discrete diffusion models.
Discrete Beckmann Transport Models for One-Step Language Modeling and Reasoning
DBTM achieves one-step text generation via a time-independent transport map trained directly from data, removing pretrained teacher distillation.
Unlocking Lossless Speedups in LLMs via Discrete Diffusion
Uno pairs autoregressive LLMs with lightweight diffusion weights to draw multiple tokens in parallel, delivering up to 3x lossless speedup without a draft model.