Skip to content
NewA calmer, faster ZeroHour

Aligning One-Step Generative Models with Reward-Weighted Transport Distillation

Hugging Face daily papersby Austin Wang, Ziheng Cheng, Lexing Ying ()1 min read1 · 1 read
AI summary · grok-4.7Summaries by Vani AI

RWTD post-trains one-step generators, raising SANA Sprint GenEval from 0.73 to 0.80.

Reward-Weighted Transport Distillation (RWTD) post-trains one-step generative models using only generated samples and scalar reward evaluations. It builds an adaptive target that mixes separately reward-tilted current and reference distributions, implemented with feature-space optimal transport and fixed-point regression. The analysis says its fixed points interpolate between off-policy tilting of the reference and on-policy tilting of the current model. Empirically, RWTD raised the GenEval score of the one-step SANA Sprint 1.6B backbone from 0.73 to 0.80, with preference experiments showing cross-reward generalization and preserved compositional ability.

Key facts
  • Post-training uses only generated samples and scalar rewards
  • Adaptive target mixes tilted current and reference distributions
  • SANA Sprint 1.6B GenEval rises from 0.73 to 0.80
  • Preference tests show cross-reward gains with composition preserved
Explain this AI news with Vani AIWhat was announced, what is new and why it matters, in a new chat

From the original article

1 min read at huggingface.co

One-step generators enable high-quality visual generation with a single network evaluation, but their post-training is difficult: general implicit generators provide neither tractable likelihoods nor denoising trajectories, and many rewards are non-differentiable. We introduce Reward-Weighted Transport Distillation (RWTD), a post-training method that requires only generated samples and scalar reward evaluations.

Hugging Face daily papers

By Austin Wang, Ziheng Cheng, Lexing Ying · huggingface.co

Read the full article at Hugging Face daily papers

A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.