Skip to content
NewA calmer, faster ZeroHour

Persistence Forcing: Exploiting Feature Specialization in Pixel-Space Diffusion

Hugging Face daily papersby Chong Wang, Zixuan Fu, Shiqi Huang ()1 min read2
AI summary · grok-4.7Summaries by Vani AI

Persistence Forcing uses specialized diffusion features to reach FID 1.63 on ImageNet 256.

Pixel-space diffusion Transformers typically refine features uniformly, despite images needing compact global structure and richer local detail. Heterogeneous refinement produces persistent features for global structure and active features for high-frequency detail. Persistence Forcing lets persistent features condition active ones and adds guidance that complements classifier-free guidance. On ImageNet, PerF-L reaches FID 1.91 versus JiT-H's 1.86 with half the parameters, and PerF-H reaches 1.63 at 256×256 and 1.76 at 512×512.

Key facts
  • Heterogeneous depth budgets create persistent and active features
  • Persistent features encode structure; active features encode detail
  • PerF-H FID is 1.63 at 256 and 1.76 at 512
  • PerF-L nears JiT-H quality with about half the parameters
Explain this AI news with Vani AIWhat was announced, what is new and why it matters, in a new chat

From the original article

1 min read at huggingface.co

Pixel-space diffusion Transformers (DiTs) directly operate on high-dimensional visual data, yet their hidden representations typically undergo uniform refinement across depth. Natural images, however, are inherently organized at different levels of granularity. Global structure can often be represented compactly, whereas local textures and fine details require richer representations.

Hugging Face daily papers

By Chong Wang, Zixuan Fu, Shiqi Huang · huggingface.co

Read the full article at Hugging Face daily papers

A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.