UFO: Chain-of-Evaluation for Omni-Condition Alignment in Multi-Modal Image Generation
Researchers propose UFO, a unified evaluation framework for multi-modal image generation that improves correlation with human judgments by 15.25%.
The paper introduces UFO, the first unified framework for evaluating omni-condition alignment in multi-modal image generation, addressing the weakness of existing embedding-based and MLLM-based methods that assess each modal condition in isolation. Its Atomized Chain-of-Evaluation paradigm decomposes alignment into fine-grained, disentangled Atomic Evaluation Units verified via general or dedicated functional calls. UFO achieves the highest correlation with human evaluation preferences, with an average improvement of 15.25%. The authors also release UFO-Bench, a benchmark for evaluating subject-driven customization models under diverse textual and visual condition interactions.
- First unified framework evaluating simultaneous alignment with textual and visual conditions
- Atomized Chain-of-Evaluation decomposes alignment into Atomic Evaluation Units
- Average 15.25% improvement in correlation with human evaluation preferences
- UFO-Bench evaluates customization models under diverse condition interactions
- Tags
- benchmarkevaluation-frameworkimage-generationmllmmulti-modal-generationsubject-driven-customization
From the original article
1 min read at huggingface.co
Multi-modal image generation, particularly subject-driven customization, has garnered growing attention in recent years. Despite the rapid advancement of generative models, their evaluation remains largely lagging.
By Danning Zhang, Yijing Lin, Shuhan Zhuang · huggingface.co
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.