Although recent text-to-image generative models have achieved impressive performance, they still often struggle with capturing the compositional complexities of prompts including attribute binding, and spatial relationships between different entities. This misalignment is not revealed by common evaluation metrics such as CLIPScore. Recent works have proposed evaluation metrics that utilize Visual Question Answering (VQA) by decomposing prompts into questions about the generated image for more robust compositional evaluation. Although these methods align better with human evaluations, they still fail to fully cover the compositionality within the image. To address this, we propose a novel metric that breaks down images into components, and texts into fine-grained questions about the generated image for evaluation. Our method outperforms previous state-of-the-art metrics, demonstrating its effectiveness in evaluating text-to-image generative models. Code is available atthis https URLT2I-FineEval.
View on arXiv@article{hosseini2025_2503.11481,
title={ T2I-FineEval: Fine-Grained Compositional Metric for Text-to-Image Evaluation },
author={ Seyed Mohammad Hadi Hosseini and Amir Mohammad Izadi and Ali Abdollahi and Armin Saghafian and Mahdieh Soleymani Baghshah },
journal={arXiv preprint arXiv:2503.11481},
year={ 2025 }
}