Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion models

7 June 2023

Papers citing "Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion models"

50 / 78 papers shown

Title
Metrics that matter: Evaluating image quality metrics for medical image generation Yash Deo Yan Jia T. Lassila William A. P. Smith T. Lawton Siyuan Kang Alejandro F. Frangi Ibrahim Habli 36 0 0 12 May 2025
Can We Achieve Efficient Diffusion without Self-Attention? Distilling Self-Attention into Convolutions Ziyi Dong Chengxing Zhou Weijian Deng Pengxu Wei Xiangyang Ji Liang Lin MQ 46 0 0 30 Apr 2025
Entropic Time Schedulers for Generative Diffusion Models Dejan Stancevic Luca Ambrogioni DiffM OOD 38 0 0 18 Apr 2025
Generalization through variance: how noise shapes inductive biases in diffusion models John J. Vastola DiffM 112 1 0 16 Apr 2025
D $^2$ iT: Dynamic Diffusion Transformer for Accurate Image Generation Weinan Jia Mengqi Huang Nan Chen Lei Zhang Zhendong Mao 21 0 0 13 Apr 2025
ID-Booth: Identity-consistent Face Generation with Diffusion Models Darian Tomašević Fadi Boutros Chenhao Lin Naser Damer Vitomir Štruc Peter Peer DiffM 55 1 0 10 Apr 2025
Domain Guidance: A Simple Transfer Approach for a Pre-trained Diffusion Model Jincheng Zhong Xiangcheng Zhang J. Z. Wang Mingsheng Long 38 1 0 02 Apr 2025
Evaluating Text-to-Image Synthesis with a Conditional Fréchet Distance Jaywon Koo J. Hernandez Moayed Haji-Ali Ziyan Yang Vicente Ordonez EGVM 67 0 0 27 Mar 2025
Unconditional Priors Matter! Improving Conditional Generation of Fine-Tuned Diffusion Models Prin Phunyaphibarn Phillip Y. Lee Jaihoon Kim Minhyuk Sung DiffM 84 0 0 26 Mar 2025
PALATE: Peculiar Application of the Law of Total Expectation to Enhance the Evaluation of Deep Generative Models Tadeusz Dziarmaga Marcin Kądziołka Artur Kasymov Marcin Mazur EGVM 97 0 0 24 Mar 2025
Deeply Supervised Flow-Based Generative Models Inkyu Shin Chenglin Yang Liang-Chieh Chen 58 0 0 18 Mar 2025
AugGen: Synthetic Augmentation Can Improve Discriminative Models Parsa Rahimi Damien Teney S´ebastien Marcel 64 0 0 14 Mar 2025
Probability-Flow ODE in Infinite-Dimensional Function Spaces Kunwoo Na Junghyun Lee Se-Young Yun Sungbin Lim 45 0 0 13 Mar 2025
Conformal Prediction Sets Can Cause Disparate Impact Jesse C. Cresswell Bhargava Kumar Yi Sui Mouloud Belbahri FaML 77 1 0 17 Feb 2025
On the Statistical Complexity of Estimating Vendi Scores from Empirical Data Azim Ospanov Farzan Farnia 35 1 0 17 Feb 2025
The Vendiscope: An Algorithmic Microscope For Data Collections Amey P. Pasarkar Adji Bousso Dieng 36 2 0 15 Feb 2025
PDA: Generalizable Detection of AI-Generated Images via Post-hoc Distribution Alignment Li Wang Wenyu Chen Zheng Li Shanqing Guo 34 0 0 15 Feb 2025
HistoSmith: Single-Stage Histology Image-Label Generation via Conditional Latent Diffusion for Enhanced Cell Segmentation and Classification V. Vadori Jean-Marie Graic A. Peruffo L. Finos Ujwala Kiran Chaudhari Enrico Grisan DiffM MedIm 88 0 0 12 Feb 2025
Recommendations Beyond Catalogs: Diffusion Models for Personalized Generation Gabriel Patron Zhiwei Xu Ishan Kapnadak Felipe Maia Polo DiffM 38 0 0 05 Feb 2025
Towards Scalable Topological Regularizers Hiu-Tung Wong Darrick Lee Hong Yan BDL 57 0 0 24 Jan 2025
Be More Diverse than the Most Diverse: Optimal Mixtures of Generative Models via Mixture-UCB Bandit Algorithms Parham Rezaei Farzan Farnia Cheuk Ting Li 43 1 0 23 Dec 2024
Detecting Discrepancies Between AI-Generated and Natural Images Using Uncertainty Jun Nie Yonggang Zhang Tongliang Liu Y. Cheung Bo Han Xinmei Tian UQCV 90 0 0 08 Dec 2024
SimuScope: Realistic Endoscopic Synthetic Dataset Generation through Surgical Simulation and Diffusion Models Sabina Martyniak Joanna Kaleta Diego DallÁlba Michał Naskręt Szymon Płotka Przemysław Korzeniowski MedIm 66 0 0 03 Dec 2024
Image Generation Diversity Issues and How to Tame Them Mischa Dombrowski Weitong Zhang Sarah Cechnicka Hadrien Reynaud Bernhard Kainz 67 0 0 25 Nov 2024
The Unreasonable Effectiveness of Guidance for Diffusion Models Tim Kaiser Nikolas Adaloglou M. Kollmann DiffM 28 0 0 15 Nov 2024
Inconsistencies In Consistency Models: Better ODE Solving Does Not Imply Better Samples Noël Vouitsis Rasa Hosseinzadeh Brendan Leigh Ross Valentin Villecroze S. Gorti Jesse C. Cresswell G. Loaiza-Ganem DiffM 43 0 0 13 Nov 2024
Uncovering Hidden Subspaces in Video Diffusion Models Using Re-Identification Mischa Dombrowski Hadrien Reynaud Bernhard Kainz DiffM 42 1 0 07 Nov 2024
Conditional Vendi Score: An Information-Theoretic Approach to Diversity Evaluation of Prompt-based Generative Models Mohammad Jalali Azim Ospanov Amin Gohari Farzan Farnia EGVM 37 2 0 05 Nov 2024
A Geometric Framework for Understanding Memorization in Generative Models Brendan Leigh Ross Hamidreza Kamkari Tongzi Wu Rasa Hosseinzadeh Zhaoyan Liu George Stein Jesse C. Cresswell G. Loaiza-Ganem 44 6 0 31 Oct 2024
Conjuring Semantic Similarity Tian Yu Liu Stefano Soatto DiffM 27 0 0 21 Oct 2024
Sparse Repellency for Shielded Generation in Text-to-image Diffusion Models Michael Kirchhof James Thornton Pierre Ablin Louis Béthune Eugène Ndiaye Marco Cuturi 36 2 0 08 Oct 2024
Forte : Finding Outliers with Representation Typicality Estimation Debargha Ganguly Warren Morningstar A. Yu Vipin Chaudhary OODD 39 0 0 02 Oct 2024
Edge-preserving noise for diffusion models Jente Vandersanden Sascha Holl Xingchang Huang Gurprit Singh DiffM 35 0 0 02 Oct 2024
DIAGen: Diverse Image Augmentation with Generative Models Tobias Lingenberg Markus Reuter Gopika Sudhakaran Dominik Gojny Stefan Roth Simone Schaub-Meyer DiffM 23 3 0 26 Aug 2024
Towards a Scalable Reference-Free Evaluation of Generative Models Azim Ospanov Jingwei Zhang Mohammad Jalali Xuenan Cao Andrej Bogdanov Farzan Farnia EGVM 32 1 0 03 Jul 2024
No Training, No Problem: Rethinking Classifier-Free Guidance for Diffusion Models Seyedmorteza Sadat Manuel Kansy Otmar Hilliges Romann M. Weber 34 10 0 02 Jul 2024
Consistency Models Made Easy Zhengyang Geng Ashwini Pokle William Luo Justin Lin J. Zico Kolter 35 24 0 20 Jun 2024
Guiding a Diffusion Model with a Bad Version of Itself Tero Karras M. Aittala Tuomas Kynkaanniemi J. Lehtinen Timo Aila S. Laine 28 57 0 04 Jun 2024
Kaleido Diffusion: Improving Conditional Diffusion Models with Autoregressive Latent Modeling Jiatao Gu Ying Shen Shuangfei Zhai Yizhe Zhang Navdeep Jaitly J. Susskind 47 10 0 31 May 2024
RIGID: A Training-free and Model-Agnostic Framework for Robust AI-Generated Image Detection Zhiyuan He Pin-Yu Chen Tsung-Yi Ho 36 12 0 30 May 2024
Greedy Growing Enables High-Resolution Pixel-Based Diffusion Models C. N. Vasconcelos Abdullah Rashwan Austin Waters Trevor Walker Keyang Xu Jimmy Yan ... Wenlei Zhou Kevin Swersky David J. Fleet Jason Baldridge Oliver Wang 39 3 0 27 May 2024
Towards Geographic Inclusion in the Evaluation of Text-to-Image Models Melissa Hall Samuel J. Bell Candace Ross Adina Williams M. Drozdzal Adriana Romero Soriano EGVM 25 3 0 07 May 2024
Report on the AAPM Grand Challenge on deep generative modeling for learning medical image statistics Rucha Deshpande Varun A. Kelkar Dimitrios S. Gotsis Prabhat Kc Rongping Zeng Kyle J. Myers F. Brooks M. Anastasio MedIm 21 4 0 03 May 2024
DOCCI: Descriptions of Connected and Contrasting Images Yasumasa Onoe Sunayana Rane Zachary Berger Yonatan Bitton Jaemin Cho ... Zarana Parekh Jordi Pont-Tuset Garrett Tanzer Su Wang Jason Baldridge 36 48 0 30 Apr 2024
Revisiting Text-to-Image Evaluation with Gecko: On Metrics, Prompts, and Human Ratings Olivia Wiles Chuhan Zhang Isabela Albuquerque Ivana Kajić Su Wang ... Jordi Pont-Tuset Aida Nematzadeh Anant Nawalgaria Jordi Pont-Tuset Aida Nematzadeh EGVM 120 13 0 25 Apr 2024
F2FLDM: Latent Diffusion Models with Histopathology Pre-Trained Embeddings for Unpaired Frozen Section to FFPE Translation M. M. Ho Shikha Dubey Yosep Chong Beatrice S. Knudsen Tolga Tasdizen MedIm AI4CE 32 1 0 19 Apr 2024
Applying Guidance in a Limited Interval Improves Sample and Distribution Quality in Diffusion Models Tuomas Kynkaanniemi M. Aittala Tero Karras S. Laine Timo Aila J. Lehtinen 19 57 0 11 Apr 2024
PosterLlama: Bridging Design Ability of Langauge Model to Contents-Aware Layout Generation Jaejung Seol Seojun Kim Jaejun Yoo 3DV VLM 32 7 0 01 Apr 2024
ZigMa: A DiT-style Zigzag Mamba Diffusion Model Vincent Tao Hu S. A. Baumann Ming Gui Olga Grebenkova Pingchuan Ma Johannes S. Fischer Bjorn Ommer 40 42 0 20 Mar 2024
StainDiffuser: MultiTask Dual Diffusion Model for Virtual Staining Tushar Kataria Beatrice S. Knudsen Shireen Elhabian DiffM MedIm 27 8 0 17 Mar 2024