Discovering Bugs in Vision Models using Off-the-shelf Image Generation and Captioning

18 August 2022

Papers citing "Discovering Bugs in Vision Models using Off-the-shelf Image Generation and Captioning"

41 / 41 papers shown

Title
Fine-Grained Bias Exploration and Mitigation for Group-Robust Classification Miaoyun Zhao Qiang Zhang C. Li 18 0 0 11 May 2025
Classifier-to-Bias: Toward Unsupervised Automatic Bias Detection for Visual Classifiers Quentin Guimard Moreno DÍncà Massimiliano Mancini Elisa Ricci SSL 72 0 0 29 Apr 2025
Detecting Systematic Weaknesses in Vision Models along Predefined Human-Understandable Dimensions Sujan Sai Gannamaneni Rohil Prakash Rao Michael Mock Maram Akila Stefan Wrobel AAML 62 0 0 17 Feb 2025
Improving Object Detection by Modifying Synthetic Data with Explainable AI Nitish Mital Simon Malzard Richard Walters Celso M. De Melo Raghuveer Rao Victoria Nockles 74 0 0 02 Dec 2024
Interactive Visual Assessment for Text-to-Image Generation Models Xiaoyue Mi Fan Tang Juan Cao Qiang Sheng Ziyao Huang Peng Li Y. Liu Tong-Yee Lee EGVM 64 0 0 23 Nov 2024
GIFT: A Framework for Global Interpretable Faithful Textual Explanations of Vision Classifiers Éloi Zablocki Valentin Gerard Amaia Cardiel Eric Gaussier Matthieu Cord Eduardo Valle 69 0 0 23 Nov 2024
Learning Where to Edit Vision Transformers Yunqiao Yang Long-Kai Huang Shengzhuang Chen Kede Ma Ying Wei KELM 23 1 0 04 Nov 2024
Explaining an image classifier with a generative model conditioned by uncertainty Adrien Le Coz Stéphane Herbin Faouzi Adjed 26 0 0 02 Oct 2024
Visual Data Diagnosis and Debiasing with Concept Graphs Rwiddhi Chakraborty Yinong Wang Jialu Gao Runkai Zheng Cheng Zhang Fernando De la Torre 18 2 0 26 Sep 2024
Are Pose Estimators Ready for the Open World? STAGE: Synthetic Data Generation Toolkit for Auditing 3D Human Pose Estimators Nikita Kister István Sárándi Anna Khoreva Gerard Pons-Moll 42 0 0 28 Aug 2024
Say My Name: a Model's Bias Discovery Framework Massimiliano Ciranni Luca Molinaro C. Barbano A. Fiandrotti Vittorio Murino Vito Paolo Pastore Enzo Tartaglione 23 3 0 18 Aug 2024
Model editing for distribution shifts in uranium oxide morphological analysis Davis Brown Cody Nizinski Madelyn Shapiro Corey Fallon Tianzhixi Yin Henry Kvinge Jonathan Tu 31 0 0 22 Jul 2024
Unveiling Glitches: A Deep Dive into Image Encoding Bugs within CLIP Ayush Ranjan Daniel Wen Karthik Bhat 24 0 0 30 Jun 2024
Reinforcing Pre-trained Models Using Counterfactual Images Xiang Li Ren Togo Keisuke Maeda Takahiro Ogawa Miki Haseyama 18 1 0 19 Jun 2024
Efficient Exploration of Image Classifier Failures with Bayesian Optimization and Text-to-Image Models Adrien Le Coz Houssem Ouertatani Stéphane Herbin Faouzi Adjed 16 0 0 26 Apr 2024
Identification of Fine-grained Systematic Errors via Controlled Scene Generation Valentyn Boreiko Matthias Hein J. H. Metzen 19 1 0 10 Apr 2024
Distributionally Generative Augmentation for Fair Facial Attribute Classification Fengda Zhang Qianpei He Kun Kuang Jiashuo Liu Long Chen Chao-Xiang Wu Jun Xiao Hanwang Zhang CVBM 27 8 0 11 Mar 2024
Benchmarking Segmentation Models with Mask-Preserved Attribute Editing Zijin Yin Kongming Liang Bing Li Zhanyu Ma Jun Guo VLM 33 2 0 02 Mar 2024
Clarify: Improving Model Robustness With Natural Language Corrections Yoonho Lee Michelle S. Lam Helena Vasconcelos Michael S. Bernstein Chelsea Finn 18 6 0 06 Feb 2024
The Journey, Not the Destination: How Data Guides Diffusion Models Kristian Georgiev Joshua Vendrow Hadi Salman Sung Min Park Aleksander Madry 8 20 0 11 Dec 2023
Identifying and Mitigating Model Failures through Few-shot CLIP-aided Diffusion Generation Atoosa Malemir Chegini S. Feizi VLM 25 2 0 09 Dec 2023
Error Discovery by Clustering Influence Embeddings Fulton Wang Julius Adebayo Sarah Tan Diego Garcia-Olano Narine Kokhlikyan 11 3 0 07 Dec 2023
Probing clustering in neural network representations Thao Nguyen Simon Kornblith 16 1 0 14 Nov 2023
Effective Human-AI Teams via Learned Natural Language Rules and Onboarding Hussein Mozannar Jimin J Lee Dennis L. Wei P. Sattigeri Subhro Das David Sontag 39 11 0 02 Nov 2023
Targeted Image Data Augmentation Increases Basic Skills Captioning Robustness Valentin Barriere Felipe del Rio Andres Carvallo De Ferari Carlos Aspillaga Eugenio Herrera-Berg Cristian Buc Calderon DiffM 14 0 0 27 Sep 2023
Identifying Systematic Errors in Object Detectors with the SCROD Pipeline Valentyn Boreiko Matthias Hein J. H. Metzen 6 5 0 23 Sep 2023
ASPIRE: Language-Guided Data Augmentation for Improving Robustness Against Spurious Correlations Sreyan Ghosh Chandra Kiran Reddy Evuru Sonal Kumar Utkarsh Tyagi Sakshi Singh Sanjoy Chowdhury Dinesh Manocha OOD 20 1 0 19 Aug 2023
Identifying Interpretable Subspaces in Image Representations N. Kalibhat S. Bhardwaj Bayan Bruss Hamed Firooz Maziar Sanjabi S. Feizi FAtt 17 26 0 20 Jul 2023
Mass-Producing Failures of Multimodal Systems with Language Models Shengbang Tong Erik Jones Jacob Steinhardt 20 33 0 21 Jun 2023
Where Does My Model Underperform? A Human Evaluation of Slice Discovery Algorithms Nari Johnson Ángel Alexander Cabrera Gregory Plumb Ameet Talwalkar 18 12 0 13 Jun 2023
LANCE: Stress-testing Visual Models by Generating Language-guided Counterfactual Images Viraj Prabhu Sriram Yenamandra Prithvijit Chattopadhyay Judy Hoffman 13 37 0 30 May 2023
Spawrious: A Benchmark for Fine Control of Spurious Correlation Biases Aengus Lynch G. Dovonon Jean Kaddour Ricardo M. A. Silva 181 30 0 09 Mar 2023
Identification of Systematic Errors of Image Classifiers on Rare Subgroups J. H. Metzen Robin Hutmacher N. G. Hua Valentyn Boreiko Dan Zhang AAML VLM 50 18 0 09 Mar 2023
Dataset Interfaces: Diagnosing Model Failures Using Controllable Counterfactual Generation Joshua Vendrow Saachi Jain Logan Engstrom A. Madry OOD 8 34 0 15 Feb 2023
Discovering and Mitigating Visual Biases through Keyword Explanation Younghyun Kim Sangwoo Mo Minkyu Kim Kyungmin Lee Jaeho Lee Jinwoo Shin 26 30 0 26 Jan 2023
Adaptive Testing of Computer Vision Models Irena Gao Gabriel Ilharco Scott M. Lundberg Marco Tulio Ribeiro VLM 12 40 0 06 Dec 2022
Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networks Tilman Raukur A. Ho Stephen Casper Dylan Hadfield-Menell AAML AI4CE 18 123 0 27 Jul 2022
Towards a More Rigorous Science of Blindspot Discovery in Image Classification Models Gregory Plumb Nari Johnson Ángel Alexander Cabrera Ameet Talwalkar 27 5 0 08 Jul 2022
Robust Feature-Level Adversaries are Interpretability Tools Stephen Casper Max Nadeau Dylan Hadfield-Menell Gabriel Kreiman AAML 40 27 0 07 Oct 2021
Constructing Unrestricted Adversarial Examples with Generative Models Yang Song Rui Shu Nate Kushman Stefano Ermon GAN AAML 174 300 0 21 May 2018
Adversarial examples in the physical world Alexey Kurakin Ian Goodfellow Samy Bengio SILM AAML 250 5,813 0 08 Jul 2016