v1v2 (latest)

Identifying Statistical Bias in Dataset Replication

19 May 2020

ArXiv (abs)PDF HTML Github (25★)

Papers citing "Identifying Statistical Bias in Dataset Replication"

36 / 36 papers shown

Title
Revisiting Data Auditing in Large Vision-Language Models Hongyu Zhu Sichu Liang Wenjie Wang Boheng Li Tongxin Yuan Fangqi Li Shilin Wang Zhuosheng Zhang VLM 458 0 0 25 Apr 2025
Leveraging generative models to characterize the failure conditions of image classifiers Adrien Le Coz Stéphane Herbin Faouzi Adjed GAN 54 1 0 01 Oct 2024
Blind Baselines Beat Membership Inference Attacks for Foundation Models Debeshee Das Jie Zhang Florian Tramèr MIALM 178 39 1 23 Jun 2024
What Does Softmax Probability Tell Us about Classifiers Ranking Across Diverse Test Conditions? Weijie Tu Weijian Deng Liang Zheng Tom Gedeon 94 1 0 14 Jun 2024
A Decade's Battle on Dataset Bias: Are We There Yet? Zhuang Liu Kaiming He 94 37 0 13 Mar 2024
Leveraging Human-Machine Interactions for Computer Vision Dataset Quality Enhancement Esla Timothy Anzaku Hyesoo Hong Jin-Woo Park Wonjun Yang Kangmin Kim Jongbum Won Deshika Vinoshani Kumari Herath Arnout Van Messem W. D. Neve 44 1 0 31 Jan 2024
Describing Differences in Image Sets with Natural Language Lisa Dunlap Yuhui Zhang Xiaohan Wang Ruiqi Zhong Trevor Darrell Jacob Steinhardt Joseph E. Gonzalez Serena Yeung-Levy CoGe VLM 125 32 0 05 Dec 2023
What Makes ImageNet Look Unlike LAION Ali Shirali Moritz Hardt 25 10 0 27 Jun 2023
Quantitatively Measuring and Contrastively Exploring Heterogeneity for Domain Generalization Yunze Tong Junkun Yuan Min Zhang Di-hua Zhu Keli Zhang Leilei Gan Kun Kuang 84 8 0 25 May 2023
Self-Improving-Leaderboard(SIL): A Call for Real-World Centric Natural Language Processing Leaderboards Chanjun Park Hyeonseok Moon Seolhwa Lee Jaehyung Seo Sugyeong Eo Heu-Jeoung Lim 57 2 0 20 Mar 2023
Dataset Interfaces: Diagnosing Model Failures Using Controllable Counterfactual Generation Joshua Vendrow Saachi Jain Logan Engstrom Aleksander Madry OOD 85 35 0 15 Feb 2023
Diverse, Difficult, and Odd Instances (D2O): A New Test Set for Object Classification Ali Borji VLM 98 0 0 29 Jan 2023
A Principled Evaluation Protocol for Comparative Investigation of the Effectiveness of DNN Classification Models on Similar-but-non-identical Datasets Esla Timothy Anzaku Haohan Wang Arnout Van Messem W. D. Neve 49 2 0 05 Sep 2022
A Siren Song of Open Source Reproducibility Edward Raff Andrew L. Farris 90 9 0 09 Apr 2022
On Modality Bias Recognition and Reduction Yangyang Guo Liqiang Nie Harry Cheng Zhiyong Cheng Mohan S. Kankanhalli A. Bimbo 75 28 0 25 Feb 2022
Generative multitask learning mitigates target-causing confounding Taro Makino Krzysztof J. Geras Kyunghyun Cho OOD 61 6 0 08 Feb 2022
Unsolved Problems in ML Safety Dan Hendrycks Nicholas Carlini John Schulman Jacob Steinhardt 285 294 0 28 Sep 2021
A Framework for Cluster and Classifier Evaluation in the Absence of Reference Labels R. Joyce Edward Raff Charles K. Nicholas 80 16 0 23 Sep 2021
Using Synthetic Corruptions to Measure Robustness to Natural Distribution Shifts Alfred Laugros A. Caplier Matthieu Ospici 27 5 0 26 Jul 2021
Cross-replication Reliability -- An Empirical Approach to Interpreting Inter-rater Reliability KayYen Wong Praveen K. Paritosh Lora Aroyo 61 28 0 11 Jun 2021
RobustNav: Towards Benchmarking Robustness in Embodied Navigation Prithvijit Chattopadhyay Judy Hoffman Roozbeh Mottaghi Aniruddha Kembhavi 84 55 0 08 Jun 2021
3DB: A Framework for Debugging Computer Vision Models Guillaume Leclerc Hadi Salman Andrew Ilyas Sai H. Vemprala Logan Engstrom ... Pengchuan Zhang Shibani Santurkar Greg Yang Ashish Kapoor Aleksander Madry 118 42 0 07 Jun 2021
The statistical advantage of automatic NLG metrics at the system level Johnny Tian-Zheng Wei Robin Jia 82 23 0 26 May 2021
Defuse: Harnessing Unrestricted Adversarial Examples for Debugging Models Beyond Test Accuracy Dylan Slack N. Rauschmayr K. Kenthapadi AAML 55 2 0 11 Feb 2021
Unadversarial Examples: Designing Objects for Robust Vision Hadi Salman Andrew Ilyas Logan Engstrom Sai H. Vemprala Aleksander Madry Ashish Kapoor WIGM 130 59 0 22 Dec 2020
Optimism in the Face of Adversity: Understanding and Improving Deep Learning through Adversarial Robustness Guillermo Ortiz-Jiménez Apostolos Modas Seyed-Mohsen Moosavi-Dezfooli P. Frossard AAML 121 48 0 19 Oct 2020
Environment Inference for Invariant Learning Elliot Creager J. Jacobsen R. Zemel OOD 83 385 0 14 Oct 2020
BREEDS: Benchmarks for Subpopulation Shift Shibani Santurkar Dimitris Tsipras Aleksander Madry OOD 71 175 0 11 Aug 2020
On Robustness and Transferability of Convolutional Neural Networks Josip Djolonga Jessica Yung Michael Tschannen Rob Romijnders Lucas Beyer ... D. Moldovan Sylvain Gelly N. Houlsby Xiaohua Zhai Mario Lucic OOD 110 156 0 16 Jul 2020
Improving robustness against common corruptions by covariate shift adaptation Steffen Schneider E. Rusak L. Eck Oliver Bringmann Wieland Brendel Matthias Bethge VLM 101 485 0 30 Jun 2020
The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization Dan Hendrycks Steven Basart Norman Mu Saurav Kadavath Frank Wang ... Samyak Parajuli Mike Guo Basel Alomair Jacob Steinhardt Justin Gilmer OOD 401 1,760 0 29 Jun 2020
Active Online Learning with Hidden Shifting Domains Yining Chen Haipeng Luo Tengyu Ma Chicheng Zhang 48 5 0 25 Jun 2020
Using Wavelets and Spectral Methods to Study Patterns in Image-Classification Datasets Roozbeh Yousefzadeh Furong Huang 51 6 0 17 Jun 2020
Are we done with ImageNet? Lucas Beyer Olivier J. Hénaff Alexander Kolesnikov Xiaohua Zhai Aaron van den Oord VLM 139 408 0 12 Jun 2020
From ImageNet to Image Classification: Contextualizing Progress on Benchmarks Dimitris Tsipras Shibani Santurkar Logan Engstrom Andrew Ilyas Aleksander Madry 83 135 0 22 May 2020
Natural Adversarial Examples Dan Hendrycks Kevin Zhao Steven Basart Jacob Steinhardt Basel Alomair OODD 293 1,486 0 16 Jul 2019