MetaShift: A Dataset of Datasets for Evaluating Contextual Distribution Shifts and Training Conflicts

14 February 2022

Papers citing "MetaShift: A Dataset of Datasets for Evaluating Contextual Distribution Shifts and Training Conflicts"

50 / 57 papers shown

Title
Leveraging Text-to-Image Generation for Handling Spurious Correlation Aryan Yazdan Parast Basim Azam Naveed Akhtar 42 0 0 21 Mar 2025
Project-Probe-Aggregate: Efficient Fine-Tuning for Group Robustness B. Zhu Jiequan Cui H. Zhang Chi Zhang 77 0 0 12 Mar 2025
Debiased Prompt Tuning in Vision-Language Model without Annotations Chaoquan Jiang Yunfan Yang Rui Hu Jitao Sang VLM 57 0 0 11 Mar 2025
Group-robust Sample Reweighting for Subpopulation Shifts via Influence Functions Rui Qiao Zhaoxuan Wu Jingtan Wang Pang Wei Koh Bryan Kian Hsiang Low OOD 42 2 0 10 Mar 2025
FairDropout: Using Example-Tied Dropout to Enhance Generalization of Minority Groups Géraldin Nanfack Eugene Belilovsky 54 0 0 10 Feb 2025
Adaptive Concept Bottleneck for Foundation Models Under Distribution Shifts Jihye Choi Jayaram Raghuram Yixuan Li Somesh Jha 101 4 0 18 Dec 2024
MegaCOIN: Enhancing Medium-Grained Color Perception for Vision-Language Models Ming-Chang Chiu Shicheng Wen Pin-Yu Chen Xuezhe Ma 69 0 0 05 Dec 2024
Efficient Online Inference of Vision Transformers by Training-Free Tokenization Leonidas Gee Wing Yan Li V. Sharmanska Novi Quadrianto ViT 88 0 0 23 Nov 2024
RaVL: Discovering and Mitigating Spurious Correlations in Fine-Tuned Vision-Language Models Maya Varma Jean-Benoit Delbrouck Zhihong Chen Akshay S. Chaudhari C. Langlotz VLM 42 6 0 06 Nov 2024
Compositional Risk Minimization Divyat Mahajan Mohammad Pezeshki Ioannis Mitliagkas Kartik Ahuja Pascal Vincent Pascal Vincent 26 3 0 08 Oct 2024
OOD-Chameleon: Is Algorithm Selection for OOD Generalization Learnable? Liangze Jiang Damien Teney OODD OOD 26 1 0 03 Oct 2024
Concept-Based Explanations in Computer Vision: Where Are We and Where Could We Go? Jae Hee Lee Georgii Mikriukov Gesina Schwalbe Stefan Wermter D. Wolter 48 2 0 20 Sep 2024
LADDER: Language Driven Slice Discovery and Error Rectification Shantanu Ghosh Rayan Syed Chenyu Wang Clare B. Poynton Kayhan Batmanghelich 27 1 0 31 Jul 2024
Constructing Concept-based Models to Mitigate Spurious Correlations with Minimal Human Effort Jeeyung Kim Ze Wang Qiang Qiu 38 1 0 12 Jul 2024
SLIM: Spuriousness Mitigation with Minimal Human Annotations Xiwei Xuan Ziquan Deng Hsuan-Tien Lin Kwan-Liu Ma 39 2 0 08 Jul 2024
Views Can Be Deceiving: Improved SSL Through Feature Space Augmentation Kimia Hamidieh Haoran Zhang Swami Sankaranarayanan Marzyeh Ghassemi 38 0 0 28 May 2024
Data Valuation by Leveraging Global and Local Statistical Information Xiaoling Zhou Ou Wu Michael K. Ng Hao Jiang TDI 17 0 0 23 May 2024
LLM as Dataset Analyst: Subpopulation Structure Discovery with Large Language Model Yulin Luo Ruichuan An Bocheng Zou Yiming Tang Jiaming Liu Shanghang Zhang 36 13 0 03 May 2024
MetaCoCo: A New Few-Shot Classification Benchmark with Spurious Correlation Min Zhang Haoxuan Li Fei Wu Kun Kuang OODD 19 12 0 30 Apr 2024
Controllable Prompt Tuning For Balancing Group Distributional Robustness Hoang Phan Andrew Gordon Wilson Qi Lei 36 5 0 05 Mar 2024
A Survey on Evaluation of Out-of-Distribution Generalization Han Yu Jiashuo Liu Xingxuan Zhang Jiayun Wu Peng Cui OOD 42 9 0 04 Mar 2024
Decompose-and-Compose: A Compositional Approach to Mitigating Spurious Correlation Fahimeh Hosseini Noohdani Parsa Hosseini Aryan Yazdan Parast Hamidreza Yaghoubi Araghi M. Baghshah CoGe OOD 26 6 0 29 Feb 2024
Spurious Correlations in Machine Learning: A Survey Wenqian Ye Guangtao Zheng Xu Cao Yunsheng Ma Aidong Zhang OOD AAML CML 34 33 0 20 Feb 2024
What's documented in AI? Systematic Analysis of 32K AI Model Cards Weixin Liang Nazneen Rajani Xinyu Yang Ezinwanne Ozoani Eric Wu Yiqun Chen D. Smith James Y. Zou 27 15 0 07 Feb 2024
Unraveling the Key Components of OOD Generalization via Diversification Harold Benoit Liangze Jiang Andrei Atanov Ouguzhan Fatih Kar Mattia Rigotti Amir Zamir CML 22 2 0 26 Dec 2023
Describing Differences in Image Sets with Natural Language Lisa Dunlap Yuhui Zhang Xiaohan Wang Ruiqi Zhong Trevor Darrell Jacob Steinhardt Joseph E. Gonzalez Serena Yeung-Levy CoGe VLM 25 30 0 05 Dec 2023
Wild-Tab: A Benchmark For Out-Of-Distribution Generalization In Tabular Regression Sergey Kolesnikov CML OOD 12 4 0 04 Dec 2023
NeuroInspect: Interpretable Neuron-based Debugging Framework through Class-conditional Visualizations Yeong-Joon Ju Ji-Hoon Park Seong-Whan Lee AAML 13 0 0 11 Oct 2023
Robustness May be More Brittle than We Think under Different Degrees of Distribution Shifts Kaican Li Yifan Zhang Lanqing Hong Zhenguo Li Nevin L. Zhang OOD 28 0 0 10 Oct 2023
Discovering environments with XRM Mohammad Pezeshki Diane Bouchacourt Mark Ibrahim Jimuyang Zhang Pascal Vincent David Lopez-Paz 25 18 0 28 Sep 2023
Natural Language Generation and Understanding of Big Code for AI-Assisted Programming: A Review M. Wong Shangxin Guo Ching Nam Hang Siu-Wai Ho C. Tan 28 78 0 04 Jul 2023
AVOIDDS: Aircraft Vision-based Intruder Detection Dataset and Simulator Elysia Q. Smyers Sydney M. Katz Anthony Corso Mykel J. Kochenderfer AAML 16 4 0 19 Jun 2023
Confidence-Based Model Selection: When to Take Shortcuts for Subpopulation Shifts Annie S. Chen Yoonho Lee Amrith Rajagopal Setlur Sergey Levine Chelsea Finn OOD 14 5 0 19 Jun 2023
OpenDataVal: a Unified Benchmark for Data Valuation Kevin Jiang Weixin Liang James Y. Zou Yongchan Kwon FedML 42 34 0 18 Jun 2023
Accuracy on the Curve: On the Nonlinear Correlation of ML Performance Between Data Subpopulations Weixin Liang Yining Mao Yongchan Kwon Xinyu Yang James Y. Zou OODD 29 3 0 04 May 2023
Discover and Cure: Concept-aware Mitigation of Spurious Correlation Shirley Wu Mert Yuksekgonul Linjun Zhang James Y. Zou 65 56 0 01 May 2023
A New Benchmark: On the Utility of Synthetic Data with Blender for Bare Supervised Learning and Downstream Domain Adaptation Hui Tang K. Jia OOD 26 13 0 16 Mar 2023
Spawrious: A Benchmark for Fine Control of Spurious Correlation Biases Aengus Lynch G. Dovonon Jean Kaddour Ricardo M. A. Silva 184 30 0 09 Mar 2023
SkinCon: A skin disease dataset densely annotated by domain experts for fine-grained model debugging and analysis Roxana Daneshjou Mert Yuksekgonul Zhuo Cai R. Novoa J. Zou 16 43 0 01 Feb 2023
Learning Optimal Features via Partial Invariance Moulik Choraria Ibtihal Ferwana Ankur Mani L. Varshney OOD 6 2 0 28 Jan 2023
Discovering and Mitigating Visual Biases through Keyword Explanation Younghyun Kim Sangwoo Mo Minkyu Kim Kyungmin Lee Jaeho Lee Jinwoo Shin 26 30 0 26 Jan 2023
A Whac-A-Mole Dilemma: Shortcuts Come in Multiples Where Mitigating One Amplifies Others Zhiheng Li Ivan Evtimov Albert Gordo C. Hazirbas Tal Hassner Cristian Canton Ferrer Chenliang Xu Mark Ibrahim 26 70 0 09 Dec 2022
Task Discovery: Finding the Tasks that Neural Networks Generalize on Andrei Atanov Andrei Filatov Teresa Yeo Ajay Sohmshetty Amir Zamir OOD 23 10 0 01 Dec 2022
A Call to Reflect on Evaluation Practices for Failure Detection in Image Classification Paul F. Jaeger Carsten T. Lüth Lukas Klein Till J. Bungert UQCV 9 35 0 28 Nov 2022
Wild-Time: A Benchmark of in-the-Wild Distribution Shift over Time Huaxiu Yao Caroline Choi Bochuan Cao Yoonho Lee Pang Wei Koh Chelsea Finn OOD 16 73 0 25 Nov 2022
Data Models for Dataset Drift Controls in Machine Learning With Optical Images Luis Oala Marco Aversa Gabriel Nobis Kurt Willis Yoan Neuenschwander ... E. Pomarico Wojciech Samek Roderick Murray-Smith Christoph Clausen B. Sanguinetti 13 5 0 04 Nov 2022
Sufficient Invariant Learning for Distribution Shift Taero Kim Sungjun Lim Kyungwoo Song OOD 13 2 0 24 Oct 2022
SEAL : Interactive Tool for Systematic Error Analysis and Labeling Nazneen Rajani Weixin Liang Lingjiao Chen Margaret Mitchell James Y. Zou 27 16 0 11 Oct 2022
Env-Aware Anomaly Detection: Ignore Style Changes, Stay True to Content! Stefan Smeu Elena Burceanu Andrei Liviu Nicolicioiu Emanuela Haller 16 4 0 06 Oct 2022
Zeus: Understanding and Optimizing GPU Energy Consumption of DNN Training Jie You Jaehoon Chung Mosharaf Chowdhury 14 74 0 12 Aug 2022