Understanding the Failure Modes of Out-of-Distribution Generalization

29 October 2020

Papers citing "Understanding the Failure Modes of Out-of-Distribution Generalization"

35 / 35 papers shown

Title
Severing Spurious Correlations with Data Pruning Varun Mulchandani Jung-Eun Kim 150 0 0 24 Mar 2025
Beyond Reward Hacking: Causal Rewards for Large Language Model Alignment Chaoqi Wang Zhuokai Zhao Yibo Jiang Zhaorun Chen Chen Zhu ... Jiayi Liu Lizhu Zhang Xiangjun Fan Hao Ma Sinong Wang 77 3 0 17 Jan 2025
In-context Learning in Presence of Spurious Correlations Hrayr Harutyunyan R. Darbinyan Samvel Karapetyan Hrant Khachatrian LRM 46 1 0 04 Oct 2024
Feature contamination: Neural networks learn uncorrelated features and fail to generalize Tianren Zhang Chujie Zhao Guanyu Chen Yizhou Jiang Feng Chen OOD MLT OODD 77 3 0 05 Jun 2024
Towards a Better Evaluation of Out-of-Domain Generalization Duhun Hwang Suhyun Kang Moonjung Eo Jimyeong Kim Wonjong Rhee 56 0 0 30 May 2024
When does compositional structure yield compositional generalization? A kernel theory Samuel Lippl Kim Stachenfeld NAI CoGe 73 5 0 26 May 2024
Complexity Matters: Dynamics of Feature Learning in the Presence of Spurious Correlations GuanWen Qiu Da Kuang Surbhi Goel 27 8 0 05 Mar 2024
LEVI: Generalizable Fine-tuning via Layer-wise Ensemble of Different Views Yuji Roh Qingyun Liu Huan Gui Zhe Yuan Yujin Tang ... Liang Liu Shuchao Bi Lichan Hong Ed H. Chi Zhe Zhao 43 1 0 07 Feb 2024
Out-of-distribution detection using normalizing flows on the data manifold S. Razavi M. Mehmanchi Reshad Hosseini Mostafa Tavassolipour OODD 48 0 0 26 Aug 2023
Spurious Correlations and Where to Find Them Gautam Sreekumar Vishnu Naresh Boddeti CML 20 3 0 21 Aug 2023
An Empirical Study of Pre-trained Model Selection for Out-of-Distribution Generalization and Calibration Hiroki Naganuma Ryuichiro Hataya Kotaro Yoshida Ioannis Mitliagkas OODD 92 1 0 17 Jul 2023
Fantastic DNN Classifiers and How to Identify them without Data Nathaniel R. Dean D. Sarkar 21 1 0 24 May 2023
Modeling the Q-Diversity in a Min-max Play Game for Robust Optimization Ting Wu Rui Zheng Tao Gui Qi Zhang Xuanjing Huang 41 2 0 20 May 2023
SFP: Spurious Feature-targeted Pruning for Out-of-Distribution Generalization Yingchun Wang Jingcai Guo Yi Liu Song Guo Weizhan Zhang Xiangyong Cao Qinghua Zheng AAML OODD 31 11 0 19 May 2023
Improving group robustness under noisy labels using predictive uncertainty Dongpin Oh Dae Lee Jeunghyun Byun Bonggun Shin UQCV 23 3 0 14 Dec 2022
Avoiding spurious correlations via logit correction Sheng Liu Xu Zhang Nitesh Sekhar Yue Wu Prateek Singhal C. Fernandez‐Granda 25 29 0 02 Dec 2022
Malign Overfitting: Interpolation Can Provably Preclude Invariance Yoav Wald G. Yona Uri Shalit Y. Carmon 17 5 0 28 Nov 2022
Improving Out-of-Distribution Generalization by Adversarial Training with Structured Priors Qixun Wang Yifei Wang Hong Zhu Yisen Wang OOD 22 19 0 13 Oct 2022
Out-of-Distribution Detection and Selective Generation for Conditional Language Models Jie Jessie Ren Jiaming Luo Yao-Min Zhao Kundan Krishna Mohammad Saleh Balaji Lakshminarayanan Peter J. Liu OODD 69 94 0 30 Sep 2022
Optimal Transport-based Identity Matching for Identity-invariant Facial Expression Recognition D. Kim B. Song OT 32 10 0 25 Sep 2022
Importance Tempering: Group Robustness for Overparameterized Models Yiping Lu Wenlong Ji Zachary Izzo Lexing Ying 39 7 0 19 Sep 2022
Calibrated ensembles can mitigate accuracy tradeoffs under distribution shift Ananya Kumar Tengyu Ma Percy Liang Aditi Raghunathan UQCV OODD OOD 42 38 0 18 Jul 2022
Exploring Length Generalization in Large Language Models Cem Anil Yuhuai Wu Anders Andreassen Aitor Lewkowycz Vedant Misra V. Ramasesh Ambrose Slone Guy Gur-Ari Ethan Dyer Behnam Neyshabur ReLM LRM 33 158 0 11 Jul 2022
Towards out of distribution generalization for problems in mechanics Lingxiao Yuan Harold S. Park Emma Lejeune OOD AI4CE 33 17 0 29 Jun 2022
Explaining the physics of transfer learning a data-driven subgrid-scale closure to a different turbulent flow Adam Subel Yifei Guan A. Chattopadhyay P. Hassanzadeh AI4CE 29 41 0 07 Jun 2022
Bayesian Active Learning for Scanning Probe Microscopy: from Gaussian Processes to Hypothesis Learning M. Ziatdinov Yongtao Liu K. Kelley Rama K Vasudevan Sergei V. Kalinin AI4CE 44 49 0 30 May 2022
Last Layer Re-Training is Sufficient for Robustness to Spurious Correlations Polina Kirichenko Pavel Izmailov A. Wilson OOD 34 316 0 06 Apr 2022
Understanding Rare Spurious Correlations in Neural Networks Yao-Yuan Yang Chi-Ning Chou Kamalika Chaudhuri AAML 16 25 0 10 Feb 2022
Conditional entropy minimization principle for learning domain invariant representation features Thuan Q. Nguyen Boyang Lyu Prakash Ishwar matthias. scheutz Shuchin Aeron OOD 27 7 0 25 Jan 2022
Deep Learning Through the Lens of Example Difficulty R. Baldock Hartmut Maennel Behnam Neyshabur 39 155 0 17 Jun 2021
Invariant Information Bottleneck for Domain Generalization Bo-wen Li Yifei Shen Yezhen Wang Wenzhen Zhu Colorado Reed Jun Zhang Dongsheng Li Kurt Keutzer Han Zhao OOD 32 105 0 11 Jun 2021
Can Subnetwork Structure be the Key to Out-of-Distribution Generalization? Dinghuai Zhang Kartik Ahuja Yilun Xu Yisen Wang Aaron Courville OOD 20 95 0 05 Jun 2021
Does Invariant Risk Minimization Capture Invariance? Pritish Kamath Akilesh Tangella Danica J. Sutherland Nathan Srebro OOD 196 125 0 04 Jan 2021
An Investigation of Why Overparameterization Exacerbates Spurious Correlations Shiori Sagawa Aditi Raghunathan Pang Wei Koh Percy Liang 149 371 0 09 May 2020
Out-of-Distribution Generalization via Risk Extrapolation (REx) David M. Krueger Ethan Caballero J. Jacobsen Amy Zhang Jonathan Binas Dinghuai Zhang Rémi Le Priol Aaron Courville OOD 215 901 0 02 Mar 2020