Feature contamination: Neural networks learn uncorrelated features and fail to generalize

Feature contamination: Neural networks learn uncorrelated features and fail to generalize

5 June 2024

Feng Chen

Papers citing "Feature contamination: Neural networks learn uncorrelated features and fail to generalize"

13 / 13 papers shown

Title
Variational Bayesian Bow tie Neural Networks with Shrinkage Alisa Sheinkman Sara Wade BDL UQCV 28 0 0 17 Nov 2024
Monotonic Representation of Numeric Properties in Language Models Benjamin Heinzerling Kentaro Inui KELM MILM 28 9 0 15 Mar 2024
Task Contamination: Language Models May Not Be Few-Shot Anymore Changmao Li Jeffrey Flanigan 71 87 0 26 Dec 2023
The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasets Samuel Marks Max Tegmark HILM 91 164 0 10 Oct 2023
Toy Models of Superposition Nelson Elhage Tristan Hume Catherine Olsson Nicholas Schiefer T. Henighan ... Sam McCandlish Jared Kaplan Dario Amodei Martin Wattenberg C. Olah AAML MILM 117 314 0 21 Sep 2022
Provable Domain Generalization via Invariant-Feature Subspace Recovery Haoxiang Wang Haozhe Si Bo-wen Li Han Zhao OOD 28 32 0 30 Jan 2022
A Fine-Grained Analysis on Distribution Shift Olivia Wiles Sven Gowal Florian Stimberg Sylvestre-Alvise Rebuffi Ira Ktena Krishnamurthy Dvijotham A. Cemgil OOD 215 196 0 21 Oct 2021
Gradient Matching for Domain Generalization Yuge Shi Jeffrey S. Seely Philip H. S. Torr Siddharth Narayanaswamy Awni Y. Hannun Nicolas Usunier Gabriel Synnaeve OOD 202 246 0 20 Apr 2021
SelfReg: Self-supervised Contrastive Regularization for Domain Generalization Daehee Kim Seunghyun Park Jinkyu Kim Jaekoo Lee OOD SSL 56 260 0 20 Apr 2021
Does Invariant Risk Minimization Capture Invariance? Pritish Kamath Akilesh Tangella Danica J. Sutherland Nathan Srebro OOD 185 125 0 04 Jan 2021
An Investigation of Why Overparameterization Exacerbates Spurious Correlations Shiori Sagawa Aditi Raghunathan Pang Wei Koh Percy Liang 128 368 0 09 May 2020
Out-of-Distribution Generalization via Risk Extrapolation (REx) David M. Krueger Ethan Caballero J. Jacobsen Amy Zhang Jonathan Binas Dinghuai Zhang Rémi Le Priol Aaron Courville OOD 212 888 0 02 Mar 2020
Domain-Adversarial Training of Neural Networks Yaroslav Ganin E. Ustinova Hana Ajakan Pascal Germain Hugo Larochelle François Laviolette M. Marchand Victor Lempitsky GAN OOD 149 9,300 0 28 May 2015