Gradient Starvation: A Learning Proclivity in Neural Networks

18 November 2020

Aaron Courville

Papers citing "Gradient Starvation: A Learning Proclivity in Neural Networks"

22 / 22 papers shown

Title
Predicting Practically? Domain Generalization for Predictive Analytics in Real-world Environments Hanyu Duan Yi Yang Ahmed Abbasi K. Tam OOD 74 0 0 05 Mar 2025
Do ImageNet-trained models learn shortcuts? The impact of frequency shortcuts on generalization Shunxin Wang Raymond N. J. Veldhuis N. Strisciuglio VLM 66 0 0 05 Mar 2025
A Lightweight and Extensible Cell Segmentation and Classification Model for Whole Slide Images N. Shvetsov T. Kilvaer M. Tafavvoghi Anders Sildnes Kajsa Møllersen Lill-ToveRasmussen Busund L. A. Bongo VLM 59 1 0 26 Feb 2025
Feature contamination: Neural networks learn uncorrelated features and fail to generalize Tianren Zhang Chujie Zhao Guanyu Chen Yizhou Jiang Feng Chen OOD MLT OODD 57 2 0 05 Jun 2024
Towards a Better Evaluation of Out-of-Domain Generalization Duhun Hwang Suhyun Kang Moonjung Eo Jimyeong Kim Wonjong Rhee 25 0 0 30 May 2024
Complexity Matters: Dynamics of Feature Learning in the Presence of Spurious Correlations GuanWen Qiu Da Kuang Surbhi Goel 20 8 0 05 Mar 2024
Neural Redshift: Random Networks are not Random Functions Damien Teney A. Nicolicioiu Valentin Hartmann Ehsan Abbasnejad 86 18 0 04 Mar 2024
Fine-tuning with Very Large Dropout Jianyu Zhang Léon Bottou 24 1 0 01 Mar 2024
Understanding the robustness difference between stochastic gradient descent and adaptive gradient methods A. Ma Yangchen Pan Amir-massoud Farahmand AAML 17 5 0 13 Aug 2023
Look Beyond Bias with Entropic Adversarial Data Augmentation Thomas Duboudin Emmanuel Dellandréa Corentin Abgrall Gilles Hénaff Liming Luke Chen CML 11 4 0 10 Jan 2023
Outlier-Aware Training for Improving Group Accuracy Disparities Li-Kuang Chen Canasai Kruengkrai Junichi Yamagishi 11 0 0 27 Oct 2022
On Feature Learning in the Presence of Spurious Correlations Pavel Izmailov Polina Kirichenko Nate Gruver A. Wilson 14 116 0 20 Oct 2022
Learning Less Generalizable Patterns with an Asymmetrically Trained Double Classifier for Better Test-Time Adaptation Thomas Duboudin Emmanuel Dellandréa Corentin Abgrall Gilles Hénaff Limin Chen TTA 7 1 0 17 Oct 2022
Artifact-Based Domain Generalization of Skin Lesion Models Alceu Bissoto Catarina Barata Eduardo Valle Sandra Avila MedIm AI4CE 17 13 0 20 Aug 2022
CDNet: Contrastive Disentangled Network for Fine-Grained Image Categorization of Ocular B-Scan Ultrasound Ruilong Dan Yunxiang Li Yijie Wang Gangyong Jia Ruiquan Ge Juan Ye Qun Jin Yaqi Wang 10 8 0 17 Jun 2022
Evolving Domain Generalization Wei Wang Gezheng Xu Ruizhi Pu Jiaqi Li Fan Zhou Changjian Shui Charles X. Ling Christian Gagné Boyu Wang OOD 22 3 0 31 May 2022
Last Layer Re-Training is Sufficient for Robustness to Spurious Correlations Polina Kirichenko Pavel Izmailov A. Wilson OOD 19 313 0 06 Apr 2022
OccamNets: Mitigating Dataset Bias by Favoring Simpler Hypotheses Robik Shrestha Kushal Kafle Christopher Kanan CML 8 13 0 05 Apr 2022
Simple data balancing achieves competitive worst-group-accuracy Badr Youbi Idrissi Martín Arjovsky Mohammad Pezeshki David Lopez-Paz 14 172 0 27 Oct 2021
Unravelling the Effect of Image Distortions for Biased Prediction of Pre-trained Face Recognition Models P. Majumdar S. Mittal Richa Singh Mayank Vatsa CVBM 14 19 0 14 Aug 2021
Quantifying and Improving Transferability in Domain Generalization Guojun Zhang Han Zhao Yaoliang Yu Pascal Poupart 27 37 0 07 Jun 2021
Out-of-Distribution Generalization via Risk Extrapolation (REx) David M. Krueger Ethan Caballero J. Jacobsen Amy Zhang Jonathan Binas Dinghuai Zhang Rémi Le Priol Aaron Courville OOD 215 888 0 02 Mar 2020