Understanding deep learning requires rethinking generalization

10 November 2016

Benjamin Recht

Papers citing "Understanding deep learning requires rethinking generalization"

50 / 1,075 papers shown

Title
Construct Informative Triplet with Two-stage Hard-sample Generation Chuang Zhu Zheng Hu Huihui Dong Gang He Zekuan Yu Shangshang Zhang 38 3 0 04 Dec 2021
Novel Class Discovery in Semantic Segmentation Yuyang Zhao Zhun Zhong N. Sebe G. Lee 35 27 0 03 Dec 2021
Learning Curves for Continual Learning in Neural Networks: Self-Knowledge Transfer and Forgetting Ryo Karakida S. Akaho CLL 37 11 0 03 Dec 2021
Embedding Principle: a hierarchical structure of loss landscape of deep neural networks Tao Luo Yuqing Li Zhongwang Zhang Yaoyu Zhang Z. Xu 29 22 0 30 Nov 2021
The Geometric Occam's Razor Implicit in Deep Learning Benoit Dherin Micheal Munn David Barrett 22 6 0 30 Nov 2021
Deep Probability Estimation Sheng Liu Aakash Kaku Weicheng Zhu M. Leibovich S. Mohan ... Haoxiang Huang L. Zanna N. Razavian Jonathan Niles-Weed C. Fernandez‐Granda UQCV OOD 28 14 0 21 Nov 2021
DICE: Leveraging Sparsification for Out-of-Distribution Detection Yiyou Sun Yixuan Li OODD 38 152 0 18 Nov 2021
Tensor network to learn the wavefunction of data A. Dymarsky K. Pavlenko 29 6 0 15 Nov 2021
Constrained Instance and Class Reweighting for Robust Learning under Label Noise Abhishek Kumar Ehsan Amid NoLa 35 19 0 09 Nov 2021
Data Augmentation Can Improve Robustness Sylvestre-Alvise Rebuffi Sven Gowal D. A. Calian Florian Stimberg Olivia Wiles Timothy A. Mann AAML 34 271 0 09 Nov 2021
MixACM: Mixup-Based Robustness Transfer via Distillation of Activated Channel Maps Muhammad Awais Fengwei Zhou Chuanlong Xie Jiawei Li Sung-Ho Bae Zhenguo Li AAML 43 17 0 09 Nov 2021
Information-Theoretic Bayes Risk Lower Bounds for Realizable Models M. Nokleby Ahmad Beirami 64 1 0 08 Nov 2021
Improved Regularization and Robustness for Fine-tuning in Neural Networks Dongyue Li Hongyang R. Zhang NoLa 55 56 0 08 Nov 2021
Exponential escape efficiency of SGD from sharp minima in non-stationary regime Hikaru Ibayashi Masaaki Imaizumi 34 4 0 07 Nov 2021
Understanding Layer-wise Contributions in Deep Neural Networks through Spectral Analysis Yatin Dandi Arthur Jacot FAtt 33 4 0 06 Nov 2021
Visualizing the Emergence of Intermediate Visual Patterns in DNNs Mingjie Li Shaobo Wang Quanshi Zhang 51 11 0 05 Nov 2021
An Explanation of In-context Learning as Implicit Bayesian Inference Sang Michael Xie Aditi Raghunathan Percy Liang Tengyu Ma ReLM BDL VPVLM LRM 93 698 0 03 Nov 2021
Subquadratic Overparameterization for Shallow Neural Networks Chaehwan Song Ali Ramezani-Kebrya Thomas Pethick Armin Eftekhari V. Cevher 30 31 0 02 Nov 2021
Mixture Proportion Estimation and PU Learning: A Modern Approach Saurabh Garg Yifan Wu Alexander J. Smola Sivaraman Balakrishnan Zachary Chase Lipton 24 52 0 01 Nov 2021
Real-time Speaker counting in a cocktail party scenario using Attention-guided Convolutional Neural Network Midia Yousefi John H. L. Hansen 28 10 0 30 Oct 2021
Neural Networks as Kernel Learners: The Silent Alignment Effect Alexander B. Atanasov Blake Bordelon Cengiz Pehlevan MLT 30 75 0 29 Oct 2021
PAC-Bayesian Learning of Aggregated Binary Activated Neural Networks with Probabilities over Representations Louis Fortier-Dubois Gaël Letarte Benjamin Leblanc Franccois Laviolette Pascal Germain UQCV 19 0 0 28 Oct 2021
Addressing out-of-distribution label noise in webly-labelled data Paul Albert Diego Ortego Eric Arazo Noel E. O'Connor Kevin McGuinness NoLa 18 16 0 26 Oct 2021
Rethinking Neural vs. Matrix-Factorization Collaborative Filtering: the Theoretical Perspectives Zida Cheng Chuanwei Ruan Siheng Chen Sushant Kumar Ya Zhang 27 16 0 23 Oct 2021
PropMix: Hard Sample Filtering and Proportional MixUp for Learning with Noisy Labels F. Cordeiro Vasileios Belagiannis Ian Reid G. Carneiro NoLa 30 18 0 22 Oct 2021
Model, sample, and epoch-wise descents: exact solution of gradient flow in the random feature model A. Bodin N. Macris 42 13 0 22 Oct 2021
On the Regularization of Autoencoders Harald Steck Dario Garcia-Garcia SSL AI4CE 30 4 0 21 Oct 2021
Behavioral Experiments for Understanding Catastrophic Forgetting Samuel J. Bell Neil D. Lawrence 35 4 0 20 Oct 2021
Noisy Annotation Refinement for Object Detection Jiafeng Mao Qing Yu Yoko Yamakata Kiyoharu Aizawa NoLa 47 10 0 20 Oct 2021
Interpretive Blindness Nicholas M. Asher Julie Hunter 19 0 0 19 Oct 2021
Mitigating Memorization of Noisy Labels via Regularization between Representations Hao Cheng Zhaowei Zhu Xing Sun Yang Liu NoLa 43 28 0 18 Oct 2021
Alleviating Noisy-label Effects in Image Classification via Probability Transition Matrix Ziqi Zhang Yuexiang Li Hongxin Wei Kai Ma Tao Xu Yefeng Zheng NoLa 30 5 0 17 Oct 2021
Deep Active Learning by Leveraging Training Dynamics Haonan Wang Wei Huang Ziwei Wu A. Margenot Hanghang Tong Jingrui He AI4CE 31 33 0 16 Oct 2021
Clean or Annotate: How to Spend a Limited Data Collection Budget Derek Chen Zhou Yu Samuel R. Bowman 39 13 0 15 Oct 2021
Continual Learning on Noisy Data Streams via Self-Purified Replay C. Kim Jinseo Jeong Sang-chul Moon Gunhee Kim CLL 45 39 0 14 Oct 2021
The Role of Permutation Invariance in Linear Mode Connectivity of Neural Networks R. Entezari Hanie Sedghi O. Saukh Behnam Neyshabur MoMe 39 217 0 12 Oct 2021
Open-Set Recognition: a Good Closed-Set Classifier is All You Need? S. Vaze Kai Han Andrea Vedaldi Andrew Zisserman BDL 169 411 0 12 Oct 2021
Implicit Bias of Linear Equivariant Networks Hannah Lawrence Kristian Georgiev A. Dienes B. Kiani AI4CE 45 14 0 12 Oct 2021
Why Lottery Ticket Wins? A Theoretical Perspective of Sample Complexity on Pruned Neural Networks Shuai Zhang Meng Wang Sijia Liu Pin-Yu Chen Jinjun Xiong UQCV MLT 31 13 0 12 Oct 2021
Imitating Deep Learning Dynamics via Locally Elastic Stochastic Differential Equations Jiayao Zhang Hua Wang Weijie J. Su 35 8 0 11 Oct 2021
Tighter Sparse Approximation Bounds for ReLU Neural Networks Carles Domingo-Enrich Youssef Mroueh 104 4 0 07 Oct 2021
Robustness and Reliability When Training With Noisy Labels Amanda Olmin Fredrik Lindsten OOD NoLa 24 14 0 07 Oct 2021
StrengthNet: Deep Learning-based Emotion Strength Assessment for Emotional Speech Synthesis Rui Liu Berrak Sisman Haizhou Li 34 2 0 07 Oct 2021
On the Generalization of Models Trained with SGD: Information-Theoretic Bounds and Implications Ziqiao Wang Yongyi Mao FedML MLT 39 22 0 07 Oct 2021
On Margin Maximization in Linear and ReLU Networks Gal Vardi Ohad Shamir Nathan Srebro 52 28 0 06 Oct 2021
Influence-Balanced Loss for Imbalanced Visual Classification Seulki Park Jongin Lim Younghan Jeon J. Choi CVBM 90 132 0 06 Oct 2021
Spectral Bias in Practice: The Role of Function Frequency in Generalization Sara Fridovich-Keil Raphael Gontijo-Lopes Rebecca Roelofs 41 28 0 06 Oct 2021
On the Impact of Stable Ranks in Deep Nets B. Georgiev L. Franken Mayukh Mukherjee Georgios Arvanitidis 23 3 0 05 Oct 2021
Trustworthy AI: From Principles to Practices Bo Li Peng Qi Bo Liu Shuai Di Jingen Liu Jiquan Pei Jinfeng Yi Bowen Zhou 121 357 0 04 Oct 2021
Discriminative Attribution from Counterfactuals N. Eckstein A. S. Bates G. Jefferis Jan Funke FAtt CML 27 1 0 28 Sep 2021