Understanding deep learning requires rethinking generalization

10 November 2016

Benjamin Recht

Papers citing "Understanding deep learning requires rethinking generalization"

50 / 1,038 papers shown

Title
Utilizing Excess Resources in Training Neural Networks Amit Henig Raja Giryes 53 0 0 12 Jul 2022
Integral Probability Metrics PAC-Bayes Bounds Ron Amit Baruch Epstein Shay Moran Ron Meir 32 18 0 01 Jul 2022
ProSelfLC: Progressive Self Label Correction Towards A Low-Temperature Entropy State Xinshao Wang Yang Hua Elyor Kodirov S. Mukherjee David Clifton N. Robertson 30 6 0 30 Jun 2022
Neural Networks can Learn Representations with Gradient Descent Alexandru Damian Jason D. Lee Mahdi Soltanolkotabi SSL MLT 25 114 0 30 Jun 2022
Semi-Supervised Generative Adversarial Network for Stress Detection Using Partially Labeled Physiological Data Nibraas Khan Nilanjan Sarkar 8 7 0 30 Jun 2022
On making optimal transport robust to all outliers Kilian Fatras OT 24 0 0 23 Jun 2022
Label noise (stochastic) gradient descent implicitly solves the Lasso for quadratic parametrisation Loucas Pillaud-Vivien J. Reygner Nicolas Flammarion NoLa 33 31 0 20 Jun 2022
Gray Learning from Non-IID Data with Out-of-distribution Samples Zhilin Zhao LongBing Cao Changbao Wang OOD OODD 45 1 0 19 Jun 2022
Sparse Double Descent: Where Network Pruning Aggravates Overfitting Zhengqi He Zeke Xie Quanzhi Zhu Zengchang Qin 83 27 0 17 Jun 2022
Gradient-Based Adversarial and Out-of-Distribution Detection Jinsol Lee Mohit Prabhushankar Ghassan AlRegib UQCV 40 13 0 16 Jun 2022
Accurate Emotion Strength Assessment for Seen and Unseen Speech Based on Data-Driven Deep Learning Rui Liu Berrak Sisman Björn Schuller Guanglai Gao Haizhou Li 27 11 0 15 Jun 2022
Understanding the Generalization Benefit of Normalization Layers: Sharpness Reduction Kaifeng Lyu Zhiyuan Li Sanjeev Arora FAtt 47 71 0 14 Jun 2022
Towards Understanding Sharpness-Aware Minimization Maksym Andriushchenko Nicolas Flammarion AAML 35 134 0 13 Jun 2022
Why Quantization Improves Generalization: NTK of Binary Weight Neural Networks Kaiqi Zhang Ming Yin Yu Wang MQ 24 4 0 13 Jun 2022
NeuGuard: Lightweight Neuron-Guided Defense against Membership Inference Attacks Nuo Xu Binghui Wang Ran Ran Wujie Wen Parv Venkitasubramaniam AAML 26 5 0 11 Jun 2022
Adversarial Reprogramming Revisited Matthias Englert R. Lazic AAML 29 9 0 07 Jun 2022
Recall Distortion in Neural Network Pruning and the Undecayed Pruning Algorithm Aidan Good Jia-Huei Lin Hannah Sieg Mikey Ferguson Xin Yu Shandian Zhe J. Wieczorek Thiago Serra 37 11 0 07 Jun 2022
MSR: Making Self-supervised learning Robust to Aggressive Augmentations Ying-Long Bai Erkun Yang Zhaoqing Wang Yuxuan Du Bo Han Cheng Deng Dadong Wang Tongliang Liu SSL 31 3 0 04 Jun 2022
Robust Meta-learning with Sampling Noise and Label Noise via Eigen-Reptile Dong Chen Lingfei Wu Siliang Tang Xiao Yun Bo Long Yueting Zhuang VLM NoLa 31 9 0 04 Jun 2022
Regularization-wise double descent: Why it occurs and how to eliminate it Fatih Yilmaz Reinhard Heckel 32 11 0 03 Jun 2022
Dataset Distillation using Neural Feature Regression Yongchao Zhou E. Nezhadarya Jimmy Ba DD FedML 53 151 0 01 Jun 2022
Context-based Virtual Adversarial Training for Text Classification with Noisy Labels Do-Myoung Lee Yeachan Kim Chang-gyun Seo NoLa 21 2 0 29 May 2022
Why Robust Generalization in Deep Learning is Difficult: Perspective of Expressive Power Binghui Li Jikai Jin Han Zhong J. Hopcroft Liwei Wang OOD 84 27 0 27 May 2022
Embedding Principle in Depth for the Loss Landscape Analysis of Deep Neural Networks Zhiwei Bai Yaoyu Zhang Z. Xu Tao Luo 31 5 0 26 May 2022
VeriFi: Towards Verifiable Federated Unlearning Xiangshan Gao Xingjun Ma Jingyi Wang Youcheng Sun Bo Li S. Ji Peng Cheng Jiming Chen MU 73 46 0 25 May 2022
On the Interpretability of Regularisation for Neural Networks Through Model Gradient Similarity Vincent Szolnoky Viktor Andersson Balázs Kulcsár Rebecka Jörnsten 45 5 0 25 May 2022
Compression-aware Training of Neural Networks using Frank-Wolfe Max Zimmer Christoph Spiegel Sebastian Pokutta 31 9 0 24 May 2022
Randomly Initialized One-Layer Neural Networks Make Data Linearly Separable Promit Ghosal Srinath Mahankali Yihang Sun MLT 29 4 0 24 May 2022
Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models Kushal Tirumala Aram H. Markosyan Luke Zettlemoyer Armen Aghajanyan TDI 31 187 0 22 May 2022
Interpolating Compressed Parameter Subspaces Siddhartha Datta N. Shadbolt 37 5 0 19 May 2022
Large Neural Networks Learning from Scratch with Very Few Data and without Explicit Regularization C. Linse T. Martinetz SSL VLM 17 4 0 18 May 2022
Learn2Weight: Parameter Adaptation against Similar-domain Adversarial Attacks Siddhartha Datta AAML 36 4 0 15 May 2022
HiURE: Hierarchical Exemplar Contrastive Learning for Unsupervised Relation Extraction Xuming Hu Shuliang Liu Chenwei Zhang Shuang Li Lijie Wen Philip S. Yu SSL 49 39 0 04 May 2022
A Comprehensive Survey of Image Augmentation Techniques for Deep Learning Mingle Xu Sook Yoon A. Fuentes D. Park VLM 40 399 0 03 May 2022
FedRN: Exploiting k-Reliable Neighbors Towards Robust Federated Learning Sangmook Kim Wonyoung Shin Soohyuk Jang Hwanjun Song Se-Young Yun 37 2 0 03 May 2022
Robust Face Anti-Spoofing with Dual Probabilistic Modeling Yuanhan Zhang Yichao Wu Zhen-fei Yin Jing Shao Ziwei Liu CVBM 18 2 0 27 Apr 2022
Perfectly Balanced: Improving Transfer and Robustness of Supervised Contrastive Learning Mayee F. Chen Daniel Y. Fu A. Narayan Michael Zhang Zhao Song Kayvon Fatahalian Christopher Ré SSL 32 48 0 15 Apr 2022
Nonlocal optimization of binary neural networks Amir Khoshaman Giuseppe Castiglione C. Srinivasa 18 0 0 05 Apr 2022
Learning from few examples with nonlinear feature maps I. Tyukin Oliver J. Sutton Alexander N. Gorban 24 1 0 31 Mar 2022
An Empirical Study of Memorization in NLP Xiaosen Zheng Jing Jiang TDI 17 24 1 23 Mar 2022
PACE: A Parallelizable Computation Encoder for Directed Acyclic Graphs Zehao Dong Muhan Zhang Fuhai Li Yixin Chen CML GNN 33 17 0 19 Mar 2022
Reducing Flipping Errors in Deep Neural Networks Xiang Deng Yun Xiao Bo Long Zhongfei Zhang AAML 38 4 0 16 Mar 2022
Scalable Penalized Regression for Noise Detection in Learning with Noisy Labels Yikai Wang Xinwei Sun Yanwei Fu NoLa 34 23 0 15 Mar 2022
Deep AutoAugment Yu Zheng Zikai Zhang Shen Yan Mi Zhang ViT 23 27 0 11 Mar 2022
The Combinatorial Brain Surgeon: Pruning Weights That Cancel One Another in Neural Networks Xin Yu Thiago Serra Srikumar Ramalingam Shandian Zhe 44 48 0 09 Mar 2022
Selective-Supervised Contrastive Learning with Noisy Labels Shikun Li Xiaobo Xia Shiming Ge Tongliang Liu NoLa 27 172 0 08 Mar 2022
Generalization Through The Lens Of Leave-One-Out Error Gregor Bachmann Thomas Hofmann Aurelien Lucchi 67 7 0 07 Mar 2022
Rate-Distortion Theoretic Generalization Bounds for Stochastic Learning Algorithms Romain Chor A. Gohari Gaël Richard Umut Simsekli 25 23 0 04 Mar 2022
Explicitising The Implicit Intrepretability of Deep Neural Networks Via Duality Chandrashekar Lakshminarayanan Ashutosh Kumar Singh A. Rajkumar AI4CE 28 1 0 01 Mar 2022
Understanding Contrastive Learning Requires Incorporating Inductive Biases Nikunj Saunshi Jordan T. Ash Surbhi Goel Dipendra Kumar Misra Cyril Zhang Sanjeev Arora Sham Kakade A. Krishnamurthy SSL 27 109 0 28 Feb 2022