Understanding deep learning requires rethinking generalization

10 November 2016

Benjamin Recht

Papers citing "Understanding deep learning requires rethinking generalization"

50 / 1,075 papers shown

Title
Classification and Adversarial examples in an Overparameterized Linear Model: A Signal Processing Perspective Adhyyan Narang Vidya Muthukumar A. Sahai SILM AAML 38 1 0 27 Sep 2021
Deep Exploration for Recommendation Systems Zheqing Zhu Benjamin Van Roy 37 11 0 26 Sep 2021
Training Dynamic based data filtering may not work for NLP datasets Arka Talukdar Monika Dagar Prachi Gupta Varun G. Menon NoLa 48 3 0 19 Sep 2021
Reinforcement Learning on Encrypted Data Alberto Jesu Victor-Alexandru Darvariu Alessandro Staffolani R. Montanari Mirco Musolesi OffRL 21 1 0 16 Sep 2021
No True State-of-the-Art? OOD Detection Methods are Inconsistent across Datasets Fahim Tajwar Ananya Kumar Sang Michael Xie Percy Liang OODD 27 21 0 12 Sep 2021
Feature Selection on Thermal-stress Dataset Xuyang Shen J. Plested Tom Gedeon 225 0 0 08 Sep 2021
A Farewell to the Bias-Variance Tradeoff? An Overview of the Theory of Overparameterized Machine Learning Yehuda Dar Vidya Muthukumar Richard G. Baraniuk 41 71 0 06 Sep 2021
Dash: Semi-Supervised Learning with Dynamic Thresholding Yi Tian Xu Lei Shang Jinxing Ye Qi Qian Yu-Feng Li Baigui Sun Hao Li Rong Jin 47 219 0 01 Sep 2021
Feature Importance in a Deep Learning Climate Emulator Wei Xu Xihaier Luo Yihui Ren Ji Hwan Park Shinjae Yoo Balasubramanya T. Nadiga FAtt AI4TS 44 3 0 27 Aug 2021
Multi-domain semantic segmentation with overlapping labels Petra Bevandić Marin Orsic Ivan Grubišić Josip Saric Sinisa Segvic 33 13 0 25 Aug 2021
NGC: A Unified Framework for Learning with Open-World Noisy Data Zhi-Fan Wu Tong Wei Jianwen Jiang Chaojie Mao Mingqian Tang Yu-Feng Li 11 81 0 25 Aug 2021
Towards Efficient and Data Agnostic Image Classification Training Pipeline for Embedded Systems K. Prokofiev V. Sovrasov 3DH 24 2 0 16 Aug 2021
Cooperative Learning for Noisy Supervision Hao Wu Jiangchao Yao Ya Zhang Yanfeng Wang NoLa 14 2 0 11 Aug 2021
Unified Regularity Measures for Sample-wise Learning and Generalization Chi Zhang Xiaoning Ma Yu Liu Le Wang Yuanqi Su Yuehu Liu 39 1 0 09 Aug 2021
Learning with Noisy Labels via Sparse Regularization Xiong Zhou Xianming Liu Chenyang Wang Deming Zhai Junjun Jiang Xiangyang Ji NoLa 34 51 0 31 Jul 2021
Simple, Fast, and Flexible Framework for Matrix Completion with Infinite Width Neural Networks Adityanarayanan Radhakrishnan George Stefanakis M. Belkin Caroline Uhler 35 25 0 31 Jul 2021
Generalizing Gaze Estimation with Outlier-guided Collaborative Adaptation Yunfei Liu Ruicong Liu Haofei Wang Feng Lu OOD 23 54 0 29 Jul 2021
Characterizing the Generalization Error of Gibbs Algorithm with Symmetrized KL information Gholamali Aminian Yuheng Bu Laura Toni M. Rodrigues G. Wornell 30 4 0 28 Jul 2021
Pointer Value Retrieval: A new benchmark for understanding the limits of neural network generalization Chiyuan Zhang M. Raghu Jon M. Kleinberg Samy Bengio OOD 32 30 0 27 Jul 2021
Rethinking Hard-Parameter Sharing in Multi-Domain Learning Lijun Zhang Qizheng Yang Xiao Liu Hui Guan OOD 36 14 0 23 Jul 2021
Memorization in Deep Neural Networks: Does the Loss Function matter? Deep Patel P. Sastry TDI 27 8 0 21 Jul 2021
kNet: A Deep kNN Network To Handle Label Noise Itzik Mizrahi S. Avidan NoLa 21 0 0 20 Jul 2021
Just Train Twice: Improving Group Robustness without Training Group Information E. Liu Behzad Haghgoo Annie S. Chen Aditi Raghunathan Pang Wei Koh Shiori Sagawa Percy Liang Chelsea Finn OOD 37 540 0 19 Jul 2021
Rethinking Graph Auto-Encoder Models for Attributed Graph Clustering Nairouz Mrabah Mohamed Bouguessa M. Touati Riadh Ksantini 40 63 0 19 Jul 2021
A Theory of PAC Learnability of Partial Concept Classes N. Alon Steve Hanneke R. Holzman Shay Moran 28 50 0 18 Jul 2021
Feature Mining: A Novel Training Strategy for Convolutional Neural Network Tianshu Xie Xuan Cheng Xiaomin Wang Minghui Liu Jiali Deng Ming Liu 39 5 0 18 Jul 2021
SGD: The Role of Implicit Regularization, Batch-size and Multiple-epochs Satyen Kale Ayush Sekhari Karthik Sridharan 196 29 0 11 Jul 2021
Semi-Supervised Learning with Multi-Head Co-Training Mingcai Chen Yuntao Du Yi Zhang Shuwei Qian Chong-Jun Wang 29 28 0 10 Jul 2021
Consensual Collaborative Training And Knowledge Distillation Based Facial Expression Recognition Under Noisy Annotations Darshan Gera B. S 15 7 0 10 Jul 2021
Mitigating Memorization in Sample Selection for Learning with Noisy Labels Kyeongbo Kong Junggi Lee Youngchul Kwak Young-Rae Cho Seong-Eun Kim Woo‐Jin Song NoLa 18 0 0 08 Jul 2021
Impact of deep learning-based image super-resolution on binary signal detection Xiaohui Zhang Varun A. Kelkar Jason L. Granstedt Hua Li M. Anastasio MedIm 18 23 0 06 Jul 2021
A Theoretical Analysis of Fine-tuning with Linear Teachers Gal Shachaf Alon Brutzkus Amir Globerson 39 17 0 04 Jul 2021
Survey: Leakage and Privacy at Inference Time Marija Jegorova Chaitanya Kaul Charlie Mayor Alison Q. OÑeil Alexander Weir Roderick Murray-Smith Sotirios A. Tsaftaris PILM MIACV 33 71 0 04 Jul 2021
Physics-Guided Deep Learning for Dynamical Systems: A Survey Rui Wang Rose Yu AI4CE PINN 46 65 0 02 Jul 2021
Adaptive Sample Selection for Robust Learning under Label Noise Deep Patel P. Sastry OOD NoLa 28 29 0 29 Jun 2021
Implicit Gradient Alignment in Distributed and Federated Learning Yatin Dandi Luis Barba Martin Jaggi FedML 26 31 0 25 Jun 2021
Federated Noisy Client Learning Huazhu Fu Li Li Bo Han Chengzhong Xu Ling Shao FedML 28 26 0 24 Jun 2021
RootPainter3D: Interactive-machine-learning enables rapid and accurate contouring for radiotherapy Abraham George Smith Jens Petersen C. Terrones-Campos A. Berthelsen Nora Jarrett Forbes S. Darkner L. Specht I. Vogelius MedIm AI4CE 24 21 0 22 Jun 2021
Stochastic Polyak Stepsize with a Moving Target Robert Mansel Gower Aaron Defazio Michael G. Rabbat 32 17 0 22 Jun 2021
Repulsive Deep Ensembles are Bayesian Francesco DÁngelo Vincent Fortuin UQCV BDL 64 95 0 22 Jun 2021
Membership Inference on Word Embedding and Beyond Saeed Mahloujifar Huseyin A. Inan Melissa Chase Esha Ghosh Marcello Hasegawa MIACV SILM 25 46 0 21 Jun 2021
Teacher's pet: understanding and mitigating biases in distillation Michal Lukasik Srinadh Bhojanapalli A. Menon Sanjiv Kumar 18 25 0 19 Jun 2021
Evaluating the Robustness of Trigger Set-Based Watermarks Embedded in Deep Neural Networks Suyoung Lee Wonho Song Suman Jana M. Cha Sooel Son AAML 27 13 0 18 Jun 2021
Multi-Label Learning from Single Positive Labels Elijah Cole Oisin Mac Aodha Titouan Lorieul Pietro Perona Dan Morris Nebojsa Jojic 28 108 0 17 Jun 2021
Poisoning and Backdooring Contrastive Learning Nicholas Carlini Andreas Terzis 46 158 0 17 Jun 2021
Towards Understanding Deep Learning from Noisy Labels with Small-Loss Criterion Xian-Jin Gui Wei Wang Zhang-Hao Tian NoLa 33 45 0 17 Jun 2021
Uniform Convergence of Interpolators: Gaussian Width, Norm Bounds, and Benign Overfitting Frederic Koehler Lijia Zhou Danica J. Sutherland Nathan Srebro 32 56 0 17 Jun 2021
A Winning Hand: Compressing Deep Networks Can Improve Out-Of-Distribution Robustness James Diffenderfer Brian Bartoldson Shreya Chaganti Jize Zhang B. Kailkhura OOD 31 69 0 16 Jun 2021
How to Train Your Wide Neural Network Without Backprop: An Input-Weight Alignment Perspective Akhilan Boopathy Ila Fiete 44 9 0 15 Jun 2021
What Context Features Can Transformer Language Models Use? J. O'Connor Jacob Andreas KELM 29 75 0 15 Jun 2021