Understanding deep learning requires rethinking generalization

10 November 2016

Benjamin Recht

Papers citing "Understanding deep learning requires rethinking generalization"

50 / 1,045 papers shown

Title
Understanding Contrastive Learning Requires Incorporating Inductive Biases Nikunj Saunshi Jordan T. Ash Surbhi Goel Dipendra Kumar Misra Cyril Zhang Sanjeev Arora Sham Kakade A. Krishnamurthy SSL 27 109 0 28 Feb 2022
The Spectral Bias of Polynomial Neural Networks Moulik Choraria L. Dadi Grigorios G. Chrysos Julien Mairal V. Cevher 24 18 0 27 Feb 2022
Benign Underfitting of Stochastic Gradient Descent Tomer Koren Roi Livni Yishay Mansour Uri Sherman MLT 22 13 0 27 Feb 2022
Adversarial robustness of sparse local Lipschitz predictors Ramchandran Muthukumar Jeremias Sulam AAML 34 13 0 26 Feb 2022
ASSIST: Towards Label Noise-Robust Dialogue State Tracking Fanghua Ye Yue Feng Emine Yilmaz 21 21 0 26 Feb 2022
Benefit of Interpolation in Nearest Neighbor Algorithms Yue Xing Qifan Song Guang Cheng 17 28 0 23 Feb 2022
On PAC-Bayesian reconstruction guarantees for VAEs Badr-Eddine Chérief-Abdellatif Yuyang Shi Arnaud Doucet Benjamin Guedj DRL 53 17 0 23 Feb 2022
Random Feature Amplification: Feature Learning and Generalization in Neural Networks Spencer Frei Niladri S. Chatterji Peter L. Bartlett MLT 32 29 0 15 Feb 2022
Information-Theoretic Analysis of Minimax Excess Risk Hassan Hafez-Kolahi Behrad Moniri S. Kasaei 17 4 0 15 Feb 2022
Generalisation and the Risk--Entropy Curve Dominic Belcher Antonia Marcu Adam Prugel-Bennett 21 0 0 15 Feb 2022
Holistic Adversarial Robustness of Deep Learning Models Pin-Yu Chen Sijia Liu AAML 51 16 0 15 Feb 2022
On the Origins of the Block Structure Phenomenon in Neural Network Representations Thao Nguyen M. Raghu Simon Kornblith 30 14 0 15 Feb 2022
Evolving Neural Networks with Optimal Balance between Information Flow and Connections Cost A. Khalili A. Bouchachia 17 0 0 12 Feb 2022
The no-free-lunch theorems of supervised learning T. Sterkenburg Peter Grünwald FedML 24 56 0 09 Feb 2022
A Survey on Poisoning Attacks Against Supervised Machine Learning Wenjun Qiu AAML 36 9 0 05 Feb 2022
Learning with Neighbor Consistency for Noisy Labels Ahmet Iscen Jack Valmadre Anurag Arnab Cordelia Schmid NoLa 41 75 0 04 Feb 2022
Non-Vacuous Generalisation Bounds for Shallow Neural Networks Felix Biggs Benjamin Guedj BDL 30 26 0 03 Feb 2022
On Regularizing Coordinate-MLPs Sameera Ramasinghe L. MacDonald Simon Lucey 158 5 0 01 Feb 2022
Deep Layer-wise Networks Have Closed-Form Weights Chieh-Tsai Wu A. Masoomi Arthur Gretton Jennifer Dy 31 3 0 01 Feb 2022
Datamodels: Predicting Predictions from Training Data Andrew Ilyas Sung Min Park Logan Engstrom Guillaume Leclerc A. Madry TDI 52 131 0 01 Feb 2022
Backdoors Stuck At The Frontdoor: Multi-Agent Backdoor Attacks That Backfire Siddhartha Datta N. Shadbolt AAML 38 7 0 28 Jan 2022
Interplay between depth of neural networks and locality of target functions Takashi Mori Masakuni Ueda 25 0 0 28 Jan 2022
Improved Overparametrization Bounds for Global Convergence of Stochastic Gradient Descent for Shallow Neural Networks Bartlomiej Polaczyk J. Cyranka ODL 35 3 0 28 Jan 2022
Implicit Regularization in Hierarchical Tensor Factorization and Deep Convolutional Neural Networks Noam Razin Asaf Maman Nadav Cohen 49 29 0 27 Jan 2022
PiCO+: Contrastive Label Disambiguation for Robust Partial Label Learning Haobo Wang Rui Xiao Yixuan Li Lei Feng Gang Niu Gang Chen Jun Zhao VLM 51 25 0 22 Jan 2022
Low-Pass Filtering SGD for Recovering Flat Optima in the Deep Learning Optimization Landscape Devansh Bisla Jing Wang A. Choromańska 27 34 0 20 Jan 2022
Caring Without Sharing: A Federated Learning Crowdsensing Framework for Diversifying Representation of Cities Mi-Gyoung Cho A. Mashhadi FedML 39 1 0 20 Jan 2022
BLINC: Lightweight Bimodal Learning for Low-Complexity VVC Intra Coding Farhad Pakdaman Mohammad Ali Adelimanesh M. Hashemi 19 3 0 19 Jan 2022
Overview frequency principle/spectral bias in deep learning Z. Xu Tao Luo Yaoyu Zhang FaML 35 66 0 19 Jan 2022
Towards Adversarial Evaluations for Inexact Machine Unlearning Shashwat Goel Ameya Prabhu Amartya Sanyal Ser-Nam Lim Philip Torr Ponnurangam Kumaraguru AAML ELM MU 48 50 0 17 Jan 2022
Neighborhood Region Smoothing Regularization for Finding Flat Minima In Deep Neural Networks Yang Zhao Hao Zhang 24 2 0 16 Jan 2022
Transferability in Deep Learning: A Survey Junguang Jiang Yang Shu Jianmin Wang Mingsheng Long OOD 34 101 0 15 Jan 2022
Model Stability with Continuous Data Updates Huiting Liu Avinesh P.V.S Siddharth Patwardhan Peter Grasch Sachin Agarwal 32 16 0 14 Jan 2022
Reconstructing Training Data with Informed Adversaries Borja Balle Giovanni Cherubin Jamie Hayes MIACV AAML 50 159 0 13 Jan 2022
Implicit Bias of MSE Gradient Optimization in Underparameterized Neural Networks Benjamin Bowman Guido Montúfar 28 11 0 12 Jan 2022
Stability Based Generalization Bounds for Exponential Family Langevin Dynamics A. Banerjee Tiancong Chen Xinyan Li Yingxue Zhou 34 8 0 09 Jan 2022
Separation of Scales and a Thermodynamic Description of Feature Learning in Some CNNs Inbar Seroussi Gadi Naveh Zohar Ringel 37 51 0 31 Dec 2021
Benign Overfitting in Adversarially Robust Linear Classification Jinghui Chen Yuan Cao Quanquan Gu AAML SILM 34 10 0 31 Dec 2021
Efficient Diversity-Driven Ensemble for Deep Neural Networks Wentao Zhang Jiawei Jiang Yingxia Shao Bin Cui 32 17 0 26 Dec 2021
Over-Parametrized Matrix Factorization in the Presence of Spurious Stationary Points Armin Eftekhari 24 1 0 25 Dec 2021
Robust Neural Network Classification via Double Regularization Olof Zetterqvist Rebecka Jörnsten J. Jonasson 13 1 0 15 Dec 2021
On the Impact of Hard Adversarial Instances on Overfitting in Adversarial Training Chen Liu Zhichao Huang Mathieu Salzmann Tong Zhang Sabine Süsstrunk AAML 23 13 0 14 Dec 2021
Deep Translation Prior: Test-time Training for Photorealistic Style Transfer Sunwoo Kim Soohyun Kim Seungryong Kim 24 13 0 12 Dec 2021
A generalization gap estimation for overparameterized models via the Langevin functional variance Akifumi Okuno Keisuke Yano 50 1 0 07 Dec 2021
Multi-scale Feature Learning Dynamics: Insights for Double Descent Mohammad Pezeshki Amartya Mitra Yoshua Bengio Guillaume Lajoie 61 25 0 06 Dec 2021
Protecting Intellectual Property of Language Generation APIs with Lexical Watermark Xuanli He Qiongkai Xu Lingjuan Lyu Fangzhao Wu Chenguang Wang WaLM 177 95 0 05 Dec 2021
Hard Sample Aware Noise Robust Learning for Histopathology Image Classification Chuang Zhu Wenkai Chen T. Peng Ying Wang M. Jin NoLa 34 72 0 05 Dec 2021
Construct Informative Triplet with Two-stage Hard-sample Generation Chuang Zhu Zheng Hu Huihui Dong Gang He Zekuan Yu Shangshang Zhang 36 3 0 04 Dec 2021
Novel Class Discovery in Semantic Segmentation Yuyang Zhao Zhun Zhong N. Sebe G. Lee 30 27 0 03 Dec 2021
Learning Curves for Continual Learning in Neural Networks: Self-Knowledge Transfer and Forgetting Ryo Karakida S. Akaho CLL 32 11 0 03 Dec 2021