Exploring Generalization in Deep Learning

Exploring Generalization in Deep Learning

27 June 2017

Behnam Neyshabur

Srinadh Bhojanapalli

David A. McAllester

Papers citing "Exploring Generalization in Deep Learning"

13 / 313 papers shown

Title
Non-Vacuous Generalization Bounds at the ImageNet Scale: A PAC-Bayesian Compression Approach Wenda Zhou Victor Veitch Morgane Austern Ryan P. Adams Peter Orbanz 32 209 0 16 Apr 2018
Data-Dependent Coresets for Compressing Neural Networks with Applications to Generalization Bounds Cenk Baykal Lucas Liebenwein Igor Gilitschenski Dan Feldman Daniela Rus 17 79 0 15 Apr 2018
On the importance of single directions for generalization Ari S. Morcos David Barrett Neil C. Rabinowitz M. Botvinick 13 328 0 19 Mar 2018
Structural Agnostic Modeling: Adversarial Learning of Causal Graphs Diviyan Kalainathan Olivier Goudet Isabelle M Guyon David Lopez-Paz Michèle Sebag CML 24 93 0 13 Mar 2018
A Walk with SGD Chen Xing Devansh Arpit Christos Tsirigotis Yoshua Bengio 19 118 0 24 Feb 2018
Stronger generalization bounds for deep nets via a compression approach Sanjeev Arora Rong Ge Behnam Neyshabur Yi Zhang MLT AI4CE 21 630 0 14 Feb 2018
Fix your classifier: the marginal value of training the last weight layer Elad Hoffer Itay Hubara Daniel Soudry 29 101 0 14 Jan 2018
Visualizing the Loss Landscape of Neural Nets Hao Li Zheng Xu Gavin Taylor Christoph Studer Tom Goldstein 74 1,844 0 28 Dec 2017
Entropy-SGD optimizes the prior of a PAC-Bayes bound: Generalization properties of Entropy-SGD and data-dependent priors Gintare Karolina Dziugaite Daniel M. Roy MLT 25 144 0 26 Dec 2017
Certifying Some Distributional Robustness with Principled Adversarial Training Aman Sinha Hongseok Namkoong Riccardo Volpi John C. Duchi OOD 38 854 0 29 Oct 2017
SGD Learns Over-parameterized Networks that Provably Generalize on Linearly Separable Data Alon Brutzkus Amir Globerson Eran Malach Shai Shalev-Shwartz MLT 39 276 0 27 Oct 2017
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 284 2,889 0 15 Sep 2016
Norm-Based Capacity Control in Neural Networks Behnam Neyshabur Ryota Tomioka Nathan Srebro 119 577 0 27 Feb 2015