Investigating Generalization by Controlling Normalized Margin

Investigating Generalization by Controlling Normalized Margin

8 May 2022

Alexander R. Farhang

Jeremy Bernstein

Kushal Tirumala

Yang Liu

Papers citing "Investigating Generalization by Controlling Normalized Margin"

8 / 8 papers shown

Title
Bias of Stochastic Gradient Descent or the Architecture: Disentangling the Effects of Overparameterization of Neural Networks Amit Peleg Matthias Hein 16 0 0 04 Jul 2024
Do deep neural networks have an inbuilt Occam's razor? Chris Mingard Henry Rees Guillermo Valle Pérez A. Louis UQCV BDL 19 15 0 13 Apr 2023
Automatic Gradient Descent: Deep Learning without Hyperparameters Jeremy Bernstein Chris Mingard Kevin Huang Navid Azizan Yisong Yue ODL 11 17 0 11 Apr 2023
Optimisation & Generalisation in Networks of Neurons Jeremy Bernstein AI4CE 13 2 0 18 Oct 2022
Learning by Turning: Neural Architecture Aware Optimisation Yang Liu Jeremy Bernstein M. Meister Yisong Yue ODL 39 26 0 14 Feb 2021
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles Balaji Lakshminarayanan Alexander Pritzel Charles Blundell UQCV BDL 268 5,635 0 05 Dec 2016
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 273 2,878 0 15 Sep 2016
Norm-Based Capacity Control in Neural Networks Behnam Neyshabur Ryota Tomioka Nathan Srebro 111 577 0 27 Feb 2015