An empirical analysis of the optimization of deep network loss surfaces

13 December 2016

Papers citing "An empirical analysis of the optimization of deep network loss surfaces"

9 / 9 papers shown

Title
On-the-Fly Guidance Training for Medical Image Registration Yuelin Xin Yicheng Chen Shengxiang Ji Kun Han Xiaohui Xie OOD 27 1 0 29 Aug 2023
Bidirectional Looking with A Novel Double Exponential Moving Average to Adaptive and Non-adaptive Momentum Optimizers Yineng Chen Z. Li Lefei Zhang Bo Du Hai Zhao 25 4 0 02 Jul 2023
Parameter Efficient Training of Deep Convolutional Neural Networks by Dynamic Sparse Reparameterization Hesham Mostafa Xin Wang 29 307 0 15 Feb 2019
Implicit Self-Regularization in Deep Neural Networks: Evidence from Random Matrix Theory and Implications for Learning Charles H. Martin Michael W. Mahoney AI4CE 21 190 0 02 Oct 2018
How Does Batch Normalization Help Optimization? Shibani Santurkar Dimitris Tsipras Andrew Ilyas A. Madry ODL 13 1,521 0 29 May 2018
Quantitatively Evaluating GANs With Divergences Proposed for Training Daniel Jiwoong Im He Ma Graham W. Taylor K. Branson EGVM 19 69 0 02 Mar 2018
Visualizing the Loss Landscape of Neural Nets Hao Li Zheng Xu Gavin Taylor Christoph Studer Tom Goldstein 60 1,842 0 28 Dec 2017
Sharp Minima Can Generalize For Deep Nets Laurent Dinh Razvan Pascanu Samy Bengio Yoshua Bengio ODL 30 754 0 15 Mar 2017
The Loss Surfaces of Multilayer Networks A. Choromańska Mikael Henaff Michaël Mathieu Gerard Ben Arous Yann LeCun ODL 179 1,185 0 30 Nov 2014