Negative eigenvalues of the Hessian in deep neural networks

Negative eigenvalues of the Hessian in deep neural networks

6 February 2019

Guillaume Alain

Nicolas Le Roux

Pierre-Antoine Manzagol

Papers citing "Negative eigenvalues of the Hessian in deep neural networks"

8 / 8 papers shown

Title
Nesterov acceleration in benignly non-convex landscapes Kanan Gupta Stephan Wojtowytsch 36 2 0 10 Oct 2024
Escaping Saddle Points for Effective Generalization on Class-Imbalanced Data Harsh Rangwani Sumukh K Aithal Mayank Mishra R. Venkatesh Babu 31 28 0 28 Dec 2022
Improving Robust Generalization by Direct PAC-Bayesian Bound Minimization Zifa Wang Nan Ding Tomer Levinboim Xi Chen Radu Soricut AAML 35 5 0 22 Nov 2022
Diffusion Curvature for Estimating Local Curvature in High Dimensional Data Dhananjay Bhaskar Kincaid MacDonald O. Fasina Dawson Thomas Bastian Alexander Rieck Ian M. Adelstein Smita Krishnaswamy DiffM 25 7 0 08 Jun 2022
The Break-Even Point on Optimization Trajectories of Deep Neural Networks Stanislaw Jastrzebski Maciej Szymczak Stanislav Fort Devansh Arpit Jacek Tabor Kyunghyun Cho Krzysztof J. Geras 47 154 0 21 Feb 2020
Low Rank Saddle Free Newton: A Scalable Method for Stochastic Nonconvex Optimization Thomas O'Leary-Roseberry Nick Alger Omar Ghattas ODL 31 9 0 07 Feb 2020
Interpreting Adversarial Robustness: A View from Decision Surface in Input Space Fuxun Yu Chenchen Liu Yanzhi Wang Liang Zhao Xiang Chen AAML OOD 31 27 0 29 Sep 2018
The Loss Surfaces of Multilayer Networks A. Choromańska Mikael Henaff Michaël Mathieu Gerard Ben Arous Yann LeCun ODL 179 1,185 0 30 Nov 2014