On the Local Minima of the Empirical Risk

v1v2 (latest)

On the Local Minima of the Empirical Risk

25 March 2018

Michael I. Jordan

ArXiv (abs)PDF HTML

Papers citing "On the Local Minima of the Empirical Risk"

17 / 17 papers shown

Title
Zeroth-Order Negative Curvature Finding: Escaping Saddle Points without Gradients Hualin Zhang Huan Xiong Bin Gu 87 9 0 04 Oct 2022
On Quantum Speedups for Nonconvex Optimization via Quantum Tunneling Walks Yizhou Liu Weijie J. Su Tongyang Li 86 18 0 29 Sep 2022
Tackling benign nonconvexity with smoothing and stochastic gradients Harsh Vardhan Sebastian U. Stich 91 8 0 18 Feb 2022
Stochasticity of Deterministic Gradient Descent: Large Learning Rate for Multiscale Objective Function Lingkai Kong Molei Tao 49 23 0 14 Feb 2020
Efficiently avoiding saddle points with zero order methods: No gradients required Lampros Flokas Emmanouil-Vasileios Vlatakis-Gkaragkounis Georgios Piliouras 70 34 0 29 Oct 2019
Statistical Analysis of Stationary Solutions of Coupled Nonconvex Nonsmooth Empirical Risk Minimization Zhengling Qi Ying Cui Yufeng Liu J. Pang 92 5 0 06 Oct 2019
Escaping Saddle Points for Zeroth-order Nonconvex Optimization using Estimated Gradient Descent Qinbo Bai Mridul Agarwal Vaneet Aggarwal 25 7 0 03 Oct 2019
Towards Understanding the Importance of Noise in Training Neural Networks Mo Zhou Tianyi Liu Yan Li Dachao Lin Enlu Zhou T. Zhao MLT 84 26 0 07 Sep 2019
Solving Empirical Risk Minimization in the Current Matrix Multiplication Time Y. Lee Zhao Song Qiuyi Zhang 104 117 0 11 May 2019
Towards moderate overparameterization: global convergence guarantees for training shallow neural networks Samet Oymak Mahdi Soltanolkotabi 61 323 0 12 Feb 2019
Asymmetric Valleys: Beyond Sharp and Flat Local Minima Haowei He Gao Huang Yang Yuan ODL MLT 79 150 0 02 Feb 2019
Sharp Analysis for Nonconvex SGD Escaping from Saddle Points Cong Fang Zhouchen Lin Tong Zhang 85 104 0 01 Feb 2019
Quasi-potential as an implicit regularizer for the loss function in the stochastic gradient descent Wenqing Hu Zhanxing Zhu Haoyi Xiong Jun Huan MLT 51 10 0 18 Jan 2019
Cubic Regularization with Momentum for Nonconvex Optimization Zhe Wang Yi Zhou Yingbin Liang Guanghui Lan 57 26 0 09 Oct 2018
Defending Against Saddle Point Attack in Byzantine-Robust Distributed Learning Dong Yin Yudong Chen Kannan Ramchandran Peter L. Bartlett FedML 123 100 0 14 Jun 2018
Optimization of Smooth Functions with Noisy Observations: Local Minimax Rates Yining Wang Sivaraman Balakrishnan Aarti Singh 54 25 0 22 Mar 2018
A Likelihood-Free Inference Framework for Population Genetic Data using Exchangeable Neural Networks Jeffrey Chan Valerio Perrone J. Spence Paul A. Jenkins Sara Mathieson Yun S. Song 333 109 0 16 Feb 2018