Finding Local Minima via Stochastic Nested Variance Reduction

Finding Local Minima via Stochastic Nested Variance Reduction

22 June 2018

Quanquan Gu

ArXiv (abs)PDF HTML

Papers citing "Finding Local Minima via Stochastic Nested Variance Reduction"

16 / 16 papers shown

Title
Gradient Normalization Provably Benefits Nonconvex SGD under Heavy-Tailed Noise Tao Sun Xinwang Liu Kun Yuan 159 6 0 21 Oct 2024
Rethinking SIGN Training: Provable Nonconvex Acceleration without First- and Second-Order Gradient Lipschitz Tao Sun Congliang Chen Peng Qiao Li Shen Xinwang Liu Dongsheng Li 113 5 0 23 Oct 2023
Cyclic Block Coordinate Descent With Variance Reduction for Composite Nonconvex Optimization Xu Cai Chaobing Song Stephen J. Wright Jelena Diakonikolas 115 16 0 09 Dec 2022
Simple and Optimal Stochastic Gradient Methods for Nonsmooth Nonconvex Optimization Zhize Li Jian Li 147 8 0 22 Aug 2022
Stochastic Halpern Iteration with Variance Reduction for Stochastic Monotone Inclusions Xu Cai Chaobing Song Cristóbal Guzmán Jelena Diakonikolas 189 11 0 17 Mar 2022
Escape saddle points by a simple gradient-descent based algorithm Chenyi Zhang Tongyang Li ODL 92 15 0 28 Nov 2021
Escaping Saddle Points with Compressed SGD Dmitrii Avdiukhin G. Yaroslavtsev 106 4 0 21 May 2021
Escaping Saddle Points with Stochastically Controlled Stochastic Gradient Methods Guannan Liang Qianqian Tong Chunjiang Zhu J. Bi 152 3 0 07 Mar 2021
Sample Complexity of Policy Gradient Finding Second-Order Stationary Points Long Yang Qian Zheng Gang Pan 135 25 0 02 Dec 2020
Escape saddle points faster on manifolds via perturbed Riemannian stochastic recursive gradient Andi Han Junbin Gao 93 5 0 23 Oct 2020
Sample Efficient Policy Gradient Methods with Recursive Variance Reduction Pan Xu F. Gao Quanquan Gu 165 92 0 18 Sep 2019
Stabilized SVRG: Simple Variance Reduction for Nonconvex Optimization Rong Ge Zhize Li Weiyao Wang Xiang Wang 78 36 0 01 May 2019
SSRGD: Simple Stochastic Recursive Gradient Descent for Escaping Saddle Points Zhize Li 120 42 0 19 Apr 2019
Sharp Analysis for Nonconvex SGD Escaping from Saddle Points Cong Fang Zhouchen Lin Tong Zhang 142 104 0 01 Feb 2019
Stochastic Recursive Variance-Reduced Cubic Regularization Methods Dongruo Zhou Quanquan Gu 148 27 0 31 Jan 2019
SPIDER: Near-Optimal Non-Convex Optimization via Stochastic Path Integrated Differential Estimator Cong Fang C. J. Li Zhouchen Lin Tong Zhang 264 603 0 04 Jul 2018