Stochastic Recursive Variance-Reduced Cubic Regularization Methods

v1v2 (latest)

Stochastic Recursive Variance-Reduced Cubic Regularization Methods

31 January 2019

Quanquan Gu

ArXiv (abs)PDF HTML

Papers citing "Stochastic Recursive Variance-Reduced Cubic Regularization Methods"

17 / 17 papers shown

Title
Noise is All You Need: Private Second-Order Convergence of Noisy SGD Dmitrii Avdiukhin Michael Dinitz Chenglin Fan G. Yaroslavtsev 117 1 0 09 Oct 2024
Efficiently Escaping Saddle Points for Non-Convex Policy Optimization Sadegh Khorasani Saber Salehkaleybar Negar Kiyavash Niao He Matthias Grossglauser 72 1 0 15 Nov 2023
How to escape sharp minima with random perturbations Kwangjun Ahn Ali Jadbabaie S. Sra ODL 189 10 0 25 May 2023
Faster Riemannian Newton-type Optimization by Subsampling and Cubic Regularization Yian Deng Tingting Mu 78 1 0 22 Feb 2023
HOUDINI: Escaping from Moderately Constrained Saddles Dmitrii Avdiukhin G. Yaroslavtsev 114 0 0 27 May 2022
Stochastic Second-Order Methods Improve Best-Known Sample Complexity of SGD for Gradient-Dominated Function Saeed Masiha Saber Salehkaleybar Niao He Negar Kiyavash Patrick Thiran 178 19 0 25 May 2022
Escape saddle points by a simple gradient-descent based algorithm Chenyi Zhang Tongyang Li ODL 88 15 0 28 Nov 2021
Escaping Saddle Points with Compressed SGD Dmitrii Avdiukhin G. Yaroslavtsev 106 4 0 21 May 2021
On the Oracle Complexity of Higher-Order Smooth Non-Convex Finite-Sum Optimization N. Emmenegger Rasmus Kyng Ahad N. Zehmakan 96 3 0 08 Mar 2021
Recent Theoretical Advances in Non-Convex Optimization Marina Danilova Pavel Dvurechensky Alexander Gasnikov Eduard A. Gorbunov Sergey Guminov Dmitry Kamzolov Innokentiy Shibaev 177 89 0 11 Dec 2020
Escaping Saddle-Points Faster under Interpolation-like Conditions Abhishek Roy Krishnakumar Balasubramanian Saeed Ghadimi P. Mohapatra 107 1 0 28 Sep 2020
Quantum algorithms for escaping from saddle points Chenyi Zhang Jiaqi Leng Tongyang Li 177 23 0 20 Jul 2020
GO Hessian for Expectation-Based Objectives Yulai Cong Miaoyun Zhao Jianqiao Li Junya Chen Lawrence Carin 66 0 0 16 Jun 2020
Stochastic Newton and Cubic Newton Methods with Simple Local Linear-Quadratic Rates D. Kovalev Konstantin Mishchenko Peter Richtárik ODL 118 47 0 03 Dec 2019
A Hybrid Stochastic Optimization Framework for Stochastic Composite Nonconvex Optimization Quoc Tran-Dinh Nhan H. Pham T. Dzung Lam M. Nguyen 117 55 0 08 Jul 2019
Accelerating Mini-batch SARAH by Step Size Rules Zhuang Yang Zengping Chen Cheng-Yu Wang 154 15 0 20 Jun 2019
Sharp Analysis for Nonconvex SGD Escaping from Saddle Points Cong Fang Zhouchen Lin Tong Zhang 142 104 0 01 Feb 2019