Cubic Regularization with Momentum for Nonconvex Optimization

v1v2 (latest)

Cubic Regularization with Momentum for Nonconvex Optimization

9 October 2018

Zhe Wang

ArXiv (abs)PDF HTML

Papers citing "Cubic Regularization with Momentum for Nonconvex Optimization"

12 / 12 papers shown

Title
Improving Stochastic Cubic Newton with Momentum El Mahdi Chayti N. Doikov Martin Jaggi ODL 50 0 0 25 Oct 2024
Series of Hessian-Vector Products for Tractable Saddle-Free Newton Optimisation of Neural Networks E. T. Oldewage Ross M. Clarke José Miguel Hernández-Lobato ODL 47 1 0 23 Oct 2023
A Momentum Accelerated Adaptive Cubic Regularization Method for Nonconvex Optimization Yihang Gao Michael K. Ng 38 2 0 12 Oct 2022
Approximate Secular Equations for the Cubic Regularization Subproblem Yihang Gao Man-Chung Yue Michael K. Ng 18 1 0 27 Sep 2022
Low-rank Tensor Learning with Nonconvex Overlapped Nuclear Norm Regularization Quanming Yao Yaqing Wang Bo Han James T. Kwok 71 2 0 06 May 2022
GT-STORM: Taming Sample, Communication, and Memory Complexities in Decentralized Non-Convex Learning Xin Zhang Jia Liu Zhengyuan Zhu Elizabeth S. Bentley 84 14 0 04 May 2021
Escaping Saddle Points in Distributed Newton's Method with Communication Efficiency and Byzantine Resilience Avishek Ghosh R. Maity A. Mazumdar Kannan Ramchandran FedML 54 5 0 17 Mar 2021
Recent Theoretical Advances in Non-Convex Optimization Marina Danilova Pavel Dvurechensky Alexander Gasnikov Eduard A. Gorbunov Sergey Guminov Dmitry Kamzolov Innokentiy Shibaev 129 79 0 11 Dec 2020
Combining Stochastic Adaptive Cubic Regularization with Negative Curvature for Nonconvex Optimization Seonho Park Seung Hyun Jung P. Pardalos ODL 72 15 0 27 Jun 2019
Convex-Concave Backtracking for Inertial Bregman Proximal Gradient Algorithms in Non-Convex Optimization Mahesh Chandra Mukkamala Peter Ochs Thomas Pock Shoham Sabach 47 52 0 06 Apr 2019
Momentum Schemes with Stochastic Variance Reduction for Nonconvex Composite Optimization Yi Zhou Zhe Wang Kaiyi Ji Yingbin Liang Vahid Tarokh ODL 82 14 0 07 Feb 2019
Stochastic Variance-Reduced Cubic Regularization for Nonconvex Optimization Zhe Wang Yi Zhou Yingbin Liang Guanghui Lan 76 48 0 20 Feb 2018