Convergence Analysis of Proximal Gradient with Momentum for Nonconvex Optimization

14 May 2017

Papers citing "Convergence Analysis of Proximal Gradient with Momentum for Nonconvex Optimization"

37 / 37 papers shown

Title
Federated Online Learning for Heterogeneous Multisource Streaming Data Jingmao Li Yuanxing Chen Shuangge Ma Kuangnan Fang FedML 36 0 0 08 Aug 2025
Graph Regularized NMF with L20-norm for Unsupervised Feature Learning Zhen Wang Wenwen Min 55 3 0 16 Mar 2024
$Globally Convergent Accelerated Algorithms for Multilinear Sparse Logistic Regression with $\ell_0$-constraints$ Globally Convergent Accelerated Algorithms for Multilinear Sparse Logistic Regression with $\ell_0$ -constraintsInternational Conference on Intelligent Computing (ICIC), 2023 Weifeng Yang Wenwen Min 73 0 0 17 Sep 2023
An Accelerated Block Proximal Framework with Adaptive Momentum for Nonconvex and Nonsmooth Optimization Weifeng Yang Wenwen Min 59 1 0 23 Aug 2023
Projective Proximal Gradient Descent for A Class of Nonconvex Nonsmooth Optimization Problems: Fast Convergence Without Kurdyka-Lojasiewicz (KL) Property Yingzhen Yang P. Li 73 3 0 20 Apr 2023
A Survey on Efficient Training of TransformersInternational Joint Conference on Artificial Intelligence (IJCAI), 2023 Bohan Zhuang Jing Liu Zizheng Pan Haoyu He Yuetian Weng Chunhua Shen 246 64 0 02 Feb 2023
Bayesian Learning of Parameterised Quantum Circuits Samuel Duffield Marcello Benedetti Matthias Rosenkranz 114 13 0 15 Jun 2022
Low-rank Tensor Learning with Nonconvex Overlapped Nuclear Norm RegularizationJournal of machine learning research (JMLR), 2022 Quanming Yao Yaqing Wang Bo Han James T. Kwok 125 3 0 06 May 2022
A Fast and Convergent Proximal Algorithm for Regularized Nonconvex and Nonsmooth Bi-level Optimization Ziyi Chen B. Kailkhura Yi Zhou 137 10 0 30 Mar 2022
$Restarted Nonconvex Accelerated Gradient Descent: No More Polylogarithmic Factor in the $O(ε^{-7/4})$ Complexity$ Restarted Nonconvex Accelerated Gradient Descent: No More Polylogarithmic Factor in the $O(ε^{-7/4})$ ComplexityInternational Conference on Machine Learning (ICML), 2022 Huan Li Zhouchen Lin 195 28 0 27 Jan 2022
Accelerated Proximal Alternating Gradient-Descent-Ascent for Nonconvex Minimax Machine LearningInternational Symposium on Information Theory (ISIT), 2021 Ziyi Chen Shaocong Ma Yi Zhou 349 10 0 22 Dec 2021
Unified Group Fairness on Federated Learning Tai-wei Chang Kun Kuang Yuxuan Liu Long Chen Chao-Xiang Wu Leilei Gan Jiaxun Lu Yunfeng Shao Jun Xiao FedML 257 20 0 09 Nov 2021
TAG: Task-based Accumulated Gradients for Lifelong learning Pranshu Malviya B. Ravindran Sarath Chandar CLL 169 5 0 11 May 2021
Structured Sparse Non-negative Matrix Factorization with L20-Norm for scRNA-seq Data Analysis Wenwen Min Taosheng Xu Xiang Wan Tsung-Hui Chang 54 2 0 27 Apr 2021
Proximal Gradient Descent-Ascent: Variable Convergence under KŁ GeometryInternational Conference on Learning Representations (ICLR), 2021 Ziyi Chen Yi Zhou Tengyu Xu Yingbin Liang 222 37 0 09 Feb 2021
Learning Graph Neural Networks with Approximate Gradient DescentAAAI Conference on Artificial Intelligence (AAAI), 2020 Qunwei Li Shaofeng Zou Leon Wenliang Zhong GNN 238 1 0 07 Dec 2020
Momentum with Variance Reduction for Nonconvex Composition Optimization Ziyi Chen Yi Zhou ODL 109 3 0 15 May 2020
Proximal Gradient Algorithm with Momentum and Flexible Parameter Restart for Nonconvex OptimizationInternational Joint Conference on Artificial Intelligence (IJCAI), 2020 Yi Zhou Zhe Wang Kaiyi Ji Yingbin Liang Vahid Tarokh 109 9 0 26 Feb 2020
Convergence Analysis of a Momentum Algorithm with Adaptive Step Size for Non Convex Optimization Anas Barakat Pascal Bianchi 130 12 0 18 Nov 2019
Investigating Task-driven Latent Feasibility for Nonconvex Image ModelingIEEE Transactions on Image Processing (TIP), 2019 Risheng Liu Pan Mu Jian Chen Xin-Yue Fan Zhongxuan Luo 163 25 0 18 Oct 2019
DEAM: Adaptive Momentum with Discriminative Weight for Stochastic OptimizationInternational Conference on Advances in Social Networks Analysis and Mining (ASONAM), 2019 Jiyang Bai Yuxiang Ren Jiawei Zhang ODL 135 1 0 25 Jul 2019
Tensor p-shrinkage nuclear norm for low-rank tensor completion Chunsheng Liu Hong Shan Chunlei Chen 85 24 0 09 Jul 2019
Momentum Schemes with Stochastic Variance Reduction for Nonconvex Composite Optimization Yi Zhou Zhe Wang Kaiyi Ji Yingbin Liang Vahid Tarokh ODL 106 14 0 07 Feb 2019
Asynchronous Delay-Aware Accelerated Proximal Coordinate Descent for Nonconvex Nonsmooth Problems Ehsan Kazemi Liqiang Wang 61 2 0 05 Feb 2019
SGD Converges to Global Minimum in Deep Learning via Star-convex Path Yi Zhou Junjie Yang Huishuai Zhang Yingbin Liang Vahid Tarokh 172 78 0 02 Jan 2019
A Block Coordinate Descent Proximal Method for Simultaneous Filtering and Parameter Estimation Ramin Raziperchikolaei Harish S. Bhat 82 5 0 16 Oct 2018
Cubic Regularization with Momentum for Nonconvex Optimization Zhe Wang Yi Zhou Yingbin Liang Guanghui Lan 90 27 0 09 Oct 2018
Convergence of Cubic Regularization for Nonconvex Optimization under KL Property Yi Zhou Zhe Wang Yingbin Liang 108 23 0 22 Aug 2018
On the Convergence of Learning-based Iterative Methods for Nonconvex Inverse Problems Risheng Liu Shichao Cheng Yi He Xin-Yue Fan Zhouchen Lin Zhongxuan Luo 113 72 0 16 Aug 2018
Learning Collaborative Generation Correction Modules for Blind Image Deblurring and Beyond Risheng Liu Yi He Shichao Cheng Xin-Yue Fan Zhongxuan Luo 84 18 0 31 Jul 2018
FasTer: Fast Tensor Completion with Nonconvex Regularization Quanming Yao James T. Kwok Bo Han 114 1 0 23 Jul 2018
Stochastic Nested Variance Reduction for Nonconvex Optimization Dongruo Zhou Pan Xu Quanquan Gu 199 156 0 20 Jun 2018
Stochastic Variance-Reduced Cubic Regularization for Nonconvex Optimization Zhe Wang Yi Zhou Yingbin Liang Guanghui Lan 103 50 0 20 Feb 2018
Generalization Error Bounds with Probabilistic Guarantee for SGD in Nonconvex Optimization Yi Zhou Yingbin Liang Huishuai Zhang MLT 113 27 0 19 Feb 2018
A Simple Proximal Stochastic Gradient Method for Nonsmooth Nonconvex Optimization Zhize Li Jian Li 202 124 0 13 Feb 2018
Accelerated Block Coordinate Proximal Gradients with Applications in High Dimensional Statistics T. K. Lau Yuan Yao 127 2 0 15 Oct 2017
Nonconvex Sparse Logistic Regression with Weakly Convex RegularizationIEEE Transactions on Signal Processing (IEEE TSP), 2017 Xinyue Shen Yuantao Gu 148 33 0 07 Aug 2017