Improved Zeroth-Order Variance Reduced Algorithms and Analysis for Nonconvex Optimization

27 October 2019

Papers citing "Improved Zeroth-Order Variance Reduced Algorithms and Analysis for Nonconvex Optimization"

25 / 25 papers shown

Title
A Structured Tour of Optimization with Finite Differences Marco Rando C. Molinari Lorenzo Rosasco S. Villa 171 0 0 26 May 2025
ElasticZO: A Memory-Efficient On-Device Learning with Combined Zeroth- and First-Order Optimization Keisuke Sugiura Hiroki Matsutani MQ 71 2 0 08 Jan 2025
Gradient-Free Method for Heavily Constrained Nonconvex Optimization Wanli Shi Hongchang Gao Bin Gu 86 5 0 31 Aug 2024
Zeroth-Order Stochastic Mirror Descent Algorithms for Minimax Excess Risk Optimization Zhihao Gu Zi Xu 65 1 0 22 Aug 2024
Double Variance Reduction: A Smoothing Trick for Composite Optimization Problems without First-Order Gradient Hao Di Haishan Ye Yueling Zhang Xiangyu Chang Guang Dai Ivor W. Tsang 123 1 0 28 May 2024
Fine-Tuning Language Models with Just Forward Passes Sadhika Malladi Tianyu Gao Eshaan Nichani Alexandru Damian Jason D. Lee Danqi Chen Sanjeev Arora 140 205 0 27 May 2023
Zeroth-Order Alternating Gradient Descent Ascent Algorithms for a Class of Nonconvex-Nonconcave Minimax Problems Zi Xu Ziqi Wang Junlin Wang Y. Dai 99 11 0 24 Nov 2022
Zeroth-Order Negative Curvature Finding: Escaping Saddle Points without Gradients Hualin Zhang Huan Xiong Bin Gu 87 9 0 04 Oct 2022
Gradient-Free Methods for Deterministic and Stochastic Nonsmooth Nonconvex Optimization Tianyi Lin Zeyu Zheng Michael I. Jordan 110 55 0 12 Sep 2022
Stochastic Zeroth order Descent with Structured Directions Marco Rando C. Molinari S. Villa Lorenzo Rosasco 80 8 0 10 Jun 2022
On the Second-order Convergence Properties of Random Search Methods Aurelien Lucchi Antonio Orvieto Adamos Solomou 65 9 0 25 Oct 2021
On the Convergence Theory for Hessian-Free Bilevel Algorithms Daouda Sow Kaiyi Ji Yingbin Liang 100 28 0 13 Oct 2021
An Accelerated Variance-Reduced Conditional Gradient Sliding Algorithm for First-order and Zeroth-order Optimization Xiyuan Wei Bin Gu Heng-Chiao Huang 59 1 0 18 Sep 2021
Zeroth and First Order Stochastic Frank-Wolfe Algorithms for Constrained Optimization Zeeshan Akhtar K. Rajawat 77 7 0 14 Jul 2021
Provably Faster Algorithms for Bilevel Optimization Junjie Yang Kaiyi Ji Yingbin Liang 112 136 0 08 Jun 2021
Distributed Learning Systems with First-order Methods Ji Liu Ce Zhang 36 44 0 12 Apr 2021
Statistical Inference for Polyak-Ruppert Averaged Zeroth-order Stochastic Gradient Algorithm Yanhao Jin Tesi Xiao Krishnakumar Balasubramanian 72 6 0 10 Feb 2021
Recent Theoretical Advances in Non-Convex Optimization Marina Danilova Pavel Dvurechensky Alexander Gasnikov Eduard A. Gorbunov Sergey Guminov Dmitry Kamzolov Innokentiy Shibaev 129 79 0 11 Dec 2020
An Accelerated DFO Algorithm for Finite-sum Convex Functions Yuwen Chen Antonio Orvieto Aurelien Lucchi 89 15 0 07 Jul 2020
Convergence of Meta-Learning with Task-Specific Adaptation over Partial Parameters Kaiyi Ji Jason D. Lee Yingbin Liang H. Vincent Poor 197 76 0 16 Jun 2020
Gradient Free Minimax Optimization: Variance Reduction and Faster Convergence Tengyu Xu Zhe Wang Yingbin Liang H. Vincent Poor 67 30 0 16 Jun 2020
A Primer on Zeroth-Order Optimization in Signal Processing and Machine Learning Sijia Liu Pin-Yu Chen B. Kailkhura Gaoyuan Zhang A. Hero III P. Varshney 82 235 0 11 Jun 2020
A Hybrid-Order Distributed SGD Method for Non-Convex Optimization to Balance Communication Overhead, Computational Complexity, and Convergence Rate Naeimeh Omidvar M. Maddah-ali Hamed Mahdavi ODL 35 3 0 27 Mar 2020
Nonconvex Zeroth-Order Stochastic ADMM Methods with Lower Function Query Complexity Feihu Huang Shangqian Gao J. Pei Heng-Chiao Huang 57 8 0 30 Jul 2019
Hessian-Aware Zeroth-Order Optimization for Black-Box Adversarial Attack Haishan Ye Zhichao Huang Cong Fang C. J. Li Tong Zhang AAML 83 42 0 29 Dec 2018