ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1312.2139
  4. Cited By
Optimal rates for zero-order convex optimization: the power of two
  function evaluations
v1v2 (latest)

Optimal rates for zero-order convex optimization: the power of two function evaluations

IEEE Transactions on Information Theory (IEEE Trans. Inf. Theory), 2013
7 December 2013
John C. Duchi
Sai Li
Martin J. Wainwright
Andre Wibisono
ArXiv (abs)PDFHTML

Papers citing "Optimal rates for zero-order convex optimization: the power of two function evaluations"

50 / 225 papers shown
Algorithmic Aspects of the Log-Laplace Transform and a Non-Euclidean Proximal Sampler
Algorithmic Aspects of the Log-Laplace Transform and a Non-Euclidean Proximal SamplerAnnual Conference Computational Learning Theory (COLT), 2023
Sivakanth Gopi
Y. Lee
Daogao Liu
Ruoqi Shen
Kevin Tian
590
10
0
24 Dec 2025
ZO-ASR: Zeroth-Order Fine-Tuning of Speech Foundation Models without Back-Propagation
ZO-ASR: Zeroth-Order Fine-Tuning of Speech Foundation Models without Back-Propagation
Yuezhang Peng
Yu‐Xin Liu
Yao Li
S. Wang
Fei Wen
Xie Chen
174
0
0
01 Dec 2025
Low-Rank Curvature for Zeroth-Order Optimization in LLM Fine-Tuning
Low-Rank Curvature for Zeroth-Order Optimization in LLM Fine-Tuning
Hyunseok Seung
Jaewoo Lee
Hyunsuk Ko
95
1
0
11 Nov 2025
ConMeZO: Adaptive Descent-Direction Sampling for Gradient-Free Finetuning of Large Language Models
ConMeZO: Adaptive Descent-Direction Sampling for Gradient-Free Finetuning of Large Language Models
Lejs Deen Behric
Liang Zhang
Bingcong Li
K. K. Thekumparampil
165
0
0
04 Nov 2025
BOND: License to Train with Black-Box Functions
BOND: License to Train with Black-Box Functions
Andrew Clark
Jack Moursounidis
Osmaan Rasouli
William Gan
Cooper Doyle
A. Leontjeva
124
0
0
29 Oct 2025
On the Optimal Construction of Unbiased Gradient Estimators for Zeroth-Order Optimization
On the Optimal Construction of Unbiased Gradient Estimators for Zeroth-Order Optimization
Shaocong Ma
Heng Huang
183
3
0
22 Oct 2025
Revisiting Zeroth-Order Optimization: Minimum-Variance Two-Point Estimators and Directionally Aligned Perturbations
Revisiting Zeroth-Order Optimization: Minimum-Variance Two-Point Estimators and Directionally Aligned PerturbationsInternational Conference on Learning Representations (ICLR), 2025
Shaocong Ma
Heng Huang
191
15
0
22 Oct 2025
Towards Fast LLM Fine-tuning through Zeroth-Order Optimization with Projected Gradient-Aligned Perturbations
Towards Fast LLM Fine-tuning through Zeroth-Order Optimization with Projected Gradient-Aligned Perturbations
Zhendong Mi
Qitao Tan
Grace Li Zhang
Zhaozhuo Xu
Geng Yuan
Shaoyi Huang
167
1
0
21 Oct 2025
Zeroth-Order Sharpness-Aware Learning with Exponential Tilting
Zeroth-Order Sharpness-Aware Learning with Exponential Tilting
Xuchen Gong
Tian Li
171
0
0
17 Oct 2025
Multi-Objective $\textit{min-max}$ Online Convex Optimization
Multi-Objective min-max\textit{min-max}min-max Online Convex Optimization
Rahul Vaze
Sumiran Mishra
192
0
0
15 Oct 2025
Downgrade to Upgrade: Optimizer Simplification Enhances Robustness in LLM Unlearning
Downgrade to Upgrade: Optimizer Simplification Enhances Robustness in LLM Unlearning
Yicheng Lang
Yihua Zhang
Chongyu Fan
Changsheng Wang
Jinghan Jia
Sijia Liu
MU
423
0
0
01 Oct 2025
ZOO-Prune: Training-Free Token Pruning via Zeroth-Order Gradient Estimation in Vision-Language Models
ZOO-Prune: Training-Free Token Pruning via Zeroth-Order Gradient Estimation in Vision-Language Models
Youngeun Kim
Youjia Zhang
Huiling Liu
Aecheon Jung
Sunwoo Lee
Sungeun Hong
VLM
219
1
0
29 Sep 2025
High-Probability Analysis of Online and Federated Zero-Order Optimisation
High-Probability Analysis of Online and Federated Zero-Order Optimisation
Arya Akhavan
David Janz
El-Mahdi El-Mhamdi
FedML
307
0
0
25 Sep 2025
CR-Net: Scaling Parameter-Efficient Training with Cross-Layer Low-Rank Structure
CR-Net: Scaling Parameter-Efficient Training with Cross-Layer Low-Rank Structure
Boao Kong
Junzhu Liang
Yuxi Liu
Renjia Deng
Kun Yuan
218
2
0
23 Sep 2025
The Multi-Query Paradox in Zeroth-Order Optimization
The Multi-Query Paradox in Zeroth-Order Optimization
Wei Lin
Qingyu Song
Hong Xu
268
1
0
19 Sep 2025
Warming Up for Zeroth-Order Federated Pre-Training with Low Resource Clients
Warming Up for Zeroth-Order Federated Pre-Training with Low Resource Clients
G. Legate
Irina Rish
Eugene Belilovsky
FedML
149
0
0
03 Sep 2025
Communication-Efficient Zero-Order and First-Order Federated Learning Methods over Wireless Networks
Communication-Efficient Zero-Order and First-Order Federated Learning Methods over Wireless Networks
Mohamad Assaad
Zeinab Nehme
Mérouane Debbah
153
0
0
11 Aug 2025
MobiEdit: Resource-efficient Knowledge Editing for Personalized On-device LLMs
MobiEdit: Resource-efficient Knowledge Editing for Personalized On-device LLMs
Zhenyan Lu
Daliang Xu
Dongqi Cai
Zexi Li
Wei Liu
Fangming Liu
Shangguang Wang
Mengwei Xu
KELM
258
1
0
05 Jun 2025
Leveraging Coordinate Momentum in SignSGD and Muon: Memory-Optimized Zero-Order
Leveraging Coordinate Momentum in SignSGD and Muon: Memory-Optimized Zero-Order
Egor Petrov
Grigoriy Evseev
Aleksey Antonov
Andrey Veprikov
Nikolay Bushkov
Nikolay Bushkov
Stanislav Moiseev
507
5
0
04 Jun 2025
Privacy Amplification in Differentially Private Zeroth-Order Optimization with Hidden States
Privacy Amplification in Differentially Private Zeroth-Order Optimization with Hidden States
Eli Chien
Wei-Ning Chen
P. Li
223
0
0
30 May 2025
A Structured Tour of Optimization with Finite Differences
A Structured Tour of Optimization with Finite Differences
Marco Rando
C. Molinari
Lorenzo Rosasco
S. Villa
460
0
0
26 May 2025
Scaling Recurrent Neural Networks to a Billion Parameters with Zero-Order Optimization
Scaling Recurrent Neural Networks to a Billion Parameters with Zero-Order Optimization
Francois Chaubard
Mykel J. Kochenderfer
MQAI4CE
479
3
0
23 May 2025
Bregman Linearized Augmented Lagrangian Method for Nonconvex Constrained Stochastic Zeroth-order Optimization
Bregman Linearized Augmented Lagrangian Method for Nonconvex Constrained Stochastic Zeroth-order Optimization
Qiankun Shi
Xiao Wang
Hao Wang
271
1
0
13 Apr 2025
ZIP: An Efficient Zeroth-order Prompt Tuning for Black-box Vision-Language Models
ZIP: An Efficient Zeroth-order Prompt Tuning for Black-box Vision-Language ModelsInternational Conference on Learning Representations (ICLR), 2025
Seonghwan Park
Jaehyeon Jeong
Yongjun Kim
Jaeho Lee
Namhoon Lee
VLM
392
6
0
09 Apr 2025
Efficient Personalization of Quantized Diffusion Model without Backpropagation
Efficient Personalization of Quantized Diffusion Model without BackpropagationComputer Vision and Pattern Recognition (CVPR), 2025
H. Seo
Wongi Jeong
Kyungryeol Lee
Se Young Chun
DiffMMQ
420
2
0
19 Mar 2025
ZO2: Scalable Zeroth-Order Fine-Tuning for Extremely Large Language Models with Limited GPU Memory
ZO2: Scalable Zeroth-Order Fine-Tuning for Extremely Large Language Models with Limited GPU Memory
Liangyu Wang
Jie Ren
Hang Xu
Junxiao Wang
Huanyi Xie
David E. Keyes
Di Wang
402
3
0
16 Mar 2025
LORENZA: Enhancing Generalization in Low-Rank Gradient LLM Training via Efficient Zeroth-Order Adaptive SAM
LORENZA: Enhancing Generalization in Low-Rank Gradient LLM Training via Efficient Zeroth-Order Adaptive SAM
Yehonathan Refael
Iftach Arbel
Ofir Lindenbaum
Tom Tirer
466
4
0
26 Feb 2025
Scalable Back-Propagation-Free Training of Optical Physics-Informed Neural Networks
Scalable Back-Propagation-Free Training of Optical Physics-Informed Neural Networks
Yequan Zhao
Xinling Yu
Xian Xiao
Zhe Chen
Ziyue Liu
G. Kurczveil
R. Beausoleil
Shixuan Liu
Zheng Zhang
395
1
0
17 Feb 2025
Bilevel ZOFO: Efficient LLM Fine-Tuning and Meta-Training
Bilevel ZOFO: Efficient LLM Fine-Tuning and Meta-Training
Reza Shirkavand
Qi He
Qi He
Heng-Chiao Huang
ALM
712
1
0
05 Feb 2025
Solving Infinite-Player Games with Player-to-Strategy Networks
Solving Infinite-Player Games with Player-to-Strategy Networks
Carlos Martin
Tuomas Sandholm
231
0
0
17 Jan 2025
Pareto Set Learning for Multi-Objective Reinforcement Learning
Pareto Set Learning for Multi-Objective Reinforcement LearningAAAI Conference on Artificial Intelligence (AAAI), 2025
Erlong Liu
Yu-Chang Wu
Xiaobin Huang
Chengrui Gao
Ren-Jian Wang
Ke Xue
Chao Qian
OffRL
696
23
0
12 Jan 2025
ZOQO: Zero-Order Quantized Optimization
ZOQO: Zero-Order Quantized OptimizationIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2025
Noga Bar
Raja Giryes
MQ
186
3
0
12 Jan 2025
Improving the Convergence Rates of Forward Gradient Descent with
  Repeated Sampling
Improving the Convergence Rates of Forward Gradient Descent with Repeated Sampling
Niklas Dexheimer
Johannes Schmidt-Hieber
FedML
240
0
0
26 Nov 2024
Accelerated zero-order SGD under high-order smoothness and
  overparameterized regime
Accelerated zero-order SGD under high-order smoothness and overparameterized regimeNelineinaya Dinamika (ND), 2024
Georgii Bychkov
D. Dvinskikh
Anastasia Antsiferova
Alexander Gasnikov
Aleksandr Lobanov
307
1
0
21 Nov 2024
Poor Man's Training on MCUs: A Memory-Efficient Quantized
  Back-Propagation-Free Approach
Poor Man's Training on MCUs: A Memory-Efficient Quantized Back-Propagation-Free Approach
Yequan Zhao
Hai Li
Ian Young
Zheng Zhang
MQ
432
4
0
07 Nov 2024
Zeroth-Order Fine-Tuning of LLMs in Random Subspaces
Zeroth-Order Fine-Tuning of LLMs in Random Subspaces
Ziming Yu
Pan Zhou
Sike Wang
Jia Li
Hua Huang
Hua Huang
497
0
0
11 Oct 2024
Improved Sample Complexity for Private Nonsmooth Nonconvex Optimization
Improved Sample Complexity for Private Nonsmooth Nonconvex Optimization
Guy Kornowski
Daogao Liu
Kunal Talwar
325
3
0
08 Oct 2024
Communication and Energy Efficient Federated Learning using Zero-Order
  Optimization Technique
Communication and Energy Efficient Federated Learning using Zero-Order Optimization TechniqueIEEE Transactions on Signal Processing (IEEE TSP), 2024
Elissa Mhanna
Mohamad Assaad
272
0
0
24 Sep 2024
Distributed Online Bandit Nonconvex Optimization with One-Point Residual
  Feedback via Dynamic Regret
Distributed Online Bandit Nonconvex Optimization with One-Point Residual Feedback via Dynamic Regret
Youqing Hua
Shuai Liu
Yiguang Hong
Karl Henrik Johansson
Guangchen Wang
211
2
0
24 Sep 2024
MobiZO: Enabling Efficient LLM Fine-Tuning at the Edge via Inference Engines
MobiZO: Enabling Efficient LLM Fine-Tuning at the Edge via Inference Engines
Lei Gao
Amir Ziashahabi
Yue Niu
Salman Avestimehr
M. Annavaram
345
0
0
23 Sep 2024
Compatible Gradient Approximations for Actor-Critic Algorithms
Compatible Gradient Approximations for Actor-Critic Algorithms
Baturay Saglam
Zhuoran Yang
447
1
0
02 Sep 2024
Gradient-Free Method for Heavily Constrained Nonconvex Optimization
Gradient-Free Method for Heavily Constrained Nonconvex OptimizationInternational Conference on Machine Learning (ICML), 2024
Wanli Shi
Hongchang Gao
Bin Gu
268
5
0
31 Aug 2024
Zeroth-Order Stochastic Mirror Descent Algorithms for Minimax Excess
  Risk Optimization
Zeroth-Order Stochastic Mirror Descent Algorithms for Minimax Excess Risk Optimization
Zhihao Gu
Zi Xu
352
1
0
22 Aug 2024
Ancestral Reinforcement Learning: Unifying Zeroth-Order Optimization and
  Genetic Algorithms for Reinforcement Learning
Ancestral Reinforcement Learning: Unifying Zeroth-Order Optimization and Genetic Algorithms for Reinforcement Learning
So Nakashima
Tetsuya J. Kobayashi
205
2
0
18 Aug 2024
Exploratory Optimal Stopping: A Singular Control Formulation
Exploratory Optimal Stopping: A Singular Control Formulation
Jodi Dianetti
Giorgio Ferrari
Renyuan Xu
303
16
0
18 Aug 2024
Joint-perturbation simultaneous pseudo-gradient
Joint-perturbation simultaneous pseudo-gradientInternational Joint Conference on Artificial Intelligence (IJCAI), 2024
Carlos Martin
Tuomas Sandholm
344
2
0
17 Aug 2024
Pre-trained Encoder Inference: Revealing Upstream Encoders In Downstream Machine Learning Services
Pre-trained Encoder Inference: Revealing Upstream Encoders In Downstream Machine Learning Services
Shaopeng Fu
Xuexue Sun
Ke Qing
Tianhang Zheng
Haiyan Zhao
AAMLMIACVSILM
672
1
0
05 Aug 2024
Safe Online Convex Optimization with Multi-Point Feedback
Safe Online Convex Optimization with Multi-Point Feedback
Spencer Hutchinson
Mahnoosh Alizadeh
224
1
0
16 Jul 2024
Private Zeroth-Order Nonsmooth Nonconvex Optimization
Private Zeroth-Order Nonsmooth Nonconvex Optimization
Qinzi Zhang
Hoang Tran
Ashok Cutkosky
311
7
0
27 Jun 2024
Memory-Efficient Gradient Unrolling for Large-Scale Bi-level
  Optimization
Memory-Efficient Gradient Unrolling for Large-Scale Bi-level Optimization
Qianli Shen
Yezhen Wang
Zhouhao Yang
Xiang Li
Haonan Wang
Yang Zhang
Jonathan Scarlett
Zhanxing Zhu
Kenji Kawaguchi
AI4CE
302
11
0
20 Jun 2024
12345
Next
Page 1 of 5