Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1710.10551
Cited By
v1
v2 (latest)
Stochastic Zeroth-order Optimization in High Dimensions
International Conference on Artificial Intelligence and Statistics (AISTATS), 2017
29 October 2017
Yining Wang
S. Du
Sivaraman Balakrishnan
Aarti Singh
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Stochastic Zeroth-order Optimization in High Dimensions"
50 / 69 papers shown
ConMeZO: Adaptive Descent-Direction Sampling for Gradient-Free Finetuning of Large Language Models
Lejs Deen Behric
Liang Zhang
Bingcong Li
K. K. Thekumparampil
137
0
0
04 Nov 2025
Towards Fast LLM Fine-tuning through Zeroth-Order Optimization with Projected Gradient-Aligned Perturbations
Zhendong Mi
Qitao Tan
Grace Li Zhang
Zhaozhuo Xu
Geng Yuan
Shaoyi Huang
144
0
0
21 Oct 2025
ROOT: Rethinking Offline Optimization as Distributional Translation via Probabilistic Bridge
Manh Cuong Dao
Hung Tran
Phi Le Nguyen
Thao Nguyen Truong
Trong Nghia Hoang
OffRL
208
0
0
19 Sep 2025
The Multi-Query Paradox in Zeroth-Order Optimization
Wei Lin
Qingyu Song
Hong Xu
170
0
0
19 Sep 2025
Bregman Linearized Augmented Lagrangian Method for Nonconvex Constrained Stochastic Zeroth-order Optimization
Qiankun Shi
Xiao Wang
Hao Wang
207
1
0
13 Apr 2025
ZOQO: Zero-Order Quantized Optimization
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2025
Noga Bar
Raja Giryes
MQ
152
2
0
12 Jan 2025
Simultaneous Computation and Memory Efficient Zeroth-Order Optimizer for Fine-Tuning Large Language Models
Fei Wang
Li Shen
Liang Ding
Chao Xue
Ye Liu
Changxing Ding
260
4
0
13 Oct 2024
Gradient-Free Method for Heavily Constrained Nonconvex Optimization
International Conference on Machine Learning (ICML), 2024
Wanli Shi
Hongchang Gao
Bin Gu
234
5
0
31 Aug 2024
CONGO: Compressive Online Gradient Optimization
Jeremy Carleton
Prathik Vijaykumar
Divyanshu Saxena
Dheeraj Narasimha
Srinivas Shakkottai
Aditya Akella
376
0
0
08 Jul 2024
Covariance-Adaptive Sequential Black-box Optimization for Diffusion Targeted Generation
Yueming Lyu
Kim yong Tan
Yew-Soon Ong
Ivor W. Tsang
DiffM
315
2
0
02 Jun 2024
Gradient Compressed Sensing: A Query-Efficient Gradient Estimator for High-Dimensional Zeroth-Order Optimization
Ruizhong Qiu
Hanghang Tong
344
11
0
27 May 2024
Forward Learning for Gradient-based Black-box Saliency Map Generation
Zeliang Zhang
Mingqian Feng
Jinyang Jiang
Rongyi Zhu
Yijie Peng
Chenliang Xu
FAtt
360
2
0
22 Mar 2024
Sparse MeZO: Less Parameters for Better Performance in Zeroth-Order LLM Fine-Tuning
Yong Liu
Zirui Zhu
Chaoyu Gong
Minhao Cheng
Cho-Jui Hsieh
Yang You
MoE
241
36
0
24 Feb 2024
Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark
Yihua Zhang
Pingzhi Li
Junyuan Hong
Jiaxiang Li
Yimeng Zhang
...
Wotao Yin
Mingyi Hong
Zinan Lin
Sijia Liu
Tianlong Chen
411
100
0
18 Feb 2024
Stochastic Two Points Method for Deep Model Zeroth-order Optimization
Yijiang Pang
Jiayu Zhou
428
1
0
02 Feb 2024
DPZero: Private Fine-Tuning of Language Models without Backpropagation
Liang Zhang
Bingcong Li
K. K. Thekumparampil
Sewoong Oh
Niao He
444
22
0
14 Oct 2023
ZooPFL: Exploring Black-box Foundation Models for Personalized Federated Learning
Wang Lu
Hao Yu
Yongfeng Zhang
Damien Teney
Haohan Wang
Yiqiang Chen
Qiang Yang
Xing Xie
Xiangyang Ji
233
10
0
08 Oct 2023
Efficient Federated Prompt Tuning for Black-box Large Pre-trained Models
Zihao Lin
Yan Sun
Yifan Shi
Xueqian Wang
Lifu Huang
Li Shen
Dacheng Tao
249
15
0
04 Oct 2023
DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training
International Conference on Learning Representations (ICLR), 2023
Chenyi Zi
Yimeng Zhang
Jinghan Jia
James Diffenderfer
Jiancheng Liu
Konstantinos Parasyris
Yihua Zhang
Zheng Zhang
B. Kailkhura
Sijia Liu
637
78
0
03 Oct 2023
InstructZero: Efficient Instruction Optimization for Black-Box Large Language Models
International Conference on Machine Learning (ICML), 2023
Lichang Chen
Jiuhai Chen
Tom Goldstein
Heng-Chiao Huang
Wanrong Zhu
315
59
0
05 Jun 2023
Fine-Tuning Language Models with Just Forward Passes
Neural Information Processing Systems (NeurIPS), 2023
Sadhika Malladi
Tianyu Gao
Eshaan Nichani
Alexandru Damian
Jason D. Lee
Danqi Chen
Sanjeev Arora
503
309
0
27 May 2023
Gradient-Free Textual Inversion
ACM Multimedia (ACM MM), 2023
Zhengcong Fei
Mingyuan Fan
Junshi Huang
DiffM
260
38
0
12 Apr 2023
Reward Learning as Doubly Nonparametric Bandits: Optimal Design and Scaling Laws
International Conference on Artificial Intelligence and Statistics (AISTATS), 2023
Kush S. Bhatia
Wenshuo Guo
Jacob Steinhardt
144
0
0
23 Feb 2023
Step by Step Loss Goes Very Far: Multi-Step Quantization for Adversarial Text Attacks
Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2023
Piotr Gaiñski
Klaudia Bałazy
170
7
0
10 Feb 2023
Faster Gradient-Free Algorithms for Nonsmooth Nonconvex Stochastic Optimization
International Conference on Machine Learning (ICML), 2023
Le‐Yu Chen
Jing Xu
Luo Luo
256
22
0
16 Jan 2023
Adaptive Stochastic Optimisation of Nonconvex Composite Objectives
Weijia Shao
F. Sivrikaya
S. Albayrak
195
0
0
21 Nov 2022
On Adaptivity in Non-stationary Stochastic Optimization With Bandit Feedback
Yining Wang
157
6
0
11 Oct 2022
Zeroth-Order Hard-Thresholding: Gradient Error vs. Expansivity
Neural Information Processing Systems (NeurIPS), 2022
William de Vazelhes
Hualin Zhang
Huisi Wu
Xiao-Tong Yuan
Bin Gu
327
4
0
11 Oct 2022
Convergence of Batch Updating Methods with Approximate Gradients and/or Noisy Measurements: Theory and Computational Results
Tadipatri Uday
M. Vidyasagar
164
0
0
12 Sep 2022
Gradient-Free Methods for Deterministic and Stochastic Nonsmooth Nonconvex Optimization
Neural Information Processing Systems (NeurIPS), 2022
Tianyi Lin
Zeyu Zheng
Michael I. Jordan
422
69
0
12 Sep 2022
Adaptive Zeroth-Order Optimisation of Nonconvex Composite Objectives
International Conference on Machine Learning, Optimization, and Data Science (MOD), 2022
Weijia Shao
S. Albayrak
194
1
0
09 Aug 2022
Lazy Queries Can Reduce Variance in Zeroth-order Optimization
IEEE Transactions on Signal Processing (IEEE Trans. Signal Process.), 2022
Quan-Wu Xiao
Qing Ling
Tianyi Chen
180
3
0
14 Jun 2022
Stochastic Zeroth Order Gradient and Hessian Estimators: Variance Reduction and Refined Bias Bounds
Information and Inference A Journal of the IMA (JIII), 2022
Yasong Feng
Tianyu Wang
350
14
0
29 May 2022
Curvature-Aware Derivative-Free Optimization
Journal of Scientific Computing (J. Sci. Comput.), 2021
Bumsu Kim
HanQin Cai
Daniel McKenzie
W. Yin
ODL
320
14
0
27 Sep 2021
Global optimization using random embeddings
Mathematical programming (Math. Program.), 2021
C. Cartis
E. Massart
Adilet Otemissov
139
12
0
26 Jul 2021
Problem Dependent View on Structured Thresholding Bandit Problems
International Conference on Machine Learning (ICML), 2021
J. Cheshire
Pierre Ménard
Alexandra Carpentier
93
7
0
18 Jun 2021
Zero-Shot Knowledge Distillation from a Decision-Based Black-Box Model
International Conference on Machine Learning (ICML), 2021
Zehao Wang
149
50
0
07 Jun 2021
SGD with Coordinate Sampling: Theory and Practice
Journal of machine learning research (JMLR), 2021
Rémi Leluc
Franccois Portier
212
6
0
25 May 2021
Scalable Projection-Free Optimization
Mingrui Zhang
268
0
0
07 May 2021
A Dimension-Insensitive Algorithm for Stochastic Zeroth-Order Optimization
Hongcheng Liu
Yu Yang
301
1
0
22 Apr 2021
A Zeroth-Order Block Coordinate Descent Algorithm for Huge-Scale Black-Box Optimization
International Conference on Machine Learning (ICML), 2021
HanQin Cai
Y. Lou
Daniel McKenzie
W. Yin
259
56
0
21 Feb 2021
Statistical Inference for Polyak-Ruppert Averaged Zeroth-order Stochastic Gradient Algorithm
Yanhao Jin
Tesi Xiao
Krishnakumar Balasubramanian
229
7
0
10 Feb 2021
Online Statistical Inference for Stochastic Optimization via Kiefer-Wolfowitz Methods
Journal of the American Statistical Association (JASA), 2021
Xi Chen
Zehua Lai
He Li
Yichen Zhang
342
21
0
05 Feb 2021
Data-Free Model Extraction
Computer Vision and Pattern Recognition (CVPR), 2020
Jean-Baptiste Truong
Pratyush Maini
R. Walls
Nicolas Papernot
MIACV
327
218
0
30 Nov 2020
Gradient-Based Empirical Risk Minimization using Local Polynomial Regression
Ali Jadbabaie
A. Makur
Devavrat Shah
554
8
0
04 Nov 2020
Continuum-Armed Bandits: A Function Space Perspective
Shashank Singh
434
12
0
15 Oct 2020
Boosting One-Point Derivative-Free Online Optimization via Residual Feedback
Yan Zhang
Yi Zhou
Kaiyi Ji
Michael M. Zavlanos
251
12
0
14 Oct 2020
A One-bit, Comparison-Based Gradient Estimator
HanQin Cai
Daniel McKenzie
W. Yin
Zhenliang Zhang
419
21
0
06 Oct 2020
Nearly Dimension-Independent Sparse Linear Bandit over Small Action Spaces via Best Subset Selection
Journal of the American Statistical Association (JASA), 2020
Yining Wang
Yi Chen
Ethan X. Fang
Zhaoran Wang
Runze Li
286
17
0
04 Sep 2020
Nearest Neighbour Based Estimates of Gradients: Sharp Nonasymptotic Bounds and Applications
Guillaume Ausset
Stéphan Clémenccon
Franccois Portier
277
4
0
26 Jun 2020
1
2
Next
