Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
1805.10367
Cited By
v1
v2 (latest)
Zeroth-Order Stochastic Variance Reduction for Nonconvex Optimization
25 May 2018
Sijia Liu
B. Kailkhura
Pin-Yu Chen
Pai-Shun Ting
Shiyu Chang
Lisa Amini
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Zeroth-Order Stochastic Variance Reduction for Nonconvex Optimization"
50 / 103 papers shown
Title
Provable Reinforcement Learning from Human Feedback with an Unknown Link Function
Qining Zhang
Lei Ying
60
0
0
03 Jun 2025
A Structured Tour of Optimization with Finite Differences
Marco Rando
C. Molinari
Lorenzo Rosasco
S. Villa
171
0
0
26 May 2025
Graph Guided Diffusion: Unified Guidance for Conditional Graph Generation
Victor M. Tenorio
Nicolas Zilberstein
Santiago Segarra
A. Marques
60
0
0
26 May 2025
KerZOO: Kernel Function Informed Zeroth-Order Optimization for Accurate and Accelerated LLM Fine-Tuning
Zhendong Mi
Qitao Tan
Xiaodong Yu
Zining Zhu
Geng Yuan
Shaoyi Huang
206
0
0
24 May 2025
Minimisation of Quasar-Convex Functions Using Random Zeroth-Order Oracles
Amir Ali Farzin
Yuen-Man Pun
Iman Shames
38
0
0
04 May 2025
Perturbation-efficient Zeroth-order Optimization for Hardware-friendly On-device Training
Qitao Tan
Sung-En Chang
Rui Xia
Huidong Ji
Chence Yang
...
Zheng Zhan
Zhou Zou
Yijiao Wang
Jin Lu
Geng Yuan
78
1
0
28 Apr 2025
Data-Free Black-Box Federated Learning via Zeroth-Order Gradient Estimation
Xinge Ma
Jin Wang
Xuejie Zhang
FedML
130
0
0
08 Mar 2025
Scalable Back-Propagation-Free Training of Optical Physics-Informed Neural Networks
Yequan Zhao
Xinling Yu
Xian Xiao
Zhe Chen
Ziyue Liu
G. Kurczveil
R. Beausoleil
Shixuan Liu
Zheng Zhang
126
0
0
17 Feb 2025
An Enhanced Zeroth-Order Stochastic Frank-Wolfe Framework for Constrained Finite-Sum Optimization
Haishan Ye
Yinghui Huang
Hao Di
Xiangyu Chang
138
0
0
13 Jan 2025
ElasticZO: A Memory-Efficient On-Device Learning with Combined Zeroth- and First-Order Optimization
Keisuke Sugiura
Hiroki Matsutani
MQ
71
2
0
08 Jan 2025
Poor Man's Training on MCUs: A Memory-Efficient Quantized Back-Propagation-Free Approach
Yequan Zhao
Hai Li
Ian Young
Zheng Zhang
MQ
97
3
0
07 Nov 2024
Zeroth-Order Fine-Tuning of LLMs in Random Subspaces
Ziming Yu
Pan Zhou
Sike Wang
Jia Li
Hua Huang
74
0
0
11 Oct 2024
Obtaining Lower Query Complexities through Lightweight Zeroth-Order Proximal Gradient Algorithms
Bin Gu
Xiyuan Wei
Hualin Zhang
Yi Chang
Heng-Chiao Huang
FedML
64
0
0
03 Oct 2024
Variance-Reduced Gradient Estimator for Nonconvex Zeroth-Order Distributed Optimization
Huaiyi Mu
Yujie Tang
Zhongkui Li
34
1
0
29 Sep 2024
Zeroth-Order Policy Gradient for Reinforcement Learning from Human Feedback without Reward Inference
Qining Zhang
Lei Ying
OffRL
138
4
0
25 Sep 2024
Gradient-Free Method for Heavily Constrained Nonconvex Optimization
Wanli Shi
Hongchang Gao
Bin Gu
86
5
0
31 Aug 2024
Robust Adaptation of Foundation Models with Black-Box Visual Prompting
Changdae Oh
Gyeongdeok Seo
Geunyoung Jung
Zhi-Qi Cheng
Hosik Choi
Jiyoung Jung
Kyungwoo Song
VLM
116
1
0
04 Jul 2024
AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tuning
Yifan Yang
Kai Zhen
Ershad Banijamal
Athanasios Mouchtaris
Zheng Zhang
71
9
0
26 Jun 2024
Memory-Efficient Gradient Unrolling for Large-Scale Bi-level Optimization
Qianli Shen
Yezhen Wang
Zhouhao Yang
Xiang Li
Haonan Wang
Yang Zhang
Jonathan Scarlett
Zhanxing Zhu
Kenji Kawaguchi
AI4CE
107
4
0
20 Jun 2024
Covariance-Adaptive Sequential Black-box Optimization for Diffusion Targeted Generation
Yueming Lyu
Kim yong Tan
Yew-Soon Ong
Ivor W. Tsang
DiffM
93
2
0
02 Jun 2024
Double Variance Reduction: A Smoothing Trick for Composite Optimization Problems without First-Order Gradient
Hao Di
Haishan Ye
Yueling Zhang
Xiangyu Chang
Guang Dai
Ivor W. Tsang
123
1
0
28 May 2024
Achieving Dimension-Free Communication in Federated Learning via Zeroth-Order Optimization
Zhe Li
Bicheng Ying
Zidong Liu
Chaosheng Dong
Haibo Yang
FedML
135
3
0
24 May 2024
Minimisation of Polyak-Łojasewicz Functions Using Random Zeroth-Order Oracles
Amir Ali Farzin
Iman Shames
53
1
0
15 May 2024
Dynamic Anisotropic Smoothing for Noisy Derivative-Free Optimization
S. Reifenstein
T. Leleu
Yoshihisa Yamamoto
73
1
0
02 May 2024
End-to-End Mesh Optimization of a Hybrid Deep Learning Black-Box PDE Solver
Shaocong Ma
James Diffenderfer
B. Kailkhura
Yi Zhou
AI4CE
111
0
0
17 Apr 2024
Variance-reduced Zeroth-Order Methods for Fine-Tuning Language Models
Tanmay Gautam
Youngsuk Park
Hao Zhou
Parameswaran Raman
Wooseok Ha
100
17
0
11 Apr 2024
Sparse MeZO: Less Parameters for Better Performance in Zeroth-Order LLM Fine-Tuning
Yong Liu
Zirui Zhu
Chaoyu Gong
Minhao Cheng
Cho-Jui Hsieh
Yang You
MoE
81
23
0
24 Feb 2024
Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark
Yihua Zhang
Pingzhi Li
Junyuan Hong
Jiaxiang Li
Yimeng Zhang
...
Wotao Yin
Mingyi Hong
Zhangyang Wang
Sijia Liu
Tianlong Chen
121
60
0
18 Feb 2024
Private Fine-tuning of Large Language Models with Zeroth-order Optimization
Xinyu Tang
Ashwinee Panda
Milad Nasr
Saeed Mahloujifar
Prateek Mittal
218
26
0
09 Jan 2024
Federated Full-Parameter Tuning of Billion-Sized Language Models with Communication Cost under 18 Kilobytes
Zhen Qin
Daoyuan Chen
Bingchen Qian
Bolin Ding
Yaliang Li
Shuiguang Deng
FedML
95
39
0
11 Dec 2023
DPZero: Private Fine-Tuning of Language Models without Backpropagation
Liang Zhang
Bingcong Li
K. K. Thekumparampil
Sewoong Oh
Niao He
92
15
0
14 Oct 2023
ZooPFL: Exploring Black-box Foundation Models for Personalized Federated Learning
Wang Lu
Hao Yu
Jindong Wang
Damien Teney
Haohan Wang
Yiqiang Chen
Qiang Yang
Xing Xie
Xiangyang Ji
97
8
0
08 Oct 2023
DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training
Aochuan Chen
Yimeng Zhang
Jinghan Jia
James Diffenderfer
Jiancheng Liu
Konstantinos Parasyris
Yihua Zhang
Zheng Zhang
B. Kailkhura
Sijia Liu
136
48
0
03 Oct 2023
STARNet: Sensor Trustworthiness and Anomaly Recognition via Approximated Likelihood Regret for Robust Edge Autonomy
Nastaran Darabi
Sina Tayebati
S. Sureshkumar
Sathya Ravi
Theja Tulabandhula
A. R. Trivedi
110
8
0
20 Sep 2023
Oracle Complexity Reduction for Model-free LQR: A Stochastic Variance-Reduced Policy Gradient Approach
Leonardo F. Toso
Han Wang
James Anderson
54
2
0
19 Sep 2023
Secure and Fast Asynchronous Vertical Federated Learning via Cascaded Hybrid Optimization
Ganyu Wang
Qingsong Zhang
Li Xiang
Boyu Wang
Bin Gu
Charles Ling
FedML
75
5
0
28 Jun 2023
Evading Black-box Classifiers Without Breaking Eggs
Edoardo Debenedetti
Nicholas Carlini
Florian Tramèr
MLAU
AAML
49
8
0
05 Jun 2023
Fine-Tuning Language Models with Just Forward Passes
Sadhika Malladi
Tianyu Gao
Eshaan Nichani
Alexandru Damian
Jason D. Lee
Danqi Chen
Sanjeev Arora
136
205
0
27 May 2023
A Guide Through the Zoo of Biased SGD
Yury Demidovich
Grigory Malinovsky
Igor Sokolov
Peter Richtárik
100
28
0
25 May 2023
Certified Zeroth-order Black-Box Defense with Robust UNet Denoiser
Astha Verma
A. Subramanyam
Siddhesh Bangar
Naman Lal
R. Shah
Shiníchi Satoh
107
5
0
13 Apr 2023
BlackVIP: Black-Box Visual Prompting for Robust Transfer Learning
Changdae Oh
Hyeji Hwang
Hee-young Lee
Yongtaek Lim
Geunyoung Jung
Jiyoung Jung
Hosik Choi
Kyungwoo Song
VLM
VPVLM
139
62
0
26 Mar 2023
Faster Gradient-Free Algorithms for Nonsmooth Nonconvex Stochastic Optimization
Le‐Yu Chen
Jing Xu
Luo Luo
84
16
0
16 Jan 2023
PyPop7: A Pure-Python Library for Population-Based Black-Box Optimization
Qiqi Duan
Guochen Zhou
Chang Shao
Zhuowei Wang
Mingyang Feng
Yuwei Huang
Yajing Tan
Yijun Yang
Qi Zhao
Yuhui Shi
113
6
0
12 Dec 2022
Adaptive Stochastic Optimisation of Nonconvex Composite Objectives
Weijia Shao
F. Sivrikaya
S. Albayrak
74
0
0
21 Nov 2022
Zeroth-Order Hard-Thresholding: Gradient Error vs. Expansivity
William de Vazelhes
Hualin Zhang
Huisi Wu
Xiao-Tong Yuan
Bin Gu
103
4
0
11 Oct 2022
Minibatch Stochastic Three Points Method for Unconstrained Smooth Minimization
Soumia Boucherouite
Grigory Malinovsky
Peter Richtárik
El Houcine Bergou
83
3
0
16 Sep 2022
Gradient-Free Methods for Deterministic and Stochastic Nonsmooth Nonconvex Optimization
Tianyi Lin
Zeyu Zheng
Michael I. Jordan
110
55
0
12 Sep 2022
Adaptive Zeroth-Order Optimisation of Nonconvex Composite Objectives
Weijia Shao
S. Albayrak
24
1
0
09 Aug 2022
Lazy Queries Can Reduce Variance in Zeroth-order Optimization
Quan-Wu Xiao
Qing Ling
Tianyi Chen
80
0
0
14 Jun 2022
Stochastic Zeroth order Descent with Structured Directions
Marco Rando
C. Molinari
S. Villa
Lorenzo Rosasco
80
8
0
10 Jun 2022
1
2
3
Next