ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1805.10367
  4. Cited By
Zeroth-Order Stochastic Variance Reduction for Nonconvex Optimization
v1v2 (latest)

Zeroth-Order Stochastic Variance Reduction for Nonconvex Optimization

25 May 2018
Sijia Liu
B. Kailkhura
Pin-Yu Chen
Pai-Shun Ting
Shiyu Chang
Lisa Amini
ArXiv (abs)PDFHTML

Papers citing "Zeroth-Order Stochastic Variance Reduction for Nonconvex Optimization"

50 / 103 papers shown
Title
Provable Reinforcement Learning from Human Feedback with an Unknown Link Function
Provable Reinforcement Learning from Human Feedback with an Unknown Link Function
Qining Zhang
Lei Ying
60
0
0
03 Jun 2025
A Structured Tour of Optimization with Finite Differences
A Structured Tour of Optimization with Finite Differences
Marco Rando
C. Molinari
Lorenzo Rosasco
S. Villa
171
0
0
26 May 2025
Graph Guided Diffusion: Unified Guidance for Conditional Graph Generation
Graph Guided Diffusion: Unified Guidance for Conditional Graph Generation
Victor M. Tenorio
Nicolas Zilberstein
Santiago Segarra
A. Marques
60
0
0
26 May 2025
KerZOO: Kernel Function Informed Zeroth-Order Optimization for Accurate and Accelerated LLM Fine-Tuning
KerZOO: Kernel Function Informed Zeroth-Order Optimization for Accurate and Accelerated LLM Fine-Tuning
Zhendong Mi
Qitao Tan
Xiaodong Yu
Zining Zhu
Geng Yuan
Shaoyi Huang
206
0
0
24 May 2025
Minimisation of Quasar-Convex Functions Using Random Zeroth-Order Oracles
Minimisation of Quasar-Convex Functions Using Random Zeroth-Order Oracles
Amir Ali Farzin
Yuen-Man Pun
Iman Shames
38
0
0
04 May 2025
Perturbation-efficient Zeroth-order Optimization for Hardware-friendly On-device Training
Perturbation-efficient Zeroth-order Optimization for Hardware-friendly On-device Training
Qitao Tan
Sung-En Chang
Rui Xia
Huidong Ji
Chence Yang
...
Zheng Zhan
Zhou Zou
Yijiao Wang
Jin Lu
Geng Yuan
78
1
0
28 Apr 2025
Data-Free Black-Box Federated Learning via Zeroth-Order Gradient Estimation
Xinge Ma
Jin Wang
Xuejie Zhang
FedML
130
0
0
08 Mar 2025
Scalable Back-Propagation-Free Training of Optical Physics-Informed Neural Networks
Scalable Back-Propagation-Free Training of Optical Physics-Informed Neural Networks
Yequan Zhao
Xinling Yu
Xian Xiao
Zhe Chen
Ziyue Liu
G. Kurczveil
R. Beausoleil
Shixuan Liu
Zheng Zhang
126
0
0
17 Feb 2025
An Enhanced Zeroth-Order Stochastic Frank-Wolfe Framework for Constrained Finite-Sum Optimization
An Enhanced Zeroth-Order Stochastic Frank-Wolfe Framework for Constrained Finite-Sum Optimization
Haishan Ye
Yinghui Huang
Hao Di
Xiangyu Chang
138
0
0
13 Jan 2025
ElasticZO: A Memory-Efficient On-Device Learning with Combined Zeroth- and First-Order Optimization
ElasticZO: A Memory-Efficient On-Device Learning with Combined Zeroth- and First-Order Optimization
Keisuke Sugiura
Hiroki Matsutani
MQ
71
2
0
08 Jan 2025
Poor Man's Training on MCUs: A Memory-Efficient Quantized
  Back-Propagation-Free Approach
Poor Man's Training on MCUs: A Memory-Efficient Quantized Back-Propagation-Free Approach
Yequan Zhao
Hai Li
Ian Young
Zheng Zhang
MQ
97
3
0
07 Nov 2024
Zeroth-Order Fine-Tuning of LLMs in Random Subspaces
Zeroth-Order Fine-Tuning of LLMs in Random Subspaces
Ziming Yu
Pan Zhou
Sike Wang
Jia Li
Hua Huang
74
0
0
11 Oct 2024
Obtaining Lower Query Complexities through Lightweight Zeroth-Order
  Proximal Gradient Algorithms
Obtaining Lower Query Complexities through Lightweight Zeroth-Order Proximal Gradient Algorithms
Bin Gu
Xiyuan Wei
Hualin Zhang
Yi Chang
Heng-Chiao Huang
FedML
64
0
0
03 Oct 2024
Variance-Reduced Gradient Estimator for Nonconvex Zeroth-Order
  Distributed Optimization
Variance-Reduced Gradient Estimator for Nonconvex Zeroth-Order Distributed Optimization
Huaiyi Mu
Yujie Tang
Zhongkui Li
34
1
0
29 Sep 2024
Zeroth-Order Policy Gradient for Reinforcement Learning from Human Feedback without Reward Inference
Zeroth-Order Policy Gradient for Reinforcement Learning from Human Feedback without Reward Inference
Qining Zhang
Lei Ying
OffRL
138
4
0
25 Sep 2024
Gradient-Free Method for Heavily Constrained Nonconvex Optimization
Gradient-Free Method for Heavily Constrained Nonconvex Optimization
Wanli Shi
Hongchang Gao
Bin Gu
86
5
0
31 Aug 2024
Robust Adaptation of Foundation Models with Black-Box Visual Prompting
Robust Adaptation of Foundation Models with Black-Box Visual Prompting
Changdae Oh
Gyeongdeok Seo
Geunyoung Jung
Zhi-Qi Cheng
Hosik Choi
Jiyoung Jung
Kyungwoo Song
VLM
116
1
0
04 Jul 2024
AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for
  Memory-Efficient Large Language Models Fine-Tuning
AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tuning
Yifan Yang
Kai Zhen
Ershad Banijamal
Athanasios Mouchtaris
Zheng Zhang
71
9
0
26 Jun 2024
Memory-Efficient Gradient Unrolling for Large-Scale Bi-level
  Optimization
Memory-Efficient Gradient Unrolling for Large-Scale Bi-level Optimization
Qianli Shen
Yezhen Wang
Zhouhao Yang
Xiang Li
Haonan Wang
Yang Zhang
Jonathan Scarlett
Zhanxing Zhu
Kenji Kawaguchi
AI4CE
107
4
0
20 Jun 2024
Covariance-Adaptive Sequential Black-box Optimization for Diffusion
  Targeted Generation
Covariance-Adaptive Sequential Black-box Optimization for Diffusion Targeted Generation
Yueming Lyu
Kim yong Tan
Yew-Soon Ong
Ivor W. Tsang
DiffM
93
2
0
02 Jun 2024
Double Variance Reduction: A Smoothing Trick for Composite Optimization
  Problems without First-Order Gradient
Double Variance Reduction: A Smoothing Trick for Composite Optimization Problems without First-Order Gradient
Hao Di
Haishan Ye
Yueling Zhang
Xiangyu Chang
Guang Dai
Ivor W. Tsang
123
1
0
28 May 2024
Achieving Dimension-Free Communication in Federated Learning via Zeroth-Order Optimization
Achieving Dimension-Free Communication in Federated Learning via Zeroth-Order Optimization
Zhe Li
Bicheng Ying
Zidong Liu
Chaosheng Dong
Haibo Yang
FedML
135
3
0
24 May 2024
Minimisation of Polyak-Łojasewicz Functions Using Random Zeroth-Order
  Oracles
Minimisation of Polyak-Łojasewicz Functions Using Random Zeroth-Order Oracles
Amir Ali Farzin
Iman Shames
53
1
0
15 May 2024
Dynamic Anisotropic Smoothing for Noisy Derivative-Free Optimization
Dynamic Anisotropic Smoothing for Noisy Derivative-Free Optimization
S. Reifenstein
T. Leleu
Yoshihisa Yamamoto
73
1
0
02 May 2024
End-to-End Mesh Optimization of a Hybrid Deep Learning Black-Box PDE
  Solver
End-to-End Mesh Optimization of a Hybrid Deep Learning Black-Box PDE Solver
Shaocong Ma
James Diffenderfer
B. Kailkhura
Yi Zhou
AI4CE
111
0
0
17 Apr 2024
Variance-reduced Zeroth-Order Methods for Fine-Tuning Language Models
Variance-reduced Zeroth-Order Methods for Fine-Tuning Language Models
Tanmay Gautam
Youngsuk Park
Hao Zhou
Parameswaran Raman
Wooseok Ha
100
17
0
11 Apr 2024
Sparse MeZO: Less Parameters for Better Performance in Zeroth-Order LLM
  Fine-Tuning
Sparse MeZO: Less Parameters for Better Performance in Zeroth-Order LLM Fine-Tuning
Yong Liu
Zirui Zhu
Chaoyu Gong
Minhao Cheng
Cho-Jui Hsieh
Yang You
MoE
81
23
0
24 Feb 2024
Revisiting Zeroth-Order Optimization for Memory-Efficient LLM
  Fine-Tuning: A Benchmark
Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark
Yihua Zhang
Pingzhi Li
Junyuan Hong
Jiaxiang Li
Yimeng Zhang
...
Wotao Yin
Mingyi Hong
Zhangyang Wang
Sijia Liu
Tianlong Chen
121
60
0
18 Feb 2024
Private Fine-tuning of Large Language Models with Zeroth-order Optimization
Private Fine-tuning of Large Language Models with Zeroth-order Optimization
Xinyu Tang
Ashwinee Panda
Milad Nasr
Saeed Mahloujifar
Prateek Mittal
218
26
0
09 Jan 2024
Federated Full-Parameter Tuning of Billion-Sized Language Models with
  Communication Cost under 18 Kilobytes
Federated Full-Parameter Tuning of Billion-Sized Language Models with Communication Cost under 18 Kilobytes
Zhen Qin
Daoyuan Chen
Bingchen Qian
Bolin Ding
Yaliang Li
Shuiguang Deng
FedML
95
39
0
11 Dec 2023
DPZero: Private Fine-Tuning of Language Models without Backpropagation
DPZero: Private Fine-Tuning of Language Models without Backpropagation
Liang Zhang
Bingcong Li
K. K. Thekumparampil
Sewoong Oh
Niao He
92
15
0
14 Oct 2023
ZooPFL: Exploring Black-box Foundation Models for Personalized Federated
  Learning
ZooPFL: Exploring Black-box Foundation Models for Personalized Federated Learning
Wang Lu
Hao Yu
Jindong Wang
Damien Teney
Haohan Wang
Yiqiang Chen
Qiang Yang
Xing Xie
Xiangyang Ji
97
8
0
08 Oct 2023
DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training
DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training
Aochuan Chen
Yimeng Zhang
Jinghan Jia
James Diffenderfer
Jiancheng Liu
Konstantinos Parasyris
Yihua Zhang
Zheng Zhang
B. Kailkhura
Sijia Liu
136
48
0
03 Oct 2023
STARNet: Sensor Trustworthiness and Anomaly Recognition via Approximated
  Likelihood Regret for Robust Edge Autonomy
STARNet: Sensor Trustworthiness and Anomaly Recognition via Approximated Likelihood Regret for Robust Edge Autonomy
Nastaran Darabi
Sina Tayebati
S. Sureshkumar
Sathya Ravi
Theja Tulabandhula
A. R. Trivedi
110
8
0
20 Sep 2023
Oracle Complexity Reduction for Model-free LQR: A Stochastic
  Variance-Reduced Policy Gradient Approach
Oracle Complexity Reduction for Model-free LQR: A Stochastic Variance-Reduced Policy Gradient Approach
Leonardo F. Toso
Han Wang
James Anderson
54
2
0
19 Sep 2023
Secure and Fast Asynchronous Vertical Federated Learning via Cascaded
  Hybrid Optimization
Secure and Fast Asynchronous Vertical Federated Learning via Cascaded Hybrid Optimization
Ganyu Wang
Qingsong Zhang
Li Xiang
Boyu Wang
Bin Gu
Charles Ling
FedML
75
5
0
28 Jun 2023
Evading Black-box Classifiers Without Breaking Eggs
Evading Black-box Classifiers Without Breaking Eggs
Edoardo Debenedetti
Nicholas Carlini
Florian Tramèr
MLAUAAML
49
8
0
05 Jun 2023
Fine-Tuning Language Models with Just Forward Passes
Fine-Tuning Language Models with Just Forward Passes
Sadhika Malladi
Tianyu Gao
Eshaan Nichani
Alexandru Damian
Jason D. Lee
Danqi Chen
Sanjeev Arora
136
205
0
27 May 2023
A Guide Through the Zoo of Biased SGD
A Guide Through the Zoo of Biased SGD
Yury Demidovich
Grigory Malinovsky
Igor Sokolov
Peter Richtárik
100
28
0
25 May 2023
Certified Zeroth-order Black-Box Defense with Robust UNet Denoiser
Certified Zeroth-order Black-Box Defense with Robust UNet Denoiser
Astha Verma
A. Subramanyam
Siddhesh Bangar
Naman Lal
R. Shah
Shiníchi Satoh
107
5
0
13 Apr 2023
BlackVIP: Black-Box Visual Prompting for Robust Transfer Learning
BlackVIP: Black-Box Visual Prompting for Robust Transfer Learning
Changdae Oh
Hyeji Hwang
Hee-young Lee
Yongtaek Lim
Geunyoung Jung
Jiyoung Jung
Hosik Choi
Kyungwoo Song
VLMVPVLM
139
62
0
26 Mar 2023
Faster Gradient-Free Algorithms for Nonsmooth Nonconvex Stochastic
  Optimization
Faster Gradient-Free Algorithms for Nonsmooth Nonconvex Stochastic Optimization
Le‐Yu Chen
Jing Xu
Luo Luo
84
16
0
16 Jan 2023
PyPop7: A Pure-Python Library for Population-Based Black-Box
  Optimization
PyPop7: A Pure-Python Library for Population-Based Black-Box Optimization
Qiqi Duan
Guochen Zhou
Chang Shao
Zhuowei Wang
Mingyang Feng
Yuwei Huang
Yajing Tan
Yijun Yang
Qi Zhao
Yuhui Shi
113
6
0
12 Dec 2022
Adaptive Stochastic Optimisation of Nonconvex Composite Objectives
Adaptive Stochastic Optimisation of Nonconvex Composite Objectives
Weijia Shao
F. Sivrikaya
S. Albayrak
74
0
0
21 Nov 2022
Zeroth-Order Hard-Thresholding: Gradient Error vs. Expansivity
Zeroth-Order Hard-Thresholding: Gradient Error vs. Expansivity
William de Vazelhes
Hualin Zhang
Huisi Wu
Xiao-Tong Yuan
Bin Gu
103
4
0
11 Oct 2022
Minibatch Stochastic Three Points Method for Unconstrained Smooth
  Minimization
Minibatch Stochastic Three Points Method for Unconstrained Smooth Minimization
Soumia Boucherouite
Grigory Malinovsky
Peter Richtárik
El Houcine Bergou
83
3
0
16 Sep 2022
Gradient-Free Methods for Deterministic and Stochastic Nonsmooth
  Nonconvex Optimization
Gradient-Free Methods for Deterministic and Stochastic Nonsmooth Nonconvex Optimization
Tianyi Lin
Zeyu Zheng
Michael I. Jordan
110
55
0
12 Sep 2022
Adaptive Zeroth-Order Optimisation of Nonconvex Composite Objectives
Adaptive Zeroth-Order Optimisation of Nonconvex Composite Objectives
Weijia Shao
S. Albayrak
24
1
0
09 Aug 2022
Lazy Queries Can Reduce Variance in Zeroth-order Optimization
Lazy Queries Can Reduce Variance in Zeroth-order Optimization
Quan-Wu Xiao
Qing Ling
Tianyi Chen
80
0
0
14 Jun 2022
Stochastic Zeroth order Descent with Structured Directions
Stochastic Zeroth order Descent with Structured Directions
Marco Rando
C. Molinari
S. Villa
Lorenzo Rosasco
80
8
0
10 Jun 2022
123
Next