Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales

Terms and Conditions

Twitter GitHub LinkedIn Bluesky Youtube

© 2026 ResearchTrend.AI, All rights reserved.

Home
Papers
2404.08080
Cited By

Variance-reduced Zeroth-Order Methods for Fine-Tuning Language Models

Variance-reduced Zeroth-Order Methods for Fine-Tuning Language Models

11 April 2024

Parameswaran Raman

ArXiv (abs)PDF HTML Github

Papers citing "Variance-reduced Zeroth-Order Methods for Fine-Tuning Language Models"

19 / 19 papers shown

ZO-ASR: Zeroth-Order Fine-Tuning of Speech Foundation Models without Back-Propagation

ZO-ASR: Zeroth-Order Fine-Tuning of Speech Foundation Models without Back-Propagation

174

0

0

01 Dec 2025

Low-Rank Curvature for Zeroth-Order Optimization in LLM Fine-Tuning

Low-Rank Curvature for Zeroth-Order Optimization in LLM Fine-Tuning

95

1

0

11 Nov 2025

ConMeZO: Adaptive Descent-Direction Sampling for Gradient-Free Finetuning of Large Language Models

ConMeZO: Adaptive Descent-Direction Sampling for Gradient-Free Finetuning of Large Language Models

Lejs Deen Behric

K. K. Thekumparampil

165

0

0

04 Nov 2025

On the Optimal Construction of Unbiased Gradient Estimators for Zeroth-Order Optimization

On the Optimal Construction of Unbiased Gradient Estimators for Zeroth-Order Optimization

183

3

0

22 Oct 2025

Revisiting Zeroth-Order Optimization: Minimum-Variance Two-Point Estimators and Directionally Aligned Perturbations

Revisiting Zeroth-Order Optimization: Minimum-Variance Two-Point Estimators and Directionally Aligned PerturbationsInternational Conference on Learning Representations (ICLR), 2025

191

15

0

22 Oct 2025

Towards Fast LLM Fine-tuning through Zeroth-Order Optimization with Projected Gradient-Aligned Perturbations

Towards Fast LLM Fine-tuning through Zeroth-Order Optimization with Projected Gradient-Aligned Perturbations

167

1

0

21 Oct 2025

Learning a Zeroth-Order Optimizer for Fine-Tuning LLMs

Learning a Zeroth-Order Optimizer for Fine-Tuning LLMs

203

0

0

01 Oct 2025

CR-Net: Scaling Parameter-Efficient Training with Cross-Layer Low-Rank Structure

CR-Net: Scaling Parameter-Efficient Training with Cross-Layer Low-Rank Structure

218

2

0

23 Sep 2025

KerZOO: Kernel Function Informed Zeroth-Order Optimization for Accurate and Accelerated LLM Fine-Tuning

KerZOO: Kernel Function Informed Zeroth-Order Optimization for Accurate and Accelerated LLM Fine-Tuning

379

4

0

24 May 2025

SubZero: Composing Subject, Style, and Action via Zero-Shot Personalization

SubZero: Composing Subject, Style, and Action via Zero-Shot Personalization

Shubhankar Borse

Mohammad Reza Karimi Dastjerdi

...

Prathamesh Mandke

486

3

0

27 Feb 2025

MaZO: Masked Zeroth-Order Optimization for Multi-Task Fine-Tuning of Large Language Models

MaZO: Masked Zeroth-Order Optimization for Multi-Task Fine-Tuning of Large Language Models

Athanasios Mouchtaris

Siegfried Kunzmann

505

3

0

17 Feb 2025

Scalable Back-Propagation-Free Training of Optical Physics-Informed Neural Networks

Scalable Back-Propagation-Free Training of Optical Physics-Informed Neural Networks

395

1

0

17 Feb 2025

Bilevel ZOFO: Efficient LLM Fine-Tuning and Meta-Training

Bilevel ZOFO: Efficient LLM Fine-Tuning and Meta-Training

Reza Shirkavand

Heng-Chiao Huang

712

1

0

05 Feb 2025

ZOQO: Zero-Order Quantized Optimization

ZOQO: Zero-Order Quantized OptimizationIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2025

186

3

0

12 Jan 2025

ElasticZO: A Memory-Efficient On-Device Learning with Combined Zeroth- and First-Order Optimization

ElasticZO: A Memory-Efficient On-Device Learning with Combined Zeroth- and First-Order Optimization

Keisuke Sugiura

Hiroki Matsutani

310

3

0

08 Jan 2025

Zeroth-Order Fine-Tuning of LLMs in Random Subspaces

Zeroth-Order Fine-Tuning of LLMs in Random Subspaces

497

0

0

11 Oct 2024

MobiZO: Enabling Efficient LLM Fine-Tuning at the Edge via Inference Engines

MobiZO: Enabling Efficient LLM Fine-Tuning at the Edge via Inference Engines

Amir Ziashahabi

Salman Avestimehr

345

0

0

23 Sep 2024

AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for
Memory-Efficient Large Language Models Fine-Tuning

AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tuning

Yifan Yang

Ershad Banijamal

Athanasios Mouchtaris

Zheng Zhang

172

25

0

26 Jun 2024

Adam-mini: Use Fewer Learning Rates To Gain More

Adam-mini: Use Fewer Learning Rates To Gain More

Zhi-Quan Luo

537

107

0

24 Jun 2024

Page 1 of 1