Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2102.07367
Cited By
v1
v2
v3 (latest)
A Near-Optimal Algorithm for Stochastic Bilevel Optimization via Double-Momentum
Neural Information Processing Systems (NeurIPS), 2021
15 February 2021
Prashant Khanduri
Siliang Zeng
Mingyi Hong
Hoi-To Wai
Zhaoran Wang
Zhuoran Yang
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"A Near-Optimal Algorithm for Stochastic Bilevel Optimization via Double-Momentum"
50 / 92 papers shown
On the Condition Number Dependency in Bilevel Optimization
Lesi Chen
Jingzhao Zhang
150
2
0
27 Nov 2025
A Unified Understanding of Offline Data Selection and Online Self-refining Generation for Post-training LLMs
Quan-Wu Xiao
Tianyi Chen
OffRL
280
0
0
26 Nov 2025
Encoder Fine-tuning with Stochastic Sampling Outperforms Open-weight GPT in Astronomy Knowledge Extraction
Shivam Rawat
Lucie Flek
Akbar Karimi
151
0
0
11 Nov 2025
Solving bilevel optimization via sequential minimax optimization
Zhaosong Lu
Sanyou Mei
157
3
0
10 Nov 2025
Bilevel Learning via Inexact Stochastic Gradient Descent
Mohammad Salehi
Subhadip Mukherjee
Lindon Roberts
Matthias Joachim Ehrhardt
141
0
0
10 Nov 2025
A Single-Loop First-Order Algorithm for Linearly Constrained Bilevel Optimization
Wei Shen
Jiawei Zhang
Minhui Huang
Cong Shen
206
0
0
28 Oct 2025
Computational Budget Should Be Considered in Data Selection
Weilin Wan
Weizhong Zhang
Cheng Jin
269
0
0
19 Oct 2025
Analytical Survey of Learning with Low-Resource Data: From Analysis to Investigation
Xiaofeng Cao
Mingwei Xu
Xin Yu
Jiangchao Yao
Wei Ye
...
Minling Zhang
Ivor Tsang
Yew-Soon Ong
James T. Kwok
Heng Tao Shen
221
15
0
10 Oct 2025
Adaptive Algorithms with Sharp Convergence Rates for Stochastic Hierarchical Optimization
Xiaochuan Gong
Jie Hao
Mingrui Liu
341
1
0
18 Sep 2025
Stochastic Bilevel Optimization with Heavy-Tailed Noise
Zhuanghua Liu
Luo Luo
253
3
0
18 Sep 2025
Beyond Two-Stage Training: Cooperative SFT and RL for LLM Reasoning
Liang Chen
Xueting Han
Li Shen
Jing Bai
Kam-Fai Wong
OffRL
ReLM
LRM
258
16
0
08 Sep 2025
Faster Gradient Methods for Highly-Smooth Stochastic Bilevel Optimization
Lesi Chen
Junru Li
Jingzhao Zhang
Jingzhao Zhang
191
1
0
03 Sep 2025
Efficient Curvature-Aware Hypergradient Approximation for Bilevel Optimization
Youran Dong
Junfeng Yang
Wei-Ting Yao
Jin Zhang
987
2
0
04 May 2025
Understanding Inverse Reinforcement Learning under Overparameterization: Non-Asymptotic Analysis and Global Optimality
International Conference on Artificial Intelligence and Statistics (AISTATS), 2025
Ruijia Zhang
Siliang Zeng
Chenliang Li
Alfredo García
Mingyi Hong
368
1
0
22 Mar 2025
On the Convergence of Adam-Type Algorithm for Bilevel Optimization under Unbounded Smoothness
Xiaochuan Gong
Jie Hao
Mingrui Liu
456
1
0
05 Mar 2025
Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomy
The international journal of robotics research (IJRR), 2024
Chen Wang
Kaiyi Ji
Shaoshu Su
Zhongqiang Ren
Taimeng Fu
...
Yi Du
Qihang Li
Yue Yang
Xiao Lin
Zhipeng Zhao
SSL
794
28
0
28 Jan 2025
On Penalty-based Bilevel Gradient Descent Method
International Conference on Machine Learning (ICML), 2023
Han Shen
Quan-Wu Xiao
Tianyi Chen
697
104
0
08 Jan 2025
A Nearly Optimal Single Loop Algorithm for Stochastic Bilevel Optimization under Unbounded Smoothness
International Conference on Machine Learning (ICML), 2024
Xiaochuan Gong
Jie Hao
Mingrui Liu
408
9
0
31 Dec 2024
Provably Faster Algorithms for Bilevel Optimization via Without-Replacement Sampling
Neural Information Processing Systems (NeurIPS), 2024
Junyi Li
Heng Huang
292
1
0
07 Nov 2024
SEAL: Safety-enhanced Aligned LLM Fine-tuning via Bilevel Data Selection
International Conference on Learning Representations (ICLR), 2024
Han Shen
Pin-Yu Chen
Payel Das
Tianyi Chen
ALM
367
58
0
09 Oct 2024
An Accelerated Algorithm for Stochastic Bilevel Optimization under Unbounded Smoothness
Neural Information Processing Systems (NeurIPS), 2024
Xiaochuan Gong
Jie Hao
Mingrui Liu
837
7
0
28 Sep 2024
Online Nonconvex Bilevel Optimization with Bregman Divergences
Jason Bohne
David Rosenberg
Gary Kazantsev
Pawel Polak
224
1
0
16 Sep 2024
ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting
Boyao Wang
Dylan Zhang
Hanning Zhang
Xingyuan Pan
Minrui Xu
Jipeng Zhang
Renjie Pi
Xiaoyu Wang
Tong Zhang
480
25
0
28 Jun 2024
Double Momentum Method for Lower-Level Constrained Bilevel Optimization
Wanli Shi
Yi Chang
Bin Gu
332
1
0
25 Jun 2024
First-Order Methods for Linearly Constrained Bilevel Optimization
Guy Kornowski
Swati Padmanabhan
Kai Wang
Zhe Zhang
S. Sra
467
14
0
18 Jun 2024
A Primal-Dual-Assisted Penalty Approach to Bilevel Optimization with Coupled Constraints
Neural Information Processing Systems (NeurIPS), 2024
Liuyuan Jiang
Quan-Wu Xiao
Victor M. Tenorio
Fernando Real-Rojas
Antonio G. Marques
Tianyi Chen
406
11
0
14 Jun 2024
Bilevel reinforcement learning via the development of hyper-gradient without lower-level convexity
Yan Yang
Bin Gao
Ya-xiang Yuan
500
10
0
30 May 2024
Accelerated Fully First-Order Methods for Bilevel and Minimax Optimization
Chris Junchi Li
489
0
0
01 May 2024
LancBiO: dynamic Lanczos-aided bilevel optimization via Krylov subspace
International Conference on Learning Representations (ICLR), 2024
Bin Gao
Yan Yang
Ya-xiang Yuan
433
3
0
04 Apr 2024
Regularized DeepIV with Model Selection
Zihao Li
Hui Lan
Vasilis Syrgkanis
Mengdi Wang
Masatoshi Uehara
264
5
0
07 Mar 2024
On the Complexity of First-Order Methods in Stochastic Bilevel Optimization
International Conference on Machine Learning (ICML), 2024
Jeongyeol Kwon
Dohyun Kwon
Hanbaek Lyu
340
15
0
11 Feb 2024
Principled Penalty-based Methods for Bilevel Reinforcement Learning and RLHF
International Conference on Machine Learning (ICML), 2024
Han Shen
Zhuoran Yang
Tianyi Chen
OffRL
432
33
0
10 Feb 2024
Bilevel Optimization under Unbounded Smoothness: A New Algorithm and Convergence Analysis
Jie Hao
Xiaochuan Gong
Mingrui Liu
426
14
0
17 Jan 2024
On the Communication Complexity of Decentralized Bilevel Optimization
Yihan Zhang
My T. Thai
Jie Wu
Hongchang Gao
612
6
0
19 Nov 2023
Adaptive Mirror Descent Bilevel Optimization
Feihu Huang
428
1
0
08 Nov 2023
Federated Multi-Level Optimization over Decentralized Networks
Shuoguang Yang
Xuezhou Zhang
Mengdi Wang
AI4CE
242
0
0
10 Oct 2023
On Penalty Methods for Nonconvex Bilevel Optimization and First-Order Stochastic Approximation
International Conference on Learning Representations (ICLR), 2023
Jeongyeol Kwon
Dohyun Kwon
Steve Wright
Robert D. Nowak
464
59
0
04 Sep 2023
Projection-Free Methods for Stochastic Simple Bilevel Optimization with Convex Lower-level Problem
Neural Information Processing Systems (NeurIPS), 2023
Jincheng Cao
Ruichen Jiang
Nazanin Abolfazli
Erfan Yazdandoost Hamedani
Aryan Mokhtari
307
15
0
15 Aug 2023
Non-Convex Bilevel Optimization with Time-Varying Objective Functions
Neural Information Processing Systems (NeurIPS), 2023
Sen-Fon Lin
Daouda Sow
Kaiyi Ji
Yitao Liang
Ness B. Shroff
246
8
0
07 Aug 2023
PARL: A Unified Framework for Policy Alignment in Reinforcement Learning from Human Feedback
International Conference on Learning Representations (ICLR), 2023
Souradip Chakraborty
Amrit Singh Bedi
Alec Koppel
Dinesh Manocha
Huazheng Wang
Mengdi Wang
Furong Huang
422
41
0
03 Aug 2023
An Introduction to Bi-level Optimization: Foundations and Applications in Signal Processing and Machine Learning
IEEE Signal Processing Magazine (IEEE Signal Process. Mag.), 2023
Yihua Zhang
Prashant Khanduri
Ioannis C. Tsaknakis
Yuguang Yao
Min-Fong Hong
Sijia Liu
AI4CE
414
58
0
01 Aug 2023
Near-Optimal Nonconvex-Strongly-Convex Bilevel Optimization with Fully First-Order Oracles
Le‐Yu Chen
Yaohua Ma
J.N. Zhang
493
13
0
26 Jun 2023
Optimal Algorithms for Stochastic Bilevel Optimization under Relaxed Smoothness Conditions
Journal of machine learning research (JMLR), 2023
Xuxing Chen
Tesi Xiao
Krishnakumar Balasubramanian
324
36
0
21 Jun 2023
A Generalized Alternating Method for Bilevel Learning under the Polyak-Łojasiewicz Condition
Quan-Wu Xiao
Songtao Lu
Tianyi Chen
471
5
0
04 Jun 2023
Federated Multi-Sequence Stochastic Approximation with Local Hypergradient Estimation
Davoud Ataee Tarzanagh
Mingchen Li
Pranay Sharma
Samet Oymak
342
0
0
02 Jun 2023
SimFBO: Towards Simple, Flexible and Communication-efficient Federated Bilevel Learning
Neural Information Processing Systems (NeurIPS), 2023
Yifan Yang
Peiyao Xiao
Kaiyi Ji
FedML
570
24
0
30 May 2023
Blockwise Stochastic Variance-Reduced Methods with Parallel Speedup for Multi-Block Bilevel Optimization
International Conference on Machine Learning (ICML), 2023
Quanqi Hu
Zimeng Qiu
Zhishuai Guo
Lijun Zhang
Tianbao Yang
329
8
0
30 May 2023
BiSLS/SPS: Auto-tune Step Sizes for Stable Bi-level Optimization
Neural Information Processing Systems (NeurIPS), 2023
Chen Fan
Gaspard Choné-Ducasse
Mark Schmidt
Christos Thrampoulidis
299
4
0
30 May 2023
Effective Bilevel Optimization via Minimax Reformulation
Xiaoyu Wang
Boyao Wang
Renjie Pi
Tong Zhang
355
3
0
22 May 2023
On Momentum-Based Gradient Methods for Bilevel Optimization with Nonconvex Lower-Level
Feihu Huang
569
22
0
07 Mar 2023
1
2
Next
Page 1 of 2
