v1v2v3v4 (latest)

A Single-Timescale Method for Stochastic Bilevel Optimization

International Conference on Artificial Intelligence and Statistics (AISTATS), 2021

9 February 2021

Tianyi Chen

Papers citing "A Single-Timescale Method for Stochastic Bilevel Optimization"

50 / 58 papers shown

Title
Lower Complexity Bounds for Nonconvex-Strongly-Convex Bilevel Optimization with First-Order Oracles Kaiyi Ji 92 0 0 24 Nov 2025
Encoder Fine-tuning with Stochastic Sampling Outperforms Open-weight GPT in Astronomy Knowledge Extraction Shivam Rawat Lucie Flek Akbar Karimi 105 0 0 11 Nov 2025
Solving bilevel optimization via sequential minimax optimization Zhaosong Lu Sanyou Mei 64 1 0 10 Nov 2025
A Single-Loop First-Order Algorithm for Linearly Constrained Bilevel Optimization Wei Shen Jiawei Zhang Minhui Huang Cong Shen 97 0 0 28 Oct 2025
Computational Budget Should Be Considered in Data Selection Weilin Wan Weizhong Zhang Cheng Jin 183 0 0 19 Oct 2025
Adaptive Algorithms with Sharp Convergence Rates for Stochastic Hierarchical Optimization Xiaochuan Gong Jie Hao Mingrui Liu 183 1 0 18 Sep 2025
Stochastic Bilevel Optimization with Heavy-Tailed Noise Zhuanghua Liu Luo Luo 110 0 0 18 Sep 2025
A stochastic gradient method for trilevel optimization Tommaso Giovannelli G. Kent Luis Nunes Vicente 145 0 0 11 May 2025
qNBO: quasi-Newton Meets Bilevel OptimizationInternational Conference on Learning Representations (ICLR), 2025 Sheng Fang Yong Liu Wei-Ting Yao Chengming Yu Jin Zhang 377 1 0 03 Feb 2025
On Penalty-based Bilevel Gradient Descent MethodInternational Conference on Machine Learning (ICML), 2023 Han Shen Quan-Wu Xiao Tianyi Chen 470 93 0 08 Jan 2025
A Nearly Optimal Single Loop Algorithm for Stochastic Bilevel Optimization under Unbounded SmoothnessInternational Conference on Machine Learning (ICML), 2024 Xiaochuan Gong Jie Hao Mingrui Liu 323 8 0 31 Dec 2024
Memory-Reduced Meta-Learning with Guaranteed ConvergenceAAAI Conference on Artificial Intelligence (AAAI), 2024 Honglin Yang Ji Ma Xiao Yu 253 0 0 16 Dec 2024
In-Trajectory Inverse Reinforcement Learning: Learn Incrementally Before An Ongoing Trajectory TerminatesNeural Information Processing Systems (NeurIPS), 2024 Shicheng Liu Minghui Zhu 507 1 0 21 Oct 2024
Online Nonconvex Bilevel Optimization with Bregman Divergences Jason Bohne David Rosenberg Gary Kazantsev Pawel Polak 174 0 0 16 Sep 2024
Optimal Hessian/Jacobian-Free Nonconvex-PL Bilevel Optimization Feihu Huang 205 11 0 25 Jul 2024
ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting Boyao Wang Dylan Zhang Hanning Zhang Xingyuan Pan Minrui Xu Jipeng Zhang Renjie Pi Xiaoyu Wang Tong Zhang 371 23 0 28 Jun 2024
First-Order Methods for Linearly Constrained Bilevel Optimization Guy Kornowski Swati Padmanabhan Kai Wang Zhe Zhang S. Sra 345 10 0 18 Jun 2024
A Primal-Dual-Assisted Penalty Approach to Bilevel Optimization with Coupled ConstraintsNeural Information Processing Systems (NeurIPS), 2024 Liuyuan Jiang Quan-Wu Xiao Victor M. Tenorio Fernando Real-Rojas Antonio G. Marques Tianyi Chen 318 9 0 14 Jun 2024
Bilevel reinforcement learning via the development of hyper-gradient without lower-level convexity Yan Yang Bin Gao Ya-xiang Yuan 406 6 0 30 May 2024
Fast Two-Time-Scale Stochastic Gradient Method with Applications in Reinforcement LearningAnnual Conference Computational Learning Theory (COLT), 2024 Sihan Zeng Thinh T. Doan 327 9 0 15 May 2024
Accelerated Fully First-Order Methods for Bilevel and Minimax Optimization Chris Junchi Li 395 0 0 01 May 2024
LancBiO: dynamic Lanczos-aided bilevel optimization via Krylov subspaceInternational Conference on Learning Representations (ICLR), 2024 Bin Gao Yan Yang Ya-xiang Yuan 287 3 0 04 Apr 2024
On the Complexity of First-Order Methods in Stochastic Bilevel OptimizationInternational Conference on Machine Learning (ICML), 2024 Jeongyeol Kwon Dohyun Kwon Hanbaek Lyu 197 14 0 11 Feb 2024
Implicit Diffusion: Efficient Optimization through Stochastic Sampling Pierre Marion Anna Korba Peter Bartlett Mathieu Blondel Valentin De Bortoli Arnaud Doucet Felipe Llinares-López Courtney Paquette Quentin Berthet 355 19 0 08 Feb 2024
Federated Learning Can Find Friends That Are Advantageous N. Tupitsa Samuel Horváth Martin Takávc Eduard A. Gorbunov FedML 351 3 0 07 Feb 2024
A Framework for Bilevel Optimization on Riemannian ManifoldsNeural Information Processing Systems (NeurIPS), 2024 Andi Han Bamdev Mishra Pratik Jawanpuria Akiko Takeda 139 8 0 06 Feb 2024
Decentralized Bilevel Optimization: A Perspective from Transient Iteration Complexity Boao Kong Shuchen Zhu Songtao Lu Xinmeng Huang Kun Yuan 212 0 0 05 Feb 2024
Constrained Bi-Level Optimization: Proximal Lagrangian Value function Approach and Hessian-free AlgorithmInternational Conference on Learning Representations (ICLR), 2024 Wei-Ting Yao Chengming Yu Shangzhi Zeng Jin Zhang 203 22 0 29 Jan 2024
Bilevel Optimization under Unbounded Smoothness: A New Algorithm and Convergence Analysis Jie Hao Xiaochuan Gong Mingrui Liu 246 11 0 17 Jan 2024
Joint Unsupervised and Supervised Training for Automatic Speech Recognition via Bilevel OptimizationIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2024 A. F. M. Saif Xiaodong Cui Han Shen Songtao Lu Brian Kingsbury Tianyi Chen 171 7 0 13 Jan 2024
Provably Convergent Federated Trilevel Learning Yang Jiao Kai Yang Tiancheng Wu Chen Jian Jianwei Huang FedML 215 6 0 19 Dec 2023
Adaptive Mirror Descent Bilevel Optimization Feihu Huang 324 1 0 08 Nov 2023
Contextual Stochastic Bilevel OptimizationNeural Information Processing Systems (NeurIPS), 2023 Yifan Hu Jie Wang Yao Xie Andreas Krause Daniel Kuhn 176 18 0 27 Oct 2023
On Penalty Methods for Nonconvex Bilevel Optimization and First-Order Stochastic ApproximationInternational Conference on Learning Representations (ICLR), 2023 Jeongyeol Kwon Dohyun Kwon Steve Wright Robert D. Nowak 298 50 0 04 Sep 2023
PARL: A Unified Framework for Policy Alignment in Reinforcement Learning from Human FeedbackInternational Conference on Learning Representations (ICLR), 2023 Souradip Chakraborty Amrit Singh Bedi Alec Koppel Dinesh Manocha Huazheng Wang Mengdi Wang Furong Huang 299 36 0 03 Aug 2023
An Introduction to Bi-level Optimization: Foundations and Applications in Signal Processing and Machine LearningIEEE Signal Processing Magazine (IEEE Signal Process. Mag.), 2023 Yihua Zhang Prashant Khanduri Ioannis C. Tsaknakis Yuguang Yao Min-Fong Hong Sijia Liu AI4CE 329 46 0 01 Aug 2023
Stochastic Nested Compositional Bi-level Optimization for Robust Feature Learning Xuxing Chen Krishnakumar Balasubramanian Saeed Ghadimi 155 2 0 11 Jul 2023
Optimal Algorithms for Stochastic Bilevel Optimization under Relaxed Smoothness ConditionsJournal of machine learning research (JMLR), 2023 Xuxing Chen Tesi Xiao Krishnakumar Balasubramanian 252 32 0 21 Jun 2023
A Generalized Alternating Method for Bilevel Learning under the Polyak-Łojasiewicz Condition Quan-Wu Xiao Songtao Lu Tianyi Chen 368 4 0 04 Jun 2023
BiSLS/SPS: Auto-tune Step Sizes for Stable Bi-level OptimizationNeural Information Processing Systems (NeurIPS), 2023 Chen Fan Gaspard Choné-Ducasse Mark Schmidt Christos Thrampoulidis 221 4 0 30 May 2023
Effective Bilevel Optimization via Minimax Reformulation Xiaoyu Wang Boyao Wang Renjie Pi Tong Zhang 193 3 0 22 May 2023
On Momentum-Based Gradient Methods for Bilevel Optimization with Nonconvex Lower-Level Feihu Huang 377 21 0 07 Mar 2023
Averaged Method of Multipliers for Bi-Level Optimization without Lower-Level Strong ConvexityInternational Conference on Machine Learning (ICML), 2023 Risheng Liu Yaohua Liu Wei-Ting Yao Shangzhi Zeng Jin Zhang 198 31 0 07 Feb 2023
A Fully First-Order Method for Stochastic Bilevel OptimizationInternational Conference on Machine Learning (ICML), 2023 Jeongyeol Kwon Dohyun Kwon S. Wright Robert D. Nowak 202 109 0 26 Jan 2023
First-order penalty methods for bilevel optimizationSIAM Journal on Optimization (SIOPT), 2023 Zhaosong Lu Sanyou Mei 287 58 0 04 Jan 2023
Alternating Implicit Projected SGD and Its Efficient Variants for Equality-constrained Bilevel Optimization Quan-Wu Xiao Han Shen W. Yin Tianyi Chen 194 11 0 14 Nov 2022
Decentralized Stochastic Bilevel Optimization with Improved per-Iteration ComplexityInternational Conference on Machine Learning (ICML), 2022 Xuxing Chen Minhui Huang Shiqian Ma Krishnakumar Balasubramanian 236 34 0 23 Oct 2022
Mitigating Gradient Bias in Multi-objective Learning: A Provably Convergent Stochastic Approach H. Fernando Han Shen Miao Liu Subhajit Chaudhury K. Murugesan Tianyi Chen 239 14 0 23 Oct 2022
Online Bilevel Optimization: Regret Analysis of Online Alternating Gradient MethodsInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2022 Davoud Ataee Tarzanagh Parvin Nazari Bojian Hou Li Shen Laura Balzano 408 12 0 06 Jul 2022
A Single-Timescale Analysis For Stochastic Approximation With Multiple Coupled SequencesNeural Information Processing Systems (NeurIPS), 2022 Han Shen Tianyi Chen 224 21 0 21 Jun 2022