On Penalty Methods for Nonconvex Bilevel Optimization and First-Order Stochastic Approximation

4 September 2023

Papers citing "On Penalty Methods for Nonconvex Bilevel Optimization and First-Order Stochastic Approximation"

24 / 24 papers shown

Title
Efficient Curvature-Aware Hypergradient Approximation for Bilevel Optimization Youran Dong Junfeng Yang Wei-Ting Yao Jin Zhang 33 0 0 04 May 2025
qNBO: quasi-Newton Meets Bilevel Optimization Sheng Fang Yong Liu Wei-Ting Yao Chengming Yu Jin Zhang 82 0 0 03 Feb 2025
A Nearly Optimal Single Loop Algorithm for Stochastic Bilevel Optimization under Unbounded Smoothness Xiaochuan Gong Jie Hao Mingrui Liu 44 3 0 31 Dec 2024
On The Global Convergence Of Online RLHF With Neural Parametrization Mudit Gaur Amrit Singh Bedi Raghu Pasupathy Vaneet Aggarwal 16 0 0 21 Oct 2024
SEAL: Safety-enhanced Aligned LLM Fine-tuning via Bilevel Data Selection Han Shen Pin-Yu Chen Payel Das Tianyi Chen ALM 26 11 0 09 Oct 2024
Differentially Private Bilevel Optimization Guy Kornowski 41 0 0 29 Sep 2024
An Accelerated Algorithm for Stochastic Bilevel Optimization under Unbounded Smoothness Xiaochuan Gong Jie Hao Mingrui Liu 23 2 0 28 Sep 2024
Optimal Hessian/Jacobian-Free Nonconvex-PL Bilevel Optimization Feihu Huang 33 4 0 25 Jul 2024
A Primal-Dual-Assisted Penalty Approach to Bilevel Optimization with Coupled Constraints Liuyuan Jiang Quan-Wu Xiao Victor M. Tenorio Fernando Real-Rojas Antonio G. Marques Tianyi Chen 32 1 0 14 Jun 2024
Moreau Envelope for Nonconvex Bi-Level Optimization: A Single-loop and Hessian-free Solution Strategy Risheng Liu Zhu Liu Wei-Ting Yao Shangzhi Zeng Jin Zhang 35 6 0 16 May 2024
LancBiO: dynamic Lanczos-aided bilevel optimization via Krylov subspace Bin Gao Yan Yang Ya-xiang Yuan 34 2 0 04 Apr 2024
Functional Bilevel Optimization for Machine Learning Ieva Petrulionyte Julien Mairal Michael Arbel 29 1 0 29 Mar 2024
On the Complexity of First-Order Methods in Stochastic Bilevel Optimization Jeongyeol Kwon Dohyun Kwon Hanbaek Lyu 31 2 0 11 Feb 2024
Principled Penalty-based Methods for Bilevel Reinforcement Learning and RLHF Han Shen Zhuoran Yang Tianyi Chen OffRL 32 14 0 10 Feb 2024
Constrained Bi-Level Optimization: Proximal Lagrangian Value function Approach and Hessian-free Algorithm Wei-Ting Yao Chengming Yu Shangzhi Zeng Jin Zhang 13 13 0 29 Jan 2024
Bilevel Optimization under Unbounded Smoothness: A New Algorithm and Convergence Analysis Jie Hao Xiaochuan Gong Mingrui Liu 20 6 0 17 Jan 2024
Adaptive Mirror Descent Bilevel Optimization Feihu Huang 21 1 0 08 Nov 2023
An adaptively inexact first-order method for bilevel optimization with application to hyperparameter learning Mohammad Salehi Subhadip Mukherjee Lindon Roberts Matthias Joachim Ehrhardt 15 5 0 19 Aug 2023
First-order penalty methods for bilevel optimization Zhaosong Lu Sanyou Mei 53 31 0 04 Jan 2023
On Finding Small Hyper-Gradients in Bilevel Optimization: Hardness Results and Improved Analysis Le‐Yu Chen Jing Xu J. Zhang 23 11 0 02 Jan 2023
BOME! Bilevel Optimization Made Easy: A Simple First-Order Approach Mao Ye B. Liu S. Wright Peter Stone Qian Liu 69 82 0 19 Sep 2022
A framework for bilevel optimization that enables stochastic and global variance reduction algorithms Mathieu Dagréou Pierre Ablin Samuel Vaiter Thomas Moreau 129 73 0 31 Jan 2022
Bilevel Programming for Hyperparameter Optimization and Meta-Learning Luca Franceschi P. Frasconi Saverio Salzo Riccardo Grazzi Massimiliano Pontil 96 714 0 13 Jun 2018
Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-Łojasiewicz Condition Hamed Karimi J. Nutini Mark W. Schmidt 114 1,190 0 16 Aug 2016