First-order penalty methods for bilevel optimization

4 January 2023

Papers citing "First-order penalty methods for bilevel optimization"

24 / 24 papers shown

Title
Efficient Fine-Tuning and Concept Suppression for Pruned Diffusion Models Reza Shirkavand Peiran Yu Shangqian Gao Gowthami Somepalli Tom Goldstein Heng-Chiao Huang 94 1 0 13 Mar 2025
On Penalty-based Bilevel Gradient Descent Method Han Shen Quan-Wu Xiao Tianyi Chen 40 50 0 08 Jan 2025
Unleashing the Power of Data Tsunami: A Comprehensive Survey on Data Assessment and Selection for Instruction Tuning of Language Models Yulei Qin Yuncheng Yang Pengcheng Guo Gang Li Hang Shao Yuchen Shi Zihan Xu Yun Gu Ke Li Xing Sun ALM 66 11 0 31 Dec 2024
Differentially Private Bilevel Optimization Guy Kornowski 31 0 0 29 Sep 2024
Optimal Hessian/Jacobian-Free Nonconvex-PL Bilevel Optimization Feihu Huang 20 4 0 25 Jul 2024
ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting Rui Pan Jipeng Zhang Xingyuan Pan Renjie Pi Xiaoyu Wang Tong Zhang 37 3 0 28 Jun 2024
First-Order Methods for Linearly Constrained Bilevel Optimization Guy Kornowski Swati Padmanabhan Kai Wang Zhe Zhang S. Sra 46 5 0 18 Jun 2024
Moreau Envelope for Nonconvex Bi-Level Optimization: A Single-loop and Hessian-free Solution Strategy Risheng Liu Zhu Liu Wei-Ting Yao Shangzhi Zeng Jin Zhang 22 6 0 16 May 2024
Accelerated Fully First-Order Methods for Bilevel and Minimax Optimization Chris Junchi Li 26 0 0 01 May 2024
LancBiO: dynamic Lanczos-aided bilevel optimization via Krylov subspace Bin Gao Yan Yang Ya-xiang Yuan 26 2 0 04 Apr 2024
On the Complexity of First-Order Methods in Stochastic Bilevel Optimization Jeongyeol Kwon Dohyun Kwon Hanbaek Lyu 26 2 0 11 Feb 2024
Principled Penalty-based Methods for Bilevel Reinforcement Learning and RLHF Han Shen Zhuoran Yang Tianyi Chen OffRL 24 14 0 10 Feb 2024
Constrained Bi-Level Optimization: Proximal Lagrangian Value function Approach and Hessian-free Algorithm Wei-Ting Yao Chengming Yu Shangzhi Zeng Jin Zhang 8 13 0 29 Jan 2024
Adaptive Mirror Descent Bilevel Optimization Feihu Huang 6 1 0 08 Nov 2023
On Penalty Methods for Nonconvex Bilevel Optimization and First-Order Stochastic Approximation Jeongyeol Kwon Dohyun Kwon Steve Wright Robert D. Nowak 9 25 0 04 Sep 2023
Near-Optimal Nonconvex-Strongly-Convex Bilevel Optimization with Fully First-Order Oracles Le‐Yu Chen Yaohua Ma J. Zhang 69 2 0 26 Jun 2023
A Generalized Alternating Method for Bilevel Learning under the Polyak-Łojasiewicz Condition Quan-Wu Xiao Songtao Lu Tianyi Chen 6 2 0 04 Jun 2023
On Momentum-Based Gradient Methods for Bilevel Optimization with Nonconvex Lower-Level Feihu Huang 8 18 0 07 Mar 2023
A Fully First-Order Method for Stochastic Bilevel Optimization Jeongyeol Kwon Dohyun Kwon S. Wright Robert D. Nowak 8 39 0 26 Jan 2023
A first-order augmented Lagrangian method for constrained minimax optimization Zhaosong Lu Sanyou Mei 13 6 0 05 Jan 2023
A Penalty-Based Method for Communication-Efficient Decentralized Bilevel Programming Parvin Nazari Ahmad Mousavi Davoud Ataee Tarzanagh George Michailidis 6 4 0 08 Nov 2022
BOME! Bilevel Optimization Made Easy: A Simple First-Order Approach Mao Ye B. Liu S. Wright Peter Stone Qian Liu 66 82 0 19 Sep 2022
Bilevel Programming for Hyperparameter Optimization and Meta-Learning Luca Franceschi P. Frasconi Saverio Salzo Riccardo Grazzi Massimiliano Pontil 96 714 0 13 Jun 2018
Forward and Reverse Gradient-Based Hyperparameter Optimization Luca Franceschi Michele Donini P. Frasconi Massimiliano Pontil 109 370 0 06 Mar 2017