Provably Faster Algorithms for Bilevel Optimization

8 June 2021

Papers citing "Provably Faster Algorithms for Bilevel Optimization"

31 / 31 papers shown

Title
Efficient Curvature-Aware Hypergradient Approximation for Bilevel Optimization Youran Dong Junfeng Yang Wei-Ting Yao Jin Zhang 103 0 0 04 May 2025
PR-Attack: Coordinated Prompt-RAG Attacks on Retrieval-Augmented Generation in Large Language Models via Bilevel Optimization Yang Jiao X. Wang Kai Yang AAML SILM 31 0 0 10 Apr 2025
Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomy Chen Wang Kaiyi Ji Junyi Geng Zhongqiang Ren Taimeng Fu ... Yi Du Qihang Li Y. Yang Xiao Lin Zhipeng Zhao SSL 76 9 0 28 Jan 2025
Bayesian Experimental Design via Contrastive Diffusions Jacopo Iollo Christophe Heinkelé Pierre Alliez Florence Forbes 28 0 0 15 Oct 2024
Differentially Private Bilevel Optimization Guy Kornowski 105 0 0 29 Sep 2024
An Accelerated Algorithm for Stochastic Bilevel Optimization under Unbounded Smoothness Xiaochuan Gong Jie Hao Mingrui Liu 36 2 0 28 Sep 2024
First-Order Methods for Linearly Constrained Bilevel Optimization Guy Kornowski Swati Padmanabhan Kai Wang Zhe Zhang S. Sra 70 5 0 18 Jun 2024
Implicit Diffusion: Efficient Optimization through Stochastic Sampling Pierre Marion Anna Korba Peter Bartlett Mathieu Blondel Valentin De Bortoli Arnaud Doucet Felipe Llinares-López Courtney Paquette Quentin Berthet 74 11 0 08 Feb 2024
Adaptive Mirror Descent Bilevel Optimization Feihu Huang 28 1 0 08 Nov 2023
Federated Multi-Level Optimization over Decentralized Networks Shuoguang Yang Xuezhou Zhang Mengdi Wang AI4CE 28 0 0 10 Oct 2023
Robust Ante-hoc Graph Explainer using Bilevel Optimization Kha-Dinh Luong Mert Kosan A. Silva Ambuj K. Singh 32 6 0 25 May 2023
On Momentum-Based Gradient Methods for Bilevel Optimization with Nonconvex Lower-Level Feihu Huang 19 18 0 07 Mar 2023
Achieving Hierarchy-Free Approximation for Bilevel Programs With Equilibrium Constraints Jiayang Li J. Yu Boyi Liu Zhaoran Wang Y. Nie 27 6 0 20 Feb 2023
A Fully First-Order Method for Stochastic Bilevel Optimization Jeongyeol Kwon Dohyun Kwon S. Wright Robert D. Nowak 21 67 0 26 Jan 2023
Analyzing Inexact Hypergradients for Bilevel Learning Matthias Joachim Ehrhardt Lindon Roberts 16 8 0 11 Jan 2023
First-order penalty methods for bilevel optimization Zhaosong Lu Sanyou Mei 58 31 0 04 Jan 2023
A Penalty-Based Method for Communication-Efficient Decentralized Bilevel Programming Parvin Nazari Ahmad Mousavi Davoud Ataee Tarzanagh George Michailidis 19 4 0 08 Nov 2022
Fast Adaptive Federated Bilevel Optimization Feihu Huang FedML 20 7 0 02 Nov 2022
Passage-Mask: A Learnable Regularization Strategy for Retriever-Reader Models Shujian Zhang Chengyue Gong Xingchao Liu RALM 37 6 0 02 Nov 2022
INTERACT: Achieving Low Sample and Communication Complexities in Decentralized Bilevel Learning over Networks Zhuqing Liu Xin Zhang Prashant Khanduri Songtao Lu Jia Liu 24 11 0 27 Jul 2022
Gradient-based Bi-level Optimization for Deep Learning: A Survey Can Chen Xiangshan Chen Chen-li Ma Zixuan Liu Xue Liu 81 35 0 24 Jul 2022
Online Bilevel Optimization: Regret Analysis of Online Alternating Gradient Methods Davoud Ataee Tarzanagh Parvin Nazari Bojian Hou Li Shen Laura Balzano 37 10 0 06 Jul 2022
Betty: An Automatic Differentiation Library for Multilevel Optimization Sang Keun Choe W. Neiswanger P. Xie Eric P. Xing AI4CE 23 29 0 05 Jul 2022
Decentralized Gossip-Based Stochastic Bilevel Optimization over Communication Networks Shuoguang Yang Xuezhou Zhang Mengdi Wang 32 42 0 22 Jun 2022
A Single-Timescale Analysis For Stochastic Approximation With Multiple Coupled Sequences Han Shen Tianyi Chen 30 15 0 21 Jun 2022
Local Stochastic Bilevel Optimization with Momentum-Based Variance Reduction Junyi Li Feihu Huang Heng-Chiao Huang FedML 19 27 0 03 May 2022
On the Convergence of Momentum-Based Algorithms for Federated Bilevel Optimization Problems Hongchang Gao FedML 18 1 0 28 Apr 2022
On the Convergence Theory for Hessian-Free Bilevel Algorithms Daouda Sow Kaiyi Ji Yingbin Liang 22 28 0 13 Oct 2021
Tighter Analysis of Alternating Stochastic Gradient Method for Stochastic Nested Problems Tianyi Chen Yuejiao Sun W. Yin 24 33 0 25 Jun 2021
Bilevel Programming for Hyperparameter Optimization and Meta-Learning Luca Franceschi P. Frasconi Saverio Salzo Riccardo Grazzi Massimiliano Pontil 99 715 0 13 Jun 2018
Forward and Reverse Gradient-Based Hyperparameter Optimization Luca Franceschi Michele Donini P. Frasconi Massimiliano Pontil 115 405 0 06 Mar 2017