Optimal Algorithms for Stochastic Bilevel Optimization under Relaxed Smoothness Conditions

21 June 2023

Papers citing "Optimal Algorithms for Stochastic Bilevel Optimization under Relaxed Smoothness Conditions"

23 / 23 papers shown

Title
Efficient Curvature-Aware Hypergradient Approximation for Bilevel Optimization Youran Dong Junfeng Yang Wei-Ting Yao Jin Zhang 106 0 0 04 May 2025
On the Convergence of Adam-Type Algorithm for Bilevel Optimization under Unbounded Smoothness Xiaochuan Gong Jie Hao Mingrui Liu 54 0 0 05 Mar 2025
A Nearly Optimal Single Loop Algorithm for Stochastic Bilevel Optimization under Unbounded Smoothness Xiaochuan Gong Jie Hao Mingrui Liu 44 3 0 31 Dec 2024
Exploring the Generalization Capabilities of AID-based Bi-level Optimization C. L. Philip Chen Li Shen Zhiqiang Xu W. Liu Zhi-Quan Luo Peilin Zhao 65 0 0 25 Nov 2024
Fully First-Order Methods for Decentralized Bilevel Optimization Xiaoyu Wang Xuxing Chen Shiqian Ma Tong Zhang 36 0 0 25 Oct 2024
Single-Timescale Multi-Sequence Stochastic Approximation Without Fixed Point Smoothness: Theories and Applications Yue Huang Zhaoxian Wu Shiqian Ma Qing Ling 31 1 0 17 Oct 2024
SEAL: Safety-enhanced Aligned LLM Fine-tuning via Bilevel Data Selection Han Shen Pin-Yu Chen Payel Das Tianyi Chen ALM 26 11 0 09 Oct 2024
An Accelerated Algorithm for Stochastic Bilevel Optimization under Unbounded Smoothness Xiaochuan Gong Jie Hao Mingrui Liu 36 2 0 28 Sep 2024
Fast Two-Time-Scale Stochastic Gradient Method with Applications in Reinforcement Learning Sihan Zeng Thinh T. Doan 49 5 0 15 May 2024
Fully Zeroth-Order Bilevel Programming via Gaussian Smoothing Alireza Aghasi Saeed Ghadimi 33 2 0 29 Mar 2024
Principled Penalty-based Methods for Bilevel Reinforcement Learning and RLHF Han Shen Zhuoran Yang Tianyi Chen OffRL 32 14 0 10 Feb 2024
Bilevel Optimization under Unbounded Smoothness: A New Algorithm and Convergence Analysis Jie Hao Xiaochuan Gong Mingrui Liu 25 7 0 17 Jan 2024
An adaptively inexact first-order method for bilevel optimization with application to hyperparameter learning Mohammad Salehi Subhadip Mukherjee Lindon Roberts Matthias Joachim Ehrhardt 24 5 0 19 Aug 2023
Stochastic Controlled Averaging for Federated Learning with Communication Compression Xinmeng Huang Ping Li Xiaoyun Li 32 195 0 16 Aug 2023
Stochastic Nested Compositional Bi-level Optimization for Robust Feature Learning Xuxing Chen Krishnakumar Balasubramanian Saeed Ghadimi 12 1 0 11 Jul 2023
Momentum Benefits Non-IID Federated Learning Simply and Provably Ziheng Cheng Xinmeng Huang Pengfei Wu Kun Yuan FedML 23 16 0 28 Jun 2023
Near-Optimal Nonconvex-Strongly-Convex Bilevel Optimization with Fully First-Order Oracles Le‐Yu Chen Yaohua Ma J. Zhang 84 2 0 26 Jun 2023
BOME! Bilevel Optimization Made Easy: A Simple First-Order Approach Mao Ye B. Liu S. Wright Peter Stone Qian Liu 72 82 0 19 Sep 2022
A framework for bilevel optimization that enables stochastic and global variance reduction algorithms Mathieu Dagréou Pierre Ablin Samuel Vaiter Thomas Moreau 129 95 0 31 Jan 2022
Amortized Implicit Differentiation for Stochastic Bilevel Optimization Michael Arbel Julien Mairal 101 58 0 29 Nov 2021
Solving Stochastic Compositional Optimization is Nearly as Easy as Solving Stochastic Optimization Tianyi Chen Yuejiao Sun W. Yin 44 81 0 25 Aug 2020
Bilevel Programming for Hyperparameter Optimization and Meta-Learning Luca Franceschi P. Frasconi Saverio Salzo Riccardo Grazzi Massimiliano Pontil 99 715 0 13 Jun 2018
Forward and Reverse Gradient-Based Hyperparameter Optimization Luca Franceschi Michele Donini P. Frasconi Massimiliano Pontil 115 405 0 06 Mar 2017