On the Convergence Theory for Hessian-Free Bilevel Algorithms

13 October 2021

Papers citing "On the Convergence Theory for Hessian-Free Bilevel Algorithms"

25 / 25 papers shown

Title
qNBO: quasi-Newton Meets Bilevel Optimization Sheng Fang Yong Liu Wei-Ting Yao Chengming Yu Jin Zhang 87 0 0 03 Feb 2025
Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomy Chen Wang Kaiyi Ji Junyi Geng Zhongqiang Ren Taimeng Fu ... Yi Du Qihang Li Y. Yang Xiao Lin Zhipeng Zhao SSL 71 9 0 28 Jan 2025
On Penalty-based Bilevel Gradient Descent Method Han Shen Quan-Wu Xiao Tianyi Chen 60 50 0 08 Jan 2025
Fully First-Order Methods for Decentralized Bilevel Optimization Xiaoyu Wang Xuxing Chen Shiqian Ma Tong Zhang 36 0 0 25 Oct 2024
Online Nonconvex Bilevel Optimization with Bregman Divergences Jason Bohne David Rosenberg Gary Kazantsev Pawel Polak 24 0 0 16 Sep 2024
Optimal Hessian/Jacobian-Free Nonconvex-PL Bilevel Optimization Feihu Huang 35 4 0 25 Jul 2024
ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting Rui Pan Jipeng Zhang Xingyuan Pan Renjie Pi Xiaoyu Wang Tong Zhang 45 5 0 28 Jun 2024
A Primal-Dual-Assisted Penalty Approach to Bilevel Optimization with Coupled Constraints Liuyuan Jiang Quan-Wu Xiao Victor M. Tenorio Fernando Real-Rojas Antonio G. Marques Tianyi Chen 40 1 0 14 Jun 2024
Moreau Envelope for Nonconvex Bi-Level Optimization: A Single-loop and Hessian-free Solution Strategy Risheng Liu Zhu Liu Wei-Ting Yao Shangzhi Zeng Jin Zhang 35 6 0 16 May 2024
Fully Zeroth-Order Bilevel Programming via Gaussian Smoothing Alireza Aghasi Saeed Ghadimi 23 2 0 29 Mar 2024
A Framework for Bilevel Optimization on Riemannian Manifolds Andi Han Bamdev Mishra Pratik Jawanpuria Akiko Takeda 11 4 0 06 Feb 2024
Near-Optimal Nonconvex-Strongly-Convex Bilevel Optimization with Fully First-Order Oracles Le‐Yu Chen Yaohua Ma J. Zhang 84 2 0 26 Jun 2023
Optimal Algorithms for Stochastic Bilevel Optimization under Relaxed Smoothness Conditions Xuxing Chen Tesi Xiao Krishnakumar Balasubramanian 19 24 0 21 Jun 2023
BiSLS/SPS: Auto-tune Step Sizes for Stable Bi-level Optimization Chen Fan Gaspard Choné-Ducasse Mark W. Schmidt Christos Thrampoulidis 19 3 0 30 May 2023
Effective Bilevel Optimization via Minimax Reformulation Xiaoyu Wang Rui Pan Renjie Pi Tong Zhang 30 1 0 22 May 2023
Achieving Hierarchy-Free Approximation for Bilevel Programs With Equilibrium Constraints Jiayang Li J. Yu Boyi Liu Zhaoran Wang Y. Nie 27 6 0 20 Feb 2023
A Lower Bound and a Near-Optimal Algorithm for Bilevel Empirical Risk Minimization Mathieu Dagréou Thomas Moreau Samuel Vaiter Pierre Ablin 18 12 0 17 Feb 2023
Decentralized Stochastic Bilevel Optimization with Improved per-Iteration Complexity Xuxing Chen Minhui Huang Shiqian Ma Krishnakumar Balasubramanian 19 24 0 23 Oct 2022
Lazy Queries Can Reduce Variance in Zeroth-order Optimization Quan-Wu Xiao Qing Ling Tianyi Chen 28 0 0 14 Jun 2022
Inexact bilevel stochastic gradient methods for constrained and unconstrained lower-level problems Tommaso Giovannelli G. Kent Luis Nunes Vicente 15 12 0 01 Oct 2021
Optimizing Large-Scale Hyperparameters via Automated Learning Algorithm Bin Gu Guodong Liu Yanfu Zhang Xiang Geng Heng-Chiao Huang 31 18 0 17 Feb 2021
Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAML Aniruddh Raghu M. Raghu Samy Bengio Oriol Vinyals 172 639 0 19 Sep 2019
Bilevel Programming for Hyperparameter Optimization and Meta-Learning Luca Franceschi P. Frasconi Saverio Salzo Riccardo Grazzi Massimiliano Pontil 99 715 0 13 Jun 2018
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 243 11,659 0 09 Mar 2017
Forward and Reverse Gradient-Based Hyperparameter Optimization Luca Franceschi Michele Donini P. Frasconi Massimiliano Pontil 112 404 0 06 Mar 2017