On the Iteration Complexity of Hypergradient Computation

29 June 2020

Luca Franceschi

Papers citing "On the Iteration Complexity of Hypergradient Computation"

50 / 127 papers shown

Title
Argus: Federated Non-convex Bilevel Learning over 6G Space-Air-Ground Integrated Network Ya Liu Kai Yang Yu Zhu Keying Yang Haibo Zhao 11 0 0 14 May 2025
Efficient Curvature-Aware Hypergradient Approximation for Bilevel Optimization Youran Dong Junfeng Yang Wei-Ting Yao Jin Zhang 94 0 0 04 May 2025
PRDP: Progressively Refined Differentiable Physics Kanishk Bhatia Felix Koehler Nils Thuerey AI4CE 59 0 0 26 Feb 2025
Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomy Chen Wang Kaiyi Ji Junyi Geng Zhongqiang Ren Taimeng Fu ... Yi Du Qihang Li Y. Yang Xiao Lin Zhipeng Zhao SSL 76 9 0 28 Jan 2025
On Penalty-based Bilevel Gradient Descent Method Han Shen Quan-Wu Xiao Tianyi Chen 60 50 0 08 Jan 2025
Memory-Reduced Meta-Learning with Guaranteed Convergence Honglin Yang Ji Ma Xiao Yu 69 0 0 16 Dec 2024
Exploring the Generalization Capabilities of AID-based Bi-level Optimization C. L. Philip Chen Li Shen Zhiqiang Xu W. Liu Zhi-Quan Luo Peilin Zhao 65 0 0 25 Nov 2024
Provably Faster Algorithms for Bilevel Optimization via Without-Replacement Sampling Junyi Li Heng Huang 36 1 0 07 Nov 2024
Fully First-Order Methods for Decentralized Bilevel Optimization Xiaoyu Wang Xuxing Chen Shiqian Ma Tong Zhang 36 0 0 25 Oct 2024
Meta-Learning with Heterogeneous Tasks Zhaofeng Si Shu Hu Kaiyi Ji Siwei Lyu 27 1 0 24 Oct 2024
Single-Timescale Multi-Sequence Stochastic Approximation Without Fixed Point Smoothness: Theories and Applications Yue Huang Zhaoxian Wu Shiqian Ma Qing Ling 31 1 0 17 Oct 2024
Meta-Reinforcement Learning with Universal Policy Adaptation: Provable Near-Optimality under All-task Optimum Comparator Siyuan Xu Minghui Zhu OffRL 28 1 0 13 Oct 2024
Online Nonconvex Bilevel Optimization with Bregman Divergences Jason Bohne David Rosenberg Gary Kazantsev Pawel Polak 27 0 0 16 Sep 2024
Enhancing Fairness through Reweighting: A Path to Attain the Sufficiency Rule Xuan Zhao Klaus Broelemann Salvatore Ruggieri Gjergji Kasneci 21 0 0 26 Aug 2024
Narrowing the Focus: Learned Optimizers for Pretrained Models Gus Kristiansen Mark Sandler A. Zhmoginov Nolan Miller Anirudh Goyal Jihwan Lee Max Vladymyrov 34 1 0 17 Aug 2024
ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting Rui Pan Jipeng Zhang Xingyuan Pan Renjie Pi Xiaoyu Wang Tong Zhang 50 5 0 28 Jun 2024
First-Order Methods for Linearly Constrained Bilevel Optimization Guy Kornowski Swati Padmanabhan Kai Wang Zhe Zhang S. Sra 68 5 0 18 Jun 2024
A Primal-Dual-Assisted Penalty Approach to Bilevel Optimization with Coupled Constraints Liuyuan Jiang Quan-Wu Xiao Victor M. Tenorio Fernando Real-Rojas Antonio G. Marques Tianyi Chen 40 1 0 14 Jun 2024
Bilevel reinforcement learning via the development of hyper-gradient without lower-level convexity Yan Yang Bin Gao Ya-xiang Yuan 36 2 0 30 May 2024
Derivatives of Stochastic Gradient Descent F. Iutzeler Edouard Pauwels Samuel Vaiter 29 1 0 24 May 2024
Moreau Envelope for Nonconvex Bi-Level Optimization: A Single-loop and Hessian-free Solution Strategy Risheng Liu Zhu Liu Wei-Ting Yao Shangzhi Zeng Jin Zhang 35 6 0 16 May 2024
Accelerated Fully First-Order Methods for Bilevel and Minimax Optimization Chris Junchi Li 54 0 0 01 May 2024
LancBiO: dynamic Lanczos-aided bilevel optimization via Krylov subspace Bin Gao Yan Yang Ya-xiang Yuan 34 2 0 04 Apr 2024
Functional Bilevel Optimization for Machine Learning Ieva Petrulionyte Julien Mairal Michael Arbel 37 2 0 29 Mar 2024
Nonsmooth Implicit Differentiation: Deterministic and Stochastic Convergence Rates Riccardo Grazzi Massimiliano Pontil Saverio Salzo 36 1 0 18 Mar 2024
Downstream Task Guided Masking Learning in Masked Autoencoders Using Multi-Level Optimization Han Guo Ramtin Hosseini Ruiyi Zhang Sai Ashish Somayajula Ranak Roy Chowdhury Rajesh K. Gupta Pengtao Xie 26 0 0 28 Feb 2024
BLO-SAM: Bi-level Optimization Based Overfitting-Preventing Finetuning of SAM Li Zhang Youwei Liang Ruiyi Zhang Amirhosein Javadi Pengtao Xie VLM 24 8 0 26 Feb 2024
Problem-Parameter-Free Decentralized Nonconvex Stochastic Optimization Jiaxiang Li Xuxing Chen Shiqian Ma Mingyi Hong ODL 19 2 0 13 Feb 2024
Principled Penalty-based Methods for Bilevel Reinforcement Learning and RLHF Han Shen Zhuoran Yang Tianyi Chen OffRL 32 14 0 10 Feb 2024
A Framework for Bilevel Optimization on Riemannian Manifolds Andi Han Bamdev Mishra Pratik Jawanpuria Akiko Takeda 18 4 0 06 Feb 2024
Constrained Bi-Level Optimization: Proximal Lagrangian Value function Approach and Hessian-free Algorithm Wei-Ting Yao Chengming Yu Shangzhi Zeng Jin Zhang 16 13 0 29 Jan 2024
Bilevel Optimization under Unbounded Smoothness: A New Algorithm and Convergence Analysis Jie Hao Xiaochuan Gong Mingrui Liu 25 7 0 17 Jan 2024
A First-Order Multi-Gradient Algorithm for Multi-Objective Bi-Level Optimization Feiyang Ye Baijiong Lin Xiao-Qun Cao Yu Zhang Ivor Tsang 45 6 0 17 Jan 2024
A Single-Loop Algorithm for Decentralized Bilevel Optimization Youran Dong Shiqian Ma Junfeng Yang Chao Yin 29 7 0 15 Nov 2023
Learning to Rank for Active Learning via Multi-Task Bilevel Optimization Zixin Ding Si-An Chen Ruoxi Jia Yuxin Chen 35 1 0 25 Oct 2023
PICProp: Physics-Informed Confidence Propagation for Uncertainty Quantification Qianli Shen Wai Hoh Tang Zhun Deng Apostolos F. Psaros Kenji Kawaguchi 57 1 0 10 Oct 2023
Making Scalable Meta Learning Practical Sang Keun Choe Sanket Vaibhav Mehta Hwijeen Ahn W. Neiswanger Pengtao Xie Emma Strubell Eric P. Xing 47 14 0 09 Oct 2023
Understanding Deep Gradient Leakage via Inversion Influence Functions Haobo Zhang Junyuan Hong Yuyang Deng M. Mahdavi Jiayu Zhou FedML 50 6 0 22 Sep 2023
Relax and penalize: a new bilevel approach to mixed-binary hyperparameter optimization M. D. Santis Jordan Frécon Francesco Rinaldi Saverio Salzo Martin Schmidt Martin Schmidt 51 0 0 21 Aug 2023
An adaptively inexact first-order method for bilevel optimization with application to hyperparameter learning Mohammad Salehi Subhadip Mukherjee Lindon Roberts Matthias Joachim Ehrhardt 24 5 0 19 Aug 2023
Non-Convex Bilevel Optimization with Time-Varying Objective Functions Sen-Fon Lin Daouda Sow Kaiyi Ji Yitao Liang Ness B. Shroff 25 2 0 07 Aug 2023
Doubly Robust Instance-Reweighted Adversarial Training Daouda Sow Sen-Fon Lin Zhangyang Wang Yitao Liang AAML OOD 30 2 0 01 Aug 2023
Accelerating Inexact HyperGradient Descent for Bilevel Optimization Hai-Long Yang Luo Luo C. J. Li Michael I. Jordan 18 13 0 30 Jun 2023
Near-Optimal Nonconvex-Strongly-Convex Bilevel Optimization with Fully First-Order Oracles Le‐Yu Chen Yaohua Ma J. Zhang 84 2 0 26 Jun 2023
Optimal Algorithms for Stochastic Bilevel Optimization under Relaxed Smoothness Conditions Xuxing Chen Tesi Xiao Krishnakumar Balasubramanian 19 24 0 21 Jun 2023
A Generalized Alternating Method for Bilevel Learning under the Polyak-Łojasiewicz Condition Quan-Wu Xiao Songtao Lu Tianyi Chen 24 2 0 04 Jun 2023
Revisiting Data-Free Knowledge Distillation with Poisoned Teachers Junyuan Hong Yi Zeng Shuyang Yu Lingjuan Lyu R. Jia Jiayu Zhou AAML 11 8 0 04 Jun 2023
Federated Multi-Sequence Stochastic Approximation with Local Hypergradient Estimation Davoud Ataee Tarzanagh Mingchen Li Pranay Sharma Samet Oymak 24 0 0 02 Jun 2023
Hyperparameter Learning under Data Poisoning: Analysis of the Influence of Regularization via Multiobjective Bilevel Optimization Javier Carnerero-Cano Luis Muñoz-González P. Spencer Emil C. Lupu AAML 11 3 0 02 Jun 2023
SimFBO: Towards Simple, Flexible and Communication-efficient Federated Bilevel Learning Yifan Yang Peiyao Xiao Kaiyi Ji FedML 24 14 0 30 May 2023