On the Iteration Complexity of Hypergradient Computation

29 June 2020

Luca Franceschi

Papers citing "On the Iteration Complexity of Hypergradient Computation"

27 / 127 papers shown

Title
Adversarial Unlearning of Backdoors via Implicit Hypergradient Yi Zeng Si-An Chen Won Park Z. Morley Mao Ming Jin R. Jia AAML 20 172 0 07 Oct 2021
Differentiable Equilibrium Computation with Decision Diagrams for Stackelberg Models of Combinatorial Congestion Games Shinsaku Sakaue Kengo Nakamura 6 3 0 05 Oct 2021
Towards Gradient-based Bilevel Optimization with Non-convex Followers and Beyond Risheng Liu Yaohua Liu Shangzhi Zeng Jin Zhang 19 80 0 01 Oct 2021
Sign-MAML: Efficient Model-Agnostic Meta-Learning by SignSGD Chen Fan Parikshit Ram Sijia Liu FedML 53 16 0 15 Sep 2021
Enhanced Bilevel Optimization via Bregman Distance Feihu Huang Junyi Li Shangqian Gao Heng-Chiao Huang 17 33 0 26 Jul 2021
Tighter Analysis of Alternating Stochastic Gradient Method for Stochastic Nested Problems Tianyi Chen Yuejiao Sun W. Yin 19 33 0 25 Jun 2021
iDARTS: Differentiable Architecture Search with Stochastic Implicit Gradients Miao Zhang Steven W. Su Shirui Pan Xiaojun Chang Ehsan Abbasnejad Reza Haffari 10 68 0 21 Jun 2021
A Value-Function-based Interior-point Method for Non-convex Bi-level Optimization Risheng Liu Xuan Liu Xiaoming Yuan Shangzhi Zeng Jin Zhang 13 79 0 15 Jun 2021
Provably Faster Algorithms for Bilevel Optimization Junjie Yang Kaiyi Ji Yingbin Liang 38 132 0 08 Jun 2021
Stability and Generalization of Bilevel Programming in Hyperparameter Optimization Fan Bao Guoqiang Wu Chongxuan Li Jun Zhu Bo Zhang 22 29 0 08 Jun 2021
A Generalizable Approach to Learning Optimizers Diogo Almeida Clemens Winter Jie Tang Wojciech Zaremba AI4CE 11 29 0 02 Jun 2021
Efficient and Modular Implicit Differentiation Mathieu Blondel Quentin Berthet Marco Cuturi Roy Frostig Stephan Hoyer Felipe Llinares-López Fabian Pedregosa Jean-Philippe Vert 27 214 0 31 May 2021
Regularization Can Help Mitigate Poisoning Attacks... with the Right Hyperparameters Javier Carnerero-Cano Luis Muñoz-González P. Spencer Emil C. Lupu AAML 29 10 0 23 May 2021
Implicit differentiation for fast hyperparameter selection in non-smooth convex learning Quentin Bertrand Quentin Klopfenstein Mathurin Massias Mathieu Blondel Samuel Vaiter Alexandre Gramfort Joseph Salmon 51 26 0 04 May 2021
A General Descent Aggregation Framework for Gradient-based Bi-level Optimization Risheng Liu Pan Mu Xiaoming Yuan Shangzhi Zeng Jin Zhang AI4CE 33 36 0 16 Feb 2021
A Near-Optimal Algorithm for Stochastic Bilevel Optimization via Double-Momentum Prashant Khanduri Siliang Zeng Mingyi Hong Hoi-To Wai Zhaoran Wang Zhuoran Yang 17 129 0 15 Feb 2021
A Single-Timescale Method for Stochastic Bilevel Optimization Tianyi Chen Yuejiao Sun Quan-Wu Xiao W. Yin 16 76 0 09 Feb 2021
Lower Bounds and Accelerated Algorithms for Bilevel Optimization Kaiyi Ji Yingbin Liang 16 57 0 07 Feb 2021
Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyond Risheng Liu Jiaxin Gao Jin Zhang Deyu Meng Zhouchen Lin AI4CE 43 221 0 27 Jan 2021
Convergence Properties of Stochastic Hypergradients Riccardo Grazzi Massimiliano Pontil Saverio Salzo 9 26 0 13 Nov 2020
Modeling and Optimization Trade-off in Meta-learning Katelyn Gao Ozan Sener 4 28 0 24 Oct 2020
Bilevel Optimization: Convergence Analysis and Enhanced Design Kaiyi Ji Junjie Yang Yingbin Liang 26 244 0 15 Oct 2020
Faster SVM Training via Conjugate SMO Alberto Torres-Barrán Carlos M. Alaíz José R. Dorronsoro 14 25 0 19 Mar 2020
Penalty Method for Inversion-Free Deep Bilevel Optimization Akshay Mehra Jihun Hamm 24 45 0 08 Nov 2019
Bilevel Programming for Hyperparameter Optimization and Meta-Learning Luca Franceschi P. Frasconi Saverio Salzo Riccardo Grazzi Massimiliano Pontil 99 715 0 13 Jun 2018
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 278 11,677 0 09 Mar 2017
Forward and Reverse Gradient-Based Hyperparameter Optimization Luca Franceschi Michele Donini P. Frasconi Massimiliano Pontil 115 405 0 06 Mar 2017