v1v2v3v4v5v6 (latest)

Penalty Method for Inversion-Free Deep Bilevel Optimization

Asian Conference on Machine Learning (ACML), 2019

8 November 2019

Akshay Mehra

Jihun Hamm

ArXiv (abs)PDF HTML

Papers citing "Penalty Method for Inversion-Free Deep Bilevel Optimization"

50 / 58 papers shown

Title
Encoder Fine-tuning with Stochastic Sampling Outperforms Open-weight GPT in Astronomy Knowledge Extraction Shivam Rawat Lucie Flek Akbar Karimi 69 0 0 11 Nov 2025
A Single-Loop First-Order Algorithm for Linearly Constrained Bilevel Optimization Wei Shen Jiawei Zhang Minhui Huang Cong Shen 65 0 0 28 Oct 2025
Sequential QCQP for Bilevel Optimization with Line SearchIEEE Control Systems Letters (L-CSS), 2025 Sina Sharifi Erfan Yazdandoost Hamedani Mahyar Fazlyab 221 0 0 20 May 2025
On Penalty-based Bilevel Gradient Descent MethodInternational Conference on Machine Learning (ICML), 2023 Han Shen Quan-Wu Xiao Tianyi Chen 406 88 0 08 Jan 2025
First-Order Methods for Linearly Constrained Bilevel Optimization Guy Kornowski Swati Padmanabhan Kai Wang Zhe Zhang S. Sra 317 10 0 18 Jun 2024
A Primal-Dual-Assisted Penalty Approach to Bilevel Optimization with Coupled ConstraintsNeural Information Processing Systems (NeurIPS), 2024 Liuyuan Jiang Quan-Wu Xiao Victor M. Tenorio Fernando Real-Rojas Antonio G. Marques Tianyi Chen 290 9 0 14 Jun 2024
An Introduction to Bi-level Optimization: Foundations and Applications in Signal Processing and Machine LearningIEEE Signal Processing Magazine (IEEE Signal Process. Mag.), 2023 Yihua Zhang Prashant Khanduri Ioannis C. Tsaknakis Yuguang Yao Min-Fong Hong Sijia Liu AI4CE 281 46 0 01 Aug 2023
A Generalized Alternating Method for Bilevel Learning under the Polyak-Łojasiewicz Condition Quan-Wu Xiao Songtao Lu Tianyi Chen 344 3 0 04 Jun 2023
Effective Bilevel Optimization via Minimax Reformulation Xiaoyu Wang Boyao Wang Renjie Pi Tong Zhang 185 3 0 22 May 2023
On Momentum-Based Gradient Methods for Bilevel Optimization with Nonconvex Lower-Level Feihu Huang 317 21 0 07 Mar 2023
Averaged Method of Multipliers for Bi-Level Optimization without Lower-Level Strong ConvexityInternational Conference on Machine Learning (ICML), 2023 Risheng Liu Yaohua Liu Wei-Ting Yao Shangzhi Zeng Jin Zhang 190 31 0 07 Feb 2023
A Fully First-Order Method for Stochastic Bilevel OptimizationInternational Conference on Machine Learning (ICML), 2023 Jeongyeol Kwon Dohyun Kwon S. Wright Robert D. Nowak 190 108 0 26 Jan 2023
On Implicit Bias in Overparameterized Bilevel OptimizationInternational Conference on Machine Learning (ICML), 2022 Paul Vicol Jon Lorraine Fabian Pedregosa David Duvenaud Roger C. Grosse AI4CE 226 45 0 28 Dec 2022
DIAMOND: Taming Sample and Communication Complexities in Decentralized Bilevel OptimizationIEEE Conference on Computer Communications (INFOCOM), 2022 Pei-Yuan Qiu Yining Li Zhuqing Liu Prashant Khanduri Jia Liu Ness B. Shroff Elizabeth S. Bentley K. Turck 287 4 0 05 Dec 2022
A Penalty-Based Method for Communication-Efficient Decentralized Bilevel Programming Parvin Nazari Ahmad Mousavi Davoud Ataee Tarzanagh George Michailidis 301 5 0 08 Nov 2022
BOME! Bilevel Optimization Made Easy: A Simple First-Order ApproachNeural Information Processing Systems (NeurIPS), 2022 Mao Ye B. Liu S. Wright Peter Stone Qian Liu 252 118 0 19 Sep 2022
A Globally Convergent Gradient-based Bilevel Hyperparameter Optimization Method Ankur Sinha Satender Gunwal Shivam Kumar 157 2 0 25 Aug 2022
INTERACT: Achieving Low Sample and Communication Complexities in Decentralized Bilevel Learning over NetworksACM Interational Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc), 2022 Zhuqing Liu Xin Zhang Prashant Khanduri Songtao Lu Jia Liu 250 14 0 27 Jul 2022
Communication-Efficient Robust Federated Learning with Noisy LabelsKnowledge Discovery and Data Mining (KDD), 2022 Junyi Li Jian Pei Heng Huang FedML 147 21 0 11 Jun 2022
Local Stochastic Bilevel Optimization with Momentum-Based Variance Reduction Junyi Li Feihu Huang Heng-Chiao Huang FedML 173 29 0 03 May 2022
First-Order Bilevel Topology Optimization for Fast Mechanical Design Zherong Pan Xifeng Gao Kui Wu 100 1 0 13 Apr 2022
A Learnable Variational Model for Joint Multimodal MRI Reconstruction and SynthesisInternational Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2022 Wanyu Bian Qingchao Zhang X. Ye Yunmei Chen DRL 165 25 0 08 Apr 2022
PCENet: High Dimensional Surrogate Modeling for Learning Uncertainty Paz Fink Shustin Shashanka Ubaru Małgorzata J. Zimoń Songtao Lu Vasileios Kalantzis L. Horesh H. Avron 236 3 0 10 Feb 2022
A Fully Single Loop Algorithm for Bilevel Optimization without Hessian Inverse Junyi Li Bin Gu Heng-Chiao Huang 208 81 0 09 Dec 2021
Scalable One-Pass Optimisation of High-Dimensional Weight-Update Hyperparameters by Implicit Differentiation Ross M. Clarke E. T. Oldewage José Miguel Hernández-Lobato 279 9 0 20 Oct 2021
An Optimization-Based Meta-Learning Model for MRI Reconstruction with Diverse Dataset Wanyu Bian Yunmei Chen X. Ye Qingchao Zhang 185 30 0 02 Oct 2021
Understanding the Limits of Unsupervised Domain Adaptation via Data PoisoningNeural Information Processing Systems (NeurIPS), 2021 Akshay Mehra B. Kailkhura Pin-Yu Chen Jihun Hamm AAML 190 24 0 08 Jul 2021
A Value-Function-based Interior-point Method for Non-convex Bi-level Optimization Risheng Liu Xuan Liu Xiaoming Yuan Shangzhi Zeng Jin Zhang 153 90 0 15 Jun 2021
Lower Bounds and Accelerated Algorithms for Bilevel OptimizationJournal of machine learning research (JMLR), 2021 Kaiyi Ji Yingbin Liang 191 63 0 07 Feb 2021
HYDRA: Hypergradient Data Relevance Analysis for Interpreting Deep Neural NetworksAAAI Conference on Artificial Intelligence (AAAI), 2021 Yuanyuan Chen Boyang Albert Li Han Yu Pengcheng Wu Chunyan Miao TDI 322 50 0 04 Feb 2021
Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and BeyondIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021 Risheng Liu Jiaxin Gao Jin Zhang Deyu Meng Zhouchen Lin AI4CE 408 257 0 27 Jan 2021
How Robust are Randomized Smoothing based Defenses to Data Poisoning?Computer Vision and Pattern Recognition (CVPR), 2020 Akshay Mehra B. Kailkhura Pin-Yu Chen Jihun Hamm OOD AAML 255 33 0 02 Dec 2020
Stabilizing Bi-Level Hyperparameter Optimization using Moreau-Yosida Regularization Sauptik Dhar Unmesh Kurup Mohak Shah 145 2 0 27 Jul 2020
A Gradient-based Bilevel Optimization Approach for Tuning Hyperparameters in Machine Learning Ankur Sinha Tanmay Khandait R. Mohanty 137 18 0 21 Jul 2020
A Two-Timescale Framework for Bilevel Optimization: Complexity Analysis and Application to Actor-CriticSIAM Journal on Optimization (SIOPT), 2020 Mingyi Hong Hoi-To Wai Zhaoran Wang Zhuoran Yang 322 169 0 10 Jul 2020
On the Iteration Complexity of Hypergradient Computation Riccardo Grazzi Luca Franceschi Massimiliano Pontil Saverio Salzo 228 224 0 29 Jun 2020
Learning to Impute: A General Framework for Semi-supervised Learning Wei-Hong Li Chuan-Sheng Foo Hakan Bilen SSL 164 10 0 22 Dec 2019
Optimizing Millions of Hyperparameters by Implicit DifferentiationInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2019 Jonathan Lorraine Paul Vicol David Duvenaud DD 277 446 0 06 Nov 2019
Meta-Learning with Implicit GradientsNeural Information Processing Systems (NeurIPS), 2019 Aravind Rajeswaran Chelsea Finn Sham Kakade Sergey Levine 397 934 0 10 Sep 2019
Truncated Back-propagation for Bilevel Optimization Amirreza Shaban Ching-An Cheng Nathan Hatch Byron Boots 302 296 0 25 Oct 2018
Bilevel Programming for Hyperparameter Optimization and Meta-Learning Luca Franceschi P. Frasconi Saverio Salzo Riccardo Grazzi Massimiliano Pontil 334 791 0 13 Jun 2018
K-Beam Minimax: Efficient Optimization for Deep Adversarial Learning Jihun Hamm Yung-Kyun Noh 145 9 0 29 May 2018
Poison Frogs! Targeted Clean-Label Poisoning Attacks on Neural Networks Ali Shafahi Wenjie Huang Mahyar Najibi Octavian Suciu Christoph Studer Tudor Dumitras Tom Goldstein AAML 421 1,186 0 03 Apr 2018
Learning to Reweight Examples for Robust Deep Learning Mengye Ren Wenyuan Zeng Binh Yang R. Urtasun OOD NoLa 294 1,551 0 24 Mar 2018
Learning to Compare: Relation Network for Few-Shot Learning Flood Sung Yongxin Yang Li Zhang Tao Xiang Juil Sock Timothy M. Hospedales 786 4,413 0 16 Nov 2017
Towards Poisoning of Deep Learning Algorithms with Back-gradient Optimization Luis Muñoz-González Battista Biggio Ambra Demontis Andrea Paudice Vasin Wongrassamee Emil C. Lupu Fabio Roli AAML 294 665 0 29 Aug 2017
Transfer Learning with Label Noise Xiyu Yu Tongliang Liu Biwei Huang Kun Zhang Kayhan Batmanghelich Dacheng Tao NoLa 136 32 0 31 Jul 2017
A Simple Neural Attentive Meta-Learner Nikhil Mishra Mostafa Rohaninejad Xi Chen Pieter Abbeel OOD 201 203 0 11 Jul 2017
Prototypical Networks for Few-shot Learning Jake C. Snell Kevin Swersky R. Zemel 531 9,137 0 15 Mar 2017
Understanding Black-box Predictions via Influence Functions Pang Wei Koh Abigail Z. Jacobs TDI 408 3,244 0 14 Mar 2017