Stochastic Hyperparameter Optimization through Hypernetworks

26 February 2018

Papers citing "Stochastic Hyperparameter Optimization through Hypernetworks"

47 / 97 papers shown

Title
A Fully Single Loop Algorithm for Bilevel Optimization without Hessian Inverse Junyi Li Bin Gu Heng-Chiao Huang 26 72 0 09 Dec 2021
Meta-Learning to Improve Pre-Training Aniruddh Raghu Jonathan Lorraine Simon Kornblith Matthew B. A. McDermott David Duvenaud 19 30 0 02 Nov 2021
Towards Evaluating the Robustness of Neural Networks Learned by Transduction Jiefeng Chen Xi Wu Yang Guo Yingyu Liang S. Jha ELM AAML 15 15 0 27 Oct 2021
Scalable One-Pass Optimisation of High-Dimensional Weight-Update Hyperparameters by Implicit Differentiation Ross M. Clarke E. T. Oldewage José Miguel Hernández-Lobato 28 9 0 20 Oct 2021
Meta Internal Learning Raphael Bensadoun Shir Gur Tomer Galanti Lior Wolf GAN 31 8 0 06 Oct 2021
EvoGrad: Efficient Gradient-Based Meta-Learning and Hyperparameter Optimization Ondrej Bohdal Yongxin Yang Timothy M. Hospedales 18 20 0 19 Jun 2021
Towards Adversarial Robustness via Transductive Learning Jiefeng Chen Yang Guo Xi Wu Tianqi Li Qicheng Lao Yingyu Liang S. Jha AAML 18 5 0 15 Jun 2021
Stability and Generalization of Bilevel Programming in Hyperparameter Optimization Fan Bao Guoqiang Wu Chongxuan Li Jun Zhu Bo Zhang 30 30 0 08 Jun 2021
BaMBNet: A Blur-aware Multi-branch Network for Defocus Deblurring Pengwei Liang Junjun Jiang Xianming Liu Jiayi Ma Mamba 36 4 0 31 May 2021
Personalized Federated Learning using Hypernetworks Aviv Shamsian Aviv Navon Ethan Fetaya Gal Chechik FedML 41 324 0 08 Mar 2021
Complex Momentum for Optimization in Games Jonathan Lorraine David Acuna Paul Vicol David Duvenaud 20 9 0 16 Feb 2021
A General Descent Aggregation Framework for Gradient-based Bi-level Optimization Risheng Liu Pan Mu Xiaoming Yuan Shangzhi Zeng Jin Zhang AI4CE 33 36 0 16 Feb 2021
Online hyperparameter optimization by real-time recurrent learning Daniel Jiwoong Im Cristina Savin Kyunghyun Cho 19 7 0 15 Feb 2021
Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyond Risheng Liu Jiaxin Gao Jin Zhang Deyu Meng Zhouchen Lin AI4CE 59 222 0 27 Jan 2021
Cost-Efficient Online Hyperparameter Optimization Jingkang Wang Mengye Ren Ilija Bogunovic Yuwen Xiong R. Urtasun 34 2 0 17 Jan 2021
Regularization-Agnostic Compressed Sensing MRI Reconstruction with Hypernetworks Alan Q. Wang Adrian V. Dalca M. Sabuncu OOD 40 12 0 06 Jan 2021
HyperMorph: Amortized Hyperparameter Learning for Image Registration Andrew Hoopes Malte Hoffmann Bruce Fischl John Guttag Adrian V. Dalca 36 128 0 04 Jan 2021
Optimizing Optimizers: Regret-optimal gradient descent algorithms P. Casgrain Anastasis Kratsios 14 5 0 31 Dec 2020
Teaching with Commentaries Aniruddh Raghu M. Raghu Simon Kornblith David Duvenaud Geoffrey E. Hinton 22 24 0 05 Nov 2020
Delta-STN: Efficient Bilevel Optimization for Neural Networks using Structured Response Jacobians Juhan Bae Roger C. Grosse 27 24 0 26 Oct 2020
Hidden Incentives for Auto-Induced Distributional Shift David M. Krueger Tegan Maharaj Jan Leike 11 49 0 19 Sep 2020
Improved Bilevel Model: Fast and Optimal Algorithm with Theoretical Guarantee Junyi Li Bin Gu Heng-Chiao Huang 18 41 0 01 Sep 2020
HALO: Learning to Prune Neural Networks with Shrinkage Skyler Seto M. Wells Wenyu Zhang 19 0 0 24 Aug 2020
Stabilizing Bi-Level Hyperparameter Optimization using Moreau-Yosida Regularization Sauptik Dhar Unmesh Kurup Mohak Shah 30 2 0 27 Jul 2020
A Gradient-based Bilevel Optimization Approach for Tuning Hyperparameters in Machine Learning Ankur Sinha Tanmay Khandait R. Mohanty 35 16 0 21 Jul 2020
OnlineAugment: Online Data Augmentation with Less Domain Knowledge Zhiqiang Tang Yunhe Gao Leonid Karlinsky P. Sattigeri Rogerio Feris Dimitris N. Metaxas 19 56 0 17 Jul 2020
Hyperparameter Ensembles for Robustness and Uncertainty Quantification F. Wenzel Jasper Snoek Dustin Tran Rodolphe Jenatton UQCV 33 204 0 24 Jun 2020
A Generic First-Order Algorithmic Framework for Bi-Level Programming Beyond Lower-Level Singleton Risheng Liu Pan Mu Xiaoming Yuan Shangzhi Zeng Jin Zhang 6 129 0 07 Jun 2020
MetaInv-Net: Meta Inversion Network for Sparse View CT Image Reconstruction Haimiao Zhang Baodong Liu Hengyong Yu Bin Dong 21 61 0 30 May 2020
Online Hyperparameter Search Interleaved with Proximal Parameter Updates Luis Miguel Lopez Ramos B. Beferull-Lozano 11 3 0 06 Apr 2020
On Infinite-Width Hypernetworks Etai Littwin Tomer Galanti Lior Wolf Greg Yang 6 11 0 27 Mar 2020
On the Modularity of Hypernetworks Tomer Galanti Lior Wolf 11 5 0 23 Feb 2020
Robust Federated Learning Through Representation Matching and Adaptive Hyper-parameters Hesham Mostafa FedML 25 39 0 30 Dec 2019
Learning to Impute: A General Framework for Semi-supervised Learning Wei-Hong Li Chuan-Sheng Foo Hakan Bilen SSL 24 9 0 22 Dec 2019
Optimizing Millions of Hyperparameters by Implicit Differentiation Jonathan Lorraine Paul Vicol David Duvenaud DD 27 402 0 06 Nov 2019
Efficient Optimization of Loops and Limits with Randomized Telescoping Sums Alex Beatson Ryan P. Adams 9 21 0 16 May 2019
A Generative Model for Sampling High-Performance and Diverse Weights for Neural Networks Lior Deutsch Erik Nijkamp Yu Yang 13 16 0 07 May 2019
Least Squares Auto-Tuning Shane T. Barratt Stephen P. Boyd MoMe 19 23 0 10 Apr 2019
Self-Tuning Networks: Bilevel Optimization of Hyperparameters using Structured Best-Response Functions M. Mackay Paul Vicol Jonathan Lorraine David Duvenaud Roger C. Grosse 27 164 0 07 Mar 2019
Hypernetwork functional image representation Sylwester Klocek Lukasz Maziarka Maciej Wołczyk Jacek Tabor Jakub Nowak Marek Śmieja SupR 3DH 21 90 0 27 Feb 2019
HyperGAN: A Generative Model for Diverse, Performant Neural Networks Neale Ratzlaff Fuxin Li 20 63 0 30 Jan 2019
Regularization Learning Networks: Deep Learning for Tabular Datasets Ira Shavitt E. Segal AI4CE 26 20 0 16 May 2018
A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decay L. Smith 208 1,020 0 26 Mar 2018
Learning to Reweight Examples for Robust Deep Learning Mengye Ren Wenyuan Zeng Binh Yang R. Urtasun OOD NoLa 57 1,410 0 24 Mar 2018
Generating Neural Networks with Neural Networks Lior Deutsch 33 21 0 06 Jan 2018
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 365 11,700 0 09 Mar 2017
Forward and Reverse Gradient-Based Hyperparameter Optimization Luca Franceschi Michele Donini P. Frasconi Massimiliano Pontil 133 409 0 06 Mar 2017