Principled Weight Initialization for Hypernetworks

13 December 2023

Papers citing "Principled Weight Initialization for Hypernetworks"

48 / 48 papers shown

Title
HyDA: Hypernetworks for Test Time Domain Adaptation in Medical Imaging Analysis Doron Serebro Tammy Riklin-Raviv OOD 60 0 0 06 Mar 2025
Pareto Set Learning for Multi-Objective Reinforcement Learning Erlong Liu Yu-Chang Wu Xiaobin Huang Chengrui Gao Ren-Jian Wang Ke Xue Chao Qian OffRL 42 2 0 12 Jan 2025
HyperCLIP: Adapting Vision-Language models with Hypernetworks Victor Akinwande Mohammad Sadegh Norouzzadeh Devin Willmott Anna Bair Madan Ravi Ganesh J. Zico Kolter CLIP VLM 88 0 0 21 Dec 2024
DECODE: Domain-aware Continual Domain Expansion for Motion Prediction Boqi Li Haojie Zhu Henry X. Liu 73 0 0 26 Nov 2024
HyperFusion: A Hypernetwork Approach to Multimodal Integration of Tabular and Medical Imaging Data for Predictive Modeling Daniel Duenias Brennan Nichyporuk Tal Arbel Tammy Riklin-Raviv 34 3 0 20 Mar 2024
Effect of Optimizer, Initializer, and Architecture of Hypernetworks on Continual Learning from Demonstration Sayantan Auddy Sebastian Bergner J. Piater 38 0 0 31 Dec 2023
Principled Weight Initialisation for Input-Convex Neural Networks Pieter-Jan Hoedt G. Klambauer 30 5 0 19 Dec 2023
Each Test Image Deserves A Specific Prompt: Continual Test-Time Adaptation for 2D Medical Image Segmentation Ziyang Chen Yongsheng Pan Yiwen Ye Mengkang Lu Yong-quan Xia OOD VLM MedIm 35 5 0 30 Nov 2023
Differential Evolution Algorithm based Hyper-Parameters Selection of Convolutional Neural Network for Speech Command Recognition Sandipan Dhar Anuvab Sen Aritra Bandyopadhyay N. D. Jana Arjun Ghosh Zahra Sarayloo 9 0 0 13 Oct 2023
Recurrent Hypernetworks are Surprisingly Strong in Meta-RL Jacob Beck Risto Vuorio Zheng Xiong Shimon Whiteson 27 9 0 26 Sep 2023
CoNeS: Conditional neural fields with shift modulation for multi-sequence MRI translation Yunjie Chen Marius Staring O. M. Neve Stephan R. Romeijn Erik F. Hensen Berit M. Verbist J. Wolterink Qian Tao DiffM MedIm 20 3 0 06 Sep 2023
A Brief Review of Hypernetworks in Deep Learning Vinod Kumar Chauhan Jiandong Zhou Ping Lu Soheila Molaei David A. Clifton 25 93 0 12 Jun 2023
Dynamic Inter-treatment Information Sharing for Individualized Treatment Effects Estimation V. Chauhan Jiandong Zhou Ghadeer O. Ghosheh Soheila Molaei David A. Clifton 25 8 0 25 May 2023
Focus Your Attention (with Adaptive IIR Filters) Shahar Lutati Itamar Zimerman Lior Wolf 32 9 0 24 May 2023
Magnitude Invariant Parametrizations Improve Hypernetwork Learning Jose Javier Gonzalez Ortiz John Guttag Adrian V. Dalca 26 7 0 15 Apr 2023
Scale-Space Hypernetworks for Efficient Biomedical Imaging Jose Javier Gonzalez Ortiz John Guttag Adrian V. Dalca 33 0 0 11 Apr 2023
Universal Morphology Control via Contextual Modulation Zheng Xiong Jacob Beck Shimon Whiteson 25 12 0 22 Feb 2023
Hypernetworks build Implicit Neural Representations of Sounds Filip Szatkowski Karol J. Piczak Przemtslaw Spurek Jacek Tabor Tomasz Trzciñski 22 11 0 09 Feb 2023
Equivariant Architectures for Learning in Deep Weight Spaces Aviv Navon Aviv Shamsian Idan Achituve Ethan Fetaya Gal Chechik Haggai Maron 33 63 0 30 Jan 2023
Modelling Long Range Dependencies in $N$ D: From Task-Specific to a General Purpose CNN David M. Knigge David W. Romero Albert Gu E. Gavves Erik J. Bekkers Jakub M. Tomczak Mark Hoogendoorn J. Sonke 3DV 27 21 0 25 Jan 2023
HMOE: Hypernetwork-based Mixture of Experts for Domain Generalization Jingang Qu T. Faney Zehao Wang Patrick Gallinari Soleiman Yousef J. D. Hemptinne OOD 18 7 0 15 Nov 2022
Active Predictive Coding: A Unified Neural Framework for Learning Hierarchical World Models for Perception and Planning Rajesh P. N. Rao Dimitrios C. Gklezakos V. Sathish AI4CE 11 10 0 23 Oct 2022
Hypernetworks in Meta-Reinforcement Learning Jacob Beck Matthew Jackson Risto Vuorio Shimon Whiteson OffRL 21 30 0 20 Oct 2022
DUET: A Tuning-Free Device-Cloud Collaborative Parameters Generation Framework for Efficient Device Model Generalization Zheqi Lv Wenqiao Zhang Shengyu Zhang Kun Kuang Feng Wang ... Zhengyu Chen T. Shen Hongxia Yang Bengchin Ooi Fei Wu 39 52 0 12 Sep 2022
Meta-Learning over Time for Destination Prediction Tasks M. Tenzer Z. Rasheed Khurram Hassan-Shafique Nuno Vasconcelos AI4TS 17 6 0 29 Jun 2022
Towards a General Purpose CNN for Long Range Dependencies in $N$ D David W. Romero David M. Knigge Albert Gu Erik J. Bekkers E. Gavves Jakub M. Tomczak Mark Hoogendoorn 16 19 0 07 Jun 2022
A Unified Weight Initialization Paradigm for Tensorial Convolutional Neural Networks Y. Pan Zeyong Su Ao Liu Jingquan Wang Nannan Li Zenglin Xu 27 11 0 28 May 2022
Multilingual Machine Translation with Hyper-Adapters Christos Baziotis Mikel Artetxe James Cross Shruti Bhosale 65 21 0 22 May 2022
Learning the Effect of Registration Hyperparameters with HyperMorph Andrew Hoopes Malte Hoffmann Douglas N. Greve Bruce Fischl John Guttag Adrian V. Dalca 28 38 0 30 Mar 2022
Hyperdecoders: Instance-specific decoders for multi-task NLP Hamish Ivison Matthew E. Peters AI4CE 24 20 0 15 Mar 2022
Federated Learning with Heterogeneous Architectures using Graph HyperNetworks Or Litany Haggai Maron David Acuna Jan Kautz Gal Chechik Sanja Fidler FedML 28 24 0 20 Jan 2022
Parameter Prediction for Unseen Deep Architectures Boris Knyazev M. Drozdzal Graham W. Taylor Adriana Romero Soriano OOD 22 78 0 25 Oct 2021
Block Contextual MDPs for Continual Learning Shagun Sodhani Franziska Meier Joelle Pineau Amy Zhang CLL 20 25 0 13 Oct 2021
Learning Multi-Objective Curricula for Robotic Policy Learning Jikun Kang Miao Liu Abhinav Gupta C. Pal Xue Liu Jie Fu 34 4 0 06 Oct 2021
Discretization-independent surrogate modeling over complex geometries using hypernetworks and implicit representations J. Duvall Karthik Duraisamy Shaowu Pan AI4CE 29 3 0 14 Sep 2021
Recomposing the Reinforcement Learning Building Blocks with Hypernetworks Shai Keynan Elad Sarafian Sarit Kraus OffRL 13 28 0 12 Jun 2021
HyperHyperNetworks for the Design of Antenna Arrays Shahar Lutati Lior Wolf 14 3 0 09 May 2021
HyperDynamics: Meta-Learning Object and Agent Dynamics with Hypernetworks Zhou Xian Shamit Lal H. Tung Emmanouil Antonios Platanios Katerina Fragkiadaki AI4CE 30 23 0 17 Mar 2021
Posterior Meta-Replay for Continual Learning Christian Henning Maria R. Cervera Francesco DÁngelo J. Oswald Regina Traber Benjamin Ehret Seijin Kobayashi Benjamin Grewe João Sacramento CLL BDL 51 54 0 01 Mar 2021
Infinitely Deep Bayesian Neural Networks with Stochastic Differential Equations Winnie Xu Ricky T. Q. Chen Xuechen Li D. Duvenaud BDL UQCV 21 46 0 12 Feb 2021
Regularization-Agnostic Compressed Sensing MRI Reconstruction with Hypernetworks Alan Q. Wang Adrian V. Dalca M. Sabuncu OOD 32 12 0 06 Jan 2021
Adversarial Generation of Continuous Images Ivan Skorokhodov Savva Ignatyev Mohamed Elhoseiny GAN 11 170 0 24 Nov 2020
WeightAlign: Normalizing Activations by Weight Alignment Xiangwei Shi Yun-qiang Li X. Liu J. C. V. Gemert 9 0 0 14 Oct 2020
Controllable Pareto Multi-Task Learning Xi Lin Zhiyuan Yang Qingfu Zhang Sam Kwong MoE 68 73 0 13 Oct 2020
The Heterogeneity Hypothesis: Finding Layer-Wise Differentiated Network Architectures Yawei Li Wen Li Martin Danelljan K. Zhang Shuhang Gu Luc Van Gool Radu Timofte 26 18 0 29 Jun 2020
Class Normalization for (Continual)? Generalized Zero-Shot Learning Ivan Skorokhodov Mohamed Elhoseiny VLM 16 5 0 19 Jun 2020
On Infinite-Width Hypernetworks Etai Littwin Tomer Galanti Lior Wolf Greg Yang 6 11 0 27 Mar 2020
On the Modularity of Hypernetworks Tomer Galanti Lior Wolf 6 5 0 23 Feb 2020