Parameter Prediction for Unseen Deep Architectures

25 October 2021

Boris Knyazev

M. Drozdzal

Graham W. Taylor

Adriana Romero Soriano

OOD

ArXiv (abs)PDF HTML

Papers citing "Parameter Prediction for Unseen Deep Architectures"

22 / 72 papers shown

Title
Breaking the Architecture Barrier: A Method for Efficient Knowledge Transfer Across Networks Maciej A. Czyzewski Daniel Nowak Kamila Piechowiak 98 3 0 28 Dec 2022
NeRN -- Learning Neural Representations for Neural Networks Maor Ashkenazi Zohar Rimon Ron Vainshtein Shir Levi Elad Richardson Pinchas Mintz Eran Treister 3DH 153 15 0 27 Dec 2022
Transformers over Directed Acyclic Graphs Yu Luo Veronika Thost Lei Shi GNN AI4CE 278 25 0 24 Oct 2022
Compute-Efficient Deep Learning: Algorithmic Trends and Opportunities Brian Bartoldson B. Kailkhura Davis W. Blalock 192 56 0 13 Oct 2022
Meta-Ensemble Parameter Learning Zhengcong Fei Shuman Tian Junshi Huang Xiaoming Wei Xiaolin K. Wei OOD 132 2 0 05 Oct 2022
Efficiently Learning Small Policies for Locomotion and Manipulation Shashank Hegde Gaurav Sukhatme 147 3 0 30 Sep 2022
Model Zoos: A Dataset of Diverse Populations of Neural Network Models Konstantin Schurholt Diyar Taskiran Boris Knyazev Xavier Giró-i-Nieto Damian Borth 169 35 0 29 Sep 2022
Hyper-Representations as Generative Models: Sampling Unseen Neural Network Weights Konstantin Schurholt Boris Knyazev Xavier Giró-i-Nieto Damian Borth 163 50 0 29 Sep 2022
Learning to Learn with Generative Models of Neural Network Checkpoints William S. Peebles Ilija Radosavovic Tim Brooks Alexei A. Efros Jitendra Malik UQCV 202 79 0 26 Sep 2022
GHN-Q: Parameter Prediction for Unseen Quantized Convolutional Architectures via Graph Hypernetworks S. Yun Alexander Wong GNN MQ 48 1 0 26 Aug 2022
Gradient-based Bi-level Optimization for Deep Learning: A Survey Can Chen Xiangshan Chen Chen Ma Zixuan Liu Xue Liu 293 43 0 24 Jul 2022
Hyper-Representations for Pre-Training and Transfer Learning Konstantin Schurholt Boris Knyazev Xavier Giró-i-Nieto Damian Borth 91 12 0 22 Jul 2022
Pretraining a Neural Network before Knowing Its Architecture Boris Knyazev AI4CE 88 1 0 20 Jul 2022
Goal-Conditioned Generators of Deep Policies Francesco Faccio Vincent Herrmann Aditya A. Ramesh Louis Kirsch Jürgen Schmidhuber OffRL 110 10 0 04 Jul 2022
One Hyper-Initializer for All Network Architectures in Medical Image Analysis Fangxin Shang Yehui Yang Dalu Yang Junde Wu Xiaorong Wang Yanwu Xu AI4CE 108 2 0 08 Jun 2022
Graph-level Neural Networks: Current Progress and Future Directions Ge Zhang Hongzhi Zhang Jian Yang Shan Xue Wenbin Hu Chuan Zhou Hao Peng Quan.Z Sheng Charu C. Aggarwal GNN AI4CE 123 0 0 31 May 2022
Automating Neural Architecture Design without Search Zixuan Liang Yanan Sun 3DV 88 0 0 21 Apr 2022
Teaching Networks to Solve Optimization Problems Hengrong Du Yuzhe Lu Ali Abbasi Meiyi Li Javad Mohammadi Soheil Kolouri 137 12 0 08 Feb 2022
Tutorial on amortized optimization Brandon Amos OffRL 353 64 0 01 Feb 2022
From data to functa: Your data point is a function and you can treat it like one Emilien Dupont Hyunjik Kim S. M. Ali Eslami Danilo Jimenez Rezende Dan Rosenbaum TDI 3DPC 381 174 0 28 Jan 2022
Federated Learning with Heterogeneous Architectures using Graph HyperNetworks Or Litany Haggai Maron David Acuna Jan Kautz Gal Chechik Sanja Fidler FedML 121 27 0 20 Jan 2022
Benchmarking Graph Neural Networks Vijay Prakash Dwivedi Chaitanya K. Joshi Anh Tuan Luu T. Laurent Yoshua Bengio Xavier Bresson 904 1,030 0 02 Mar 2020