Parameter Prediction for Unseen Deep Architectures

25 October 2021

Boris Knyazev

M. Drozdzal

Graham W. Taylor

Adriana Romero Soriano

OOD

ArXiv (abs)PDF HTML

Papers citing "Parameter Prediction for Unseen Deep Architectures"

50 / 72 papers shown

Title
SBS: Enhancing Parameter-Efficiency of Neural Representations for Neural Networks via Spectral Bias Suppression Qihu Xie Yuan Li Yi Kang 16 0 0 09 Sep 2025
Semantic-guided LoRA Parameters Generation Miaoge Li Yang Chen Zhijie Rao Can Jiang Jingcai Guo OffRL 20 0 0 05 Sep 2025
NeuroVoxel-LM: Language-Aligned 3D Perception via Dynamic Voxelization and Meta-Embedding Shiyu Liu Lianlei Shan 47 0 0 27 Jul 2025
An open dataset of neural networks for hypernetwork research David Kurtenbach Lior Shamir 48 0 0 15 Jul 2025
Starting Positions Matter: A Study on Better Weight Initialization for Neural Network Quantization S. Yun A. Wong MQ 150 0 0 12 Jun 2025
Generative Modeling of Weights: Generalization or Memorization? Boya Zeng Yida Yin Zhiqiu Xu Zhuang Liu DiffM 100 1 0 09 Jun 2025
Projectable Models: One-Shot Generation of Small Specialized Transformers from Large Ones A. Zhmoginov Jihwan Lee Mark Sandler 101 0 0 06 Jun 2025
A Model Zoo on Phase Transitions in Neural Networks Konstantin Schurholt Léo Meynent Yefan Zhou Haiquan Lu Yaoqing Yang Damian Borth 194 1 0 25 Apr 2025
HyperFlow: Gradient-Free Emulation of Few-Shot Fine-Tuning Donggyun Kim Chanwoo Kim Seunghoon Hong 96 0 0 21 Apr 2025
Scaling LLaNA: Advancing NeRF-Language Understanding Through Large-Scale Training Andrea Amaduzzi Pierluigi Zama Ramirez Giuseppe Lisanti Samuele Salti Luigi Di Stefano 149 1 0 18 Apr 2025
A Model Zoo of Vision Transformers Damian Falk Léo Meynent Florence Pfammatter Konstantin Schurholt Damian Borth 316 2 0 14 Apr 2025
The Impact of Model Zoo Size and Composition on Weight Space Learning Damian Falk Konstantin Schurholt Damian Borth 179 1 0 14 Apr 2025
Instruction-Guided Autoregressive Neural Network Parameter Generation Soro Bedionita Bruno Andreis Song Chong Sung Ju Hwang DiffM 124 1 0 02 Apr 2025
Structure Is Not Enough: Leveraging Behavior for Neural Network Weight Reconstruction Léo Meynent Ivan Melev Konstantin Schurholt Göran Kauermann Damian Borth 189 5 0 21 Mar 2025
Neural Network Diffusion Kaili Wang Dongwen Tang Boya Zeng Yida Yin Zhaopan Xu Yukun Zhou Zelin Zang Trevor Darrell Zhuang Liu Yang You DiffM 230 32 0 03 Jan 2025
TART: Token-based Architecture Transformer for Neural Network Performance Prediction Yannis Y. He 113 0 0 02 Jan 2025
Paragon: Parameter Generation for Controllable Multi-Task RecommendationACM Conference on Recommender Systems (RecSys), 2024 Chenglei Shen Jiahao Zhao Xiao Zhang Weijie Yu Ming He Jianping Fan 28 5 0 14 Oct 2024
Neural Metamorphosis Xingyi Yang Xinchao Wang 127 4 0 10 Oct 2024
FINE: Factorizing Knowledge for Initialization of Variable-sized Diffusion Models Yucheng Xie Fu Feng Ruixiao Shi Jing Wang Xin Geng AI4CE 111 4 0 28 Sep 2024
Monomial Matrix Group Equivariant Neural Functional Networks Hoang V. Tran Thieu N. Vo Tho H. Tran An T. Nguyen Tan M. Nguyen 208 10 0 18 Sep 2024
Implicit Neural Representation For Accurate CFD Flow Field Prediction L. D. Vito Nils Pinnau Simone Dey AI4CE 136 1 0 12 Aug 2024
Conditional LoRA Parameter Generation Aaron Mueller Millicent Li Koyena Pal Wangbo Zhao Yukun Zhou Jiuding Sun Yonatan Belinkov DiffM 112 8 0 02 Aug 2024
Younger: The First Dataset for Artificial Intelligence-Generated Neural Network Architecture Zhengxin Yang Wanling Gao Luzhou Peng Yunyou Huang Fei Tang Jianfeng Zhan 104 1 0 20 Jun 2024
LLaNA: Large Language and NeRF Assistant Andrea Amaduzzi Pierluigi Zama Ramirez Giuseppe Lisanti Samuele Salti Luigi Di Stefano 144 7 0 17 Jun 2024
Scale Equivariant Graph Metanetworks Ioannis Kalogeropoulos Giorgos Bouritsas Yannis Panagakis 213 14 0 15 Jun 2024
Towards Scalable and Versatile Weight Space Learning Konstantin Schurholt Michael W. Mahoney Damian Borth 143 25 0 14 Jun 2024
LoGAH: Predicting 774-Million-Parameter Transformers using Graph HyperNetworks with 1/100 Parameters Xinyu Zhou Boris Knyazev Alexia Jolicoeur-Martineau Jie Fu AI4CE 95 0 0 25 May 2024
Connecting NeRFs, Images, and Text Francesco Ballerini Pierluigi Zama Ramirez Roberto Mirabella Samuele Salti Luigi Di Stefano 172 6 0 11 Apr 2024
Graph Neural Networks for Learning Equivariant Representations of Neural Networks Miltiadis Kofinas Boris Knyazev Yan Zhang Yunlu Chen Gertjan J. Burghouts E. Gavves Cees G. M. Snoek David W. Zhang 159 45 0 18 Mar 2024
Transferring Core Knowledge via Learngenes Fu Feng Jing Wang Xin Geng 141 8 0 16 Jan 2024
Deep Learning on Object-centric 3D Neural Fields Pierluigi Zama Ramirez Luca de Luigi Daniele Sirocchi Adriano Cardace Riccardo Spezialetti Francesco Ballerini Samuele Salti Luigi Di Stefano 155 5 0 20 Dec 2023
Graph Metanetworks for Processing Diverse Neural Architectures Derek Lim Haggai Maron Marc T. Law Jonathan Lorraine James Lucas AI4CE 202 43 0 07 Dec 2023
Generating Interpretable Networks using Hypernetworks Isaac Liao Ziming Liu Max Tegmark 116 2 0 05 Dec 2023
Task-Agnostic Low-Rank Adapters for Unseen English Dialects Zedian Xiao William B. Held Yanchen Liu Diyi Yang 140 10 0 02 Nov 2023
ArchBERT: Bi-Modal Understanding of Neural Architectures and Natural Languages Mohammad Akbari Saeed Ranjbar Alvar Behnam Kamranian Amin Banitalebi-Dehkordi Yong Zhang AI4CE 60 1 0 26 Oct 2023
From Pointwise to Powerhouse: Initialising Neural Networks with Generative Models Christian Harder Moritz Fuchs Yuri Tolkach Anirban Mukhopadhyay 117 0 0 25 Oct 2023
Learning to Generate Parameters of ConvNets for Unseen Image Data Shiye Wang Kaituo Feng Changsheng Li Ye Yuan Guoren Wang 127 1 0 18 Oct 2023
HyperPPO: A scalable method for finding small policies for robotic control Luming Tang Zhehui Huang Gaurav Sukhatme 106 5 0 28 Sep 2023
GHN-QAT: Training Graph Hypernetworks to Predict Quantization-Robust Parameters of Unseen Limited Precision Neural Networks S. Yun Alexander Wong MQ 92 0 0 24 Sep 2023
Fast Unsupervised Deep Outlier Model Selection with Hypernetworks Xueying Ding Yue Zhao Leman Akoglu OODD 91 7 0 20 Jul 2023
Amortized Inference for Gaussian Process Hyperparameters of Structured Kernels M. Bitzer Mona Meister Christoph Zimmer 111 10 0 16 Jun 2023
Rethink DARTS Search Space and Renovate a New Benchmark Jiuling Zhang Zhiming Ding 102 3 0 12 Jun 2023
ATT3D: Amortized Text-to-3D Object Synthesis Jonathan Lorraine Kevin Xie Fangyin Wei Chen-Hsuan Lin Towaki Takikawa Nicholas Sharp Nayeon Lee Xuan Li Sanja Fidler James Lucas DiffM 134 94 0 06 Jun 2023
Generating Behaviorally Diverse Policies with Latent Diffusion Models Shashank Hegde Sumeet Batra K.R. Zentner Gaurav Sukhatme 148 16 0 30 May 2023
Neural Functional Transformers Allan Zhou Kaien Yang Yiding Jiang Kaylee Burns Winnie Xu Samuel Sokota J. Zico Kolter Chelsea Finn 112 41 0 22 May 2023
Can We Scale Transformers to Predict Parameters of Diverse ImageNet Models? Boris Knyazev Doha Hwang Simon Lacoste-Julien AI4CE 120 27 0 07 Mar 2023
Permutation Equivariant Neural Functionals Allan Zhou Kaien Yang Kaylee Burns Adriano Cardace Yiding Jiang Samuel Sokota J. Zico Kolter Chelsea Finn 194 61 0 27 Feb 2023
Deep Learning on Implicit Neural Representations of Shapes Luca de Luigi Adriano Cardace Riccardo Spezialetti Pierluigi Zama Ramirez Samuele Salti Luigi Di Stefano 129 54 0 10 Feb 2023
Equivariant Architectures for Learning in Deep Weight Spaces Aviv Navon Aviv Shamsian Idan Achituve Ethan Fetaya Gal Chechik Haggai Maron 190 81 0 30 Jan 2023
State of the Art and Potentialities of Graph-level Learning Zhenyu Yang Ge Zhang Hongzhi Zhang Jian Yang Quan.Z Sheng ... Charu C. Aggarwal Hao Peng Wenbin Hu Edwin R. Hancock Pietro Lio GNN AI4CE 169 20 0 14 Jan 2023