Can We Scale Transformers to Predict Parameters of Diverse ImageNet
Models?

Can We Scale Transformers to Predict Parameters of Diverse ImageNet Models?

7 March 2023

Boris Knyazev

Simon Lacoste-Julien

Papers citing "Can We Scale Transformers to Predict Parameters of Diverse ImageNet Models?"

16 / 16 papers shown

Title
A Model Zoo on Phase Transitions in Neural Networks Konstantin Schurholt Léo Meynent Yefan Zhou Haiquan Lu Yaoqing Yang Damian Borth 58 0 0 25 Apr 2025
The Impact of Model Zoo Size and Composition on Weight Space Learning Damian Falk Konstantin Schurholt Damian Borth 32 0 0 14 Apr 2025
Structure Is Not Enough: Leveraging Behavior for Neural Network Weight Reconstruction Léo Meynent Ivan Melev Konstantin Schurholt Göran Kauermann Damian Borth 39 2 0 21 Mar 2025
Neural Network Diffusion Kaili Wang Dongwen Tang Boya Zeng Yida Yin Zhaopan Xu Yukun Zhou Zelin Zang Trevor Darrell Zhuang Liu Yang You DiffM 35 5 0 03 Jan 2025
FINE: Factorizing Knowledge for Initialization of Variable-sized Diffusion Models Yucheng Xie Fu Feng Ruixiao Shi Jing Wang Xin Geng AI4CE 27 1 0 28 Sep 2024
Enhancing Accuracy and Parameter-Efficiency of Neural Representations for Network Parameterization Hongjun Choi Jayaraman J. Thiagarajan Ruben Glatt Shusen Liu 31 0 0 29 Jun 2024
Scale Equivariant Graph Metanetworks Ioannis Kalogeropoulos Giorgos Bouritsas Yannis Panagakis 39 6 0 15 Jun 2024
Towards Scalable and Versatile Weight Space Learning Konstantin Schurholt Michael W. Mahoney Damian Borth 37 15 0 14 Jun 2024
LoGAH: Predicting 774-Million-Parameter Transformers using Graph HyperNetworks with 1/100 Parameters Xinyu Zhou Boris Knyazev Alexia Jolicoeur-Martineau Jie Fu AI4CE 28 0 0 25 May 2024
Transferring Core Knowledge via Learngenes Fu Feng Jing Wang Xin Geng 30 5 0 16 Jan 2024
Generating Interpretable Networks using Hypernetworks Isaac Liao Ziming Liu Max Tegmark 16 2 0 05 Dec 2023
Hyper-Representations as Generative Models: Sampling Unseen Neural Network Weights Konstantin Schurholt Boris Knyazev Xavier Giró-i-Nieto Damian Borth 48 38 0 29 Sep 2022
Learning to Learn with Generative Models of Neural Network Checkpoints William S. Peebles Ilija Radosavovic Tim Brooks Alexei A. Efros Jitendra Malik UQCV 64 64 0 26 Sep 2022
ResNet strikes back: An improved training procedure in timm Ross Wightman Hugo Touvron Hervé Jégou AI4TS 198 477 0 01 Oct 2021
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 237 11,568 0 09 Mar 2017
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 279 39,083 0 01 Sep 2014