Equivariant Deep Weight Space Alignment

Equivariant Deep Weight Space Alignment

20 October 2023

Papers citing "Equivariant Deep Weight Space Alignment"

18 / 18 papers shown

Title
A Model Zoo on Phase Transitions in Neural Networks Konstantin Schurholt Léo Meynent Yefan Zhou Haiquan Lu Yaoqing Yang Damian Borth 58 0 0 25 Apr 2025
The Impact of Model Zoo Size and Composition on Weight Space Learning Damian Falk Konstantin Schurholt Damian Borth 32 0 0 14 Apr 2025
End-to-End Implicit Neural Representations for Classification Alexander Gielisse J. C. V. Gemert 42 0 0 23 Mar 2025
Structure Is Not Enough: Leveraging Behavior for Neural Network Weight Reconstruction Léo Meynent Ivan Melev Konstantin Schurholt Göran Kauermann Damian Borth 42 2 0 21 Mar 2025
Charting and Navigating Hugging Face's Model Atlas Eliahu Horwitz Nitzan Kurer Jonathan Kahana Liel Amar Yedid Hoshen 31 0 0 13 Mar 2025
Scalable Model Merging with Progressive Layer-wise Distillation Jing Xu Jiazheng Li J. Zhang MoMe FedML 83 0 0 18 Feb 2025
Exploring Model Kinship for Merging Large Language Models Yedi Hu Yunzhi Yao N. Zhang Shumin Deng H. Chen MoMe 34 1 0 16 Oct 2024
Revisiting Multi-Permutation Equivariance through the Lens of Irreducible Representations Yonatan Sverdlov Ido Springer Nadav Dym 18 2 0 09 Oct 2024
Wolf2Pack: The AutoFusion Framework for Dynamic Parameter Fusion Bowen Tian Songning Lai Yutao Yue MoMe 20 0 0 08 Oct 2024
Learning on LoRAs: GL-Equivariant Processing of Low-Rank Weight Spaces for Large Finetuned Models Theo Putterman Derek Lim Yoav Gelberg Stefanie Jegelka Haggai Maron AI4CE 43 5 0 05 Oct 2024
Foldable SuperNets: Scalable Merging of Transformers with Different Initializations and Tasks Edan Kinderman Itay Hubara Haggai Maron Daniel Soudry MoMe 45 0 0 02 Oct 2024
Variational Inference Failures Under Model Symmetries: Permutation Invariant Posteriors for Bayesian Neural Networks Yoav Gelberg Tycho F. A. van der Ouderaa Mark van der Wilk Y. Gal AAML 27 3 0 10 Aug 2024
PLeaS -- Merging Models with Permutations and Least Squares Anshul Nasery J. Hayase Pang Wei Koh Sewoong Oh MoMe 36 3 0 02 Jul 2024
Scale Equivariant Graph Metanetworks Ioannis Kalogeropoulos Giorgos Bouritsas Yannis Panagakis 39 6 0 15 Jun 2024
The Empirical Impact of Neural Parameter Symmetries, or Lack Thereof Derek Lim Moe Putterman Robin Walters Haggai Maron Stefanie Jegelka 27 5 0 30 May 2024
Improved Generalization of Weight Space Networks via Augmentations Aviv Shamsian Aviv Navon David W. Zhang Yan Zhang Ethan Fetaya Gal Chechik Haggai Maron 15 5 0 06 Feb 2024
Git Re-Basin: Merging Models modulo Permutation Symmetries Samuel K. Ainsworth J. Hayase S. Srinivasa MoMe 239 313 0 11 Sep 2022
Optimizing Mode Connectivity via Neuron Alignment N. Joseph Tatro Pin-Yu Chen Payel Das Igor Melnyk P. Sattigeri Rongjie Lai MoMe 223 80 0 05 Sep 2020