v1v2v3v4v5 (latest)

On the Symmetries of Deep Learning Models and their Internal Representations

Neural Information Processing Systems (NeurIPS), 2022

27 May 2022

Papers citing "On the Symmetries of Deep Learning Models and their Internal Representations"

42 / 42 papers shown

Title
The Alexander-Hirschowitz theorem for neurovarieties A. Massarenti M. Mella 20 0 0 24 Nov 2025
Symmetry-Aware Graph Metanetwork Autoencoders: Model Merging through Parameter Canonicalization Odysseas Boufalis Jorge Carrasco-Pollo Joshua Rosenthal Eduardo Terres-Caballero Alejandro García-Castellanos 68 0 0 16 Nov 2025
Model Unmerging: Making Your Models Unmergeable for Secure Model Sharing Zihao Wang Enneng Yang L. Yin Shiwei Liu Li Shen FedML MoMe 128 0 0 01 Sep 2025
Cross-Model Semantics in Representation Learning Saleh Nikooroo Thomas Engel 118 0 0 05 Aug 2025
Emergence of Quantised Representations Isolated to Anisotropic Functions George Bird 93 0 0 16 Jul 2025
Identifiability of Deep Polynomial Neural Networks K. Usevich Clara Dérand Ricardo Augusto Borsoi Marianne Clausel 167 3 0 20 Jun 2025
Symmetry in Neural Network Parameter Spaces Bo Zhao Robin Walters Rose Yu 261 6 0 16 Jun 2025
Meta Pruning via Graph Metanetworks : A Universal Meta Learning Framework for Network Pruning Yewei Liu Xiyuan Wang Muhan Zhang DD GNN 253 0 0 24 May 2025
Domain-Specific Pruning of Large Mixture-of-Experts Models with Few-shot Demonstrations Zican Dong Han Peng Peiyu Liu Wayne Xin Zhao Dong Wu Feng Xiao Liang Luo MoE 242 3 0 09 Apr 2025
ARC: Anchored Representation Clouds for High-Resolution INR Classification Joost Luijmes Alexander Gielisse Roman Knyazhitskiy Jan van Gemert 220 2 0 19 Mar 2025
Recursive Self-Similarity in Deep Weight Spaces of Neural Architectures: A Fractal and Coarse Geometry Perspective A. Moharil I. Kumara Damian Tamburri Majid Mohammadi Willem-jan Van Den Heuvel 266 0 0 18 Mar 2025
Machine Learning meets Algebraic Combinatorics: A Suite of Datasets Capturing Research-level Conjecturing Ability in Pure Mathematics Herman Chau Helen Jenne Davis Brown Jesse He Mark Raugas Sara Billey Henry Kvinge 182 2 0 09 Mar 2025
The Empirical Impact of Reducing Symmetries on the Performance of Deep Ensembles and MoE Andrei Chernov Oleg Novitskij 348 1 0 24 Feb 2025
Beyond the Permutation Symmetry of Transformers: The Role of Rotation for Model Fusion Binchi Zhang Zaiyi Zheng Zhengzhang Chen Wenlin Yao 490 5 0 01 Feb 2025
Nonlinear dynamics of localization in neural receptive fieldsNeural Information Processing Systems (NeurIPS), 2025 Leon Lufkin Andrew M. Saxe Erin Grant 210 2 0 28 Jan 2025
Locking Down the Finetuned LLMs Safety Minjun Zhu Linyi Yang Yifan Wei Ningyu Zhang Yue Zhang 232 21 0 14 Oct 2024
Sequencing the Neurome: Towards Scalable Exact Parameter Reconstruction of Black-Box Neural Networks Judah Goldfeder Quinten Roets Gabe Guo John Wright Hod Lipson 165 1 0 27 Sep 2024
Monomial Matrix Group Equivariant Neural Functional NetworksNeural Information Processing Systems (NeurIPS), 2024 Hoang V. Tran Thieu N. Vo Tho H. Tran An T. Nguyen Tan M. Nguyen 383 13 0 18 Sep 2024
Relative Representations: Topological and Geometric Perspectives Alejandro García-Castellanos Giovanni Luca Marchetti Danica Kragic Martina Scolamiero 320 4 0 17 Sep 2024
Remove Symmetries to Control Model Expressivity and Improve OptimizationInternational Conference on Learning Representations (ICLR), 2024 Liu Ziyin Yizhou Xu Isaac Chuang AAML 449 4 0 28 Aug 2024
Weight Scope Alignment: A Frustratingly Easy Method for Model MergingEuropean Conference on Artificial Intelligence (ECAI), 2024 Yichu Xu Xin-Chun Li Le Gan De-Chuan Zhan MoMe 243 2 0 22 Aug 2024
Neural Lineage Runpeng Yu Xinchao Wang 240 6 0 17 Jun 2024
Scale Equivariant Graph Metanetworks Ioannis Kalogeropoulos Giorgos Bouritsas Yannis Panagakis 300 15 0 15 Jun 2024
The Empirical Impact of Neural Parameter Symmetries, or Lack Thereof Derek Lim Moe Putterman Robin Walters Haggai Maron Stefanie Jegelka 396 14 0 30 May 2024
Universal Neural Functionals Allan Zhou Chelsea Finn James Harrison 210 22 0 07 Feb 2024
Unification of Symmetries Inside Neural Networks: Transformer, Feedforward and Neural ODE Koji Hashimoto Yuji Hirono Akiyoshi Sannai AI4CE 182 12 0 04 Feb 2024
Universal Neurons in GPT2 Language Models Wes Gurnee Theo Horsley Zifan Carl Guo Tara Rezaei Kheirkhah Qinyi Sun Will Hathaway Neel Nanda Dimitris Bertsimas MILM 281 76 0 22 Jan 2024
Graph Metanetworks for Processing Diverse Neural Architectures Derek Lim Haggai Maron Marc T. Law Jonathan Lorraine James Lucas AI4CE 303 43 0 07 Dec 2023
Understanding the Inner Workings of Language Models Through Representation DissimilarityConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Davis Brown Charles Godfrey Nicholas Konz Jonathan Tu Henry Kvinge 165 12 0 23 Oct 2023
On permutation symmetries in Bayesian neural network posteriors: a variational perspectiveNeural Information Processing Systems (NeurIPS), 2023 Simone Rossi Ankit Singh T. Hannagan 187 3 0 16 Oct 2023
A Symmetry-Aware Exploration of Bayesian Neural Network PosteriorsInternational Conference on Learning Representations (ICLR), 2023 Olivier Laurent Emanuel Aldea Gianni Franchi BDL UQCV 239 9 0 12 Oct 2023
Going Beyond Neural Network Feature Similarity: The Network Feature Complexity and Its Interpretation Using Category TheoryInternational Conference on Learning Representations (ICLR), 2023 Yiting Chen Zhanpeng Zhou Junchi Yan 220 10 0 10 Oct 2023
Transformer Fusion with Optimal TransportInternational Conference on Learning Representations (ICLR), 2023 Moritz Imfeld Jacopo Graldi Marco Giordano Thomas Hofmann Sotiris Anagnostidis Sidak Pal Singh ViT MoMe 394 28 0 09 Oct 2023
Deep Model Fusion: A Survey Weishi Li Yong Peng Miao Zhang Liang Ding Han Hu Li Shen FedML MoMe 249 85 0 27 Sep 2023
Investigating how ReLU-networks encode symmetriesNeural Information Processing Systems (NeurIPS), 2023 Georg Bökman Fredrik Kahl 175 7 0 26 May 2023
Similarity of Neural Network Models: A Survey of Functional and Representational MeasuresACM Computing Surveys (ACM Comput. Surv.), 2023 Max Klabunde Tobias Schumacher M. Strohmaier Florian Lemmerich 421 102 0 10 May 2023
Permutation Equivariant Neural FunctionalsNeural Information Processing Systems (NeurIPS), 2023 Allan Zhou Kaien Yang Kaylee Burns Adriano Cardace Yiding Jiang Samuel Sokota J. Zico Kolter Chelsea Finn 262 64 0 27 Feb 2023
Stress and Adaptation: Applying Anna Karenina Principle in Deep Learning for Image Classification Nesma Mahmoud Hanna Antson Jaesik Choi O. Shimmi K. Roy 90 2 0 22 Feb 2023
Equivariant Architectures for Learning in Deep Weight SpacesInternational Conference on Machine Learning (ICML), 2023 Aviv Navon Aviv Shamsian Idan Achituve Ethan Fetaya Gal Chechik Haggai Maron 254 84 0 30 Jan 2023
Do Neural Networks Trained with Topological Features Learn Different Internal Representations? Sarah McGuire Shane Jackson Tegan H. Emerson Henry Kvinge 122 5 0 14 Nov 2022
Git Re-Basin: Merging Models modulo Permutation SymmetriesInternational Conference on Learning Representations (ICLR), 2022 Samuel K. Ainsworth J. Hayase S. Srinivasa MoMe 761 411 0 11 Sep 2022
Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networks Tilman Raukur A. Ho Stephen Casper Dylan Hadfield-Menell AAML AI4CE 636 163 0 27 Jul 2022