Understanding symmetries in deep networks

3 November 2015

Papers citing "Understanding symmetries in deep networks"

28 / 28 papers shown

Title
The Empirical Impact of Reducing Symmetries on the Performance of Deep Ensembles and MoE Andrei Chernov Oleg Novitskij 146 0 0 24 Feb 2025
Foldable SuperNets: Scalable Merging of Transformers with Different Initializations and Tasks Edan Kinderman Itay Hubara Haggai Maron Daniel Soudry MoMe 98 2 0 02 Oct 2024
Monomial Matrix Group Equivariant Neural Functional Networks Hoang V. Tran Thieu N. Vo Tho H. Tran An T. Nguyen Tan M. Nguyen 140 9 0 18 Sep 2024
Variational Inference Failures Under Model Symmetries: Permutation Invariant Posteriors for Bayesian Neural Networks Yoav Gelberg Tycho F. A. van der Ouderaa Mark van der Wilk Y. Gal AAML 110 4 0 10 Aug 2024
Scale Equivariant Graph Metanetworks Ioannis Kalogeropoulos Giorgos Bouritsas Yannis Panagakis 125 11 0 15 Jun 2024
The Empirical Impact of Neural Parameter Symmetries, or Lack Thereof Derek Lim Moe Putterman Robin Walters Haggai Maron Stefanie Jegelka 112 9 0 30 May 2024
Unification of Symmetries Inside Neural Networks: Transformer, Feedforward and Neural ODE Koji Hashimoto Yuji Hirono Akiyoshi Sannai AI4CE 80 7 0 04 Feb 2024
Testing RadiX-Nets: Advances in Viable Sparse Topologies Kevin Kwak Zack West Hayden Jananthan J. Kepner 40 0 0 06 Nov 2023
Exploring the Complexity of Deep Neural Networks through Functional Equivalence Guohao Shen 103 4 0 19 May 2023
Equivariant Architectures for Learning in Deep Weight Spaces Aviv Navon Aviv Shamsian Idan Achituve Ethan Fetaya Gal Chechik Haggai Maron 115 69 0 30 Jan 2023
On the Symmetries of Deep Learning Models and their Internal Representations Charles Godfrey Davis Brown Tegan H. Emerson Henry Kvinge 96 45 0 27 May 2022
Rethinking Multidimensional Discriminator Output for Generative Adversarial Networks M. Dai Haibin Hang A. Srivastava 58 3 0 08 Sep 2021
Segmentation of Shoulder Muscle MRI Using a New Region and Edge based Deep Auto-Encoder Dr. Saddam Hussain Khan Asifullah Khan Yeon Soo Lee Mehdi Hassan Woong-Kyo Jeong 52 24 0 26 Aug 2021
On Stein Variational Neural Network Ensembles Francesco DÁngelo Vincent Fortuin F. Wenzel UQCV BDL 90 27 0 20 Jun 2021
Noether's Learning Dynamics: Role of Symmetry Breaking in Neural Networks Hidenori Tanaka D. Kunin 113 31 0 06 May 2021
Neural Teleportation M. Armenta Thierry Judge Nathan Painchaud Youssef Skandarani Carl Lemaire Gabriel Gibeau Sanchez Philippe Spino Pierre-Marc Jodoin 66 17 0 02 Dec 2020
The Representation Theory of Neural Networks M. Armenta Pierre-Marc Jodoin 113 31 0 23 Jul 2020
Evolution of Image Segmentation using Deep Convolutional Neural Network: A Survey F. Sultana Abu Sufian P. Dutta SSeg 141 258 0 13 Jan 2020
Leader Stochastic Gradient Descent for Distributed Training of Deep Learning Models: Extension Yunfei Teng Wenbo Gao F. Chalus A. Choromańska Shiqian Ma Adrian Weller 134 12 0 24 May 2019
Meta-Learning Mean Functions for Gaussian Processes Vincent Fortuin Heiko Strathmann Gunnar Rätsch BDL FedML MLT 106 29 0 23 Jan 2019
Improving Optimization for Models With Continuous Symmetry Breaking Robert Bamler Stephan Mandt DRL 66 15 0 08 Mar 2018
Riemannian approach to batch normalization Minhyung Cho Jaehyung Lee 83 94 0 27 Sep 2017
Are Saddles Good Enough for Deep Learning? Adepu Ravi Sankar V. Balasubramanian 65 5 0 07 Jun 2017
Sharp Minima Can Generalize For Deep Nets Laurent Dinh Razvan Pascanu Samy Bengio Yoshua Bengio ODL 147 774 0 15 Mar 2017
Faster Eigenvector Computation via Shift-and-Invert Preconditioning Dan Garber Laurent Dinh Chi Jin Jascha Narain Sohl-Dickstein Samy Bengio Praneeth Netrapalli Aaron Sidford 279 3,727 0 26 May 2016
Searching for Topological Symmetry in Data Haystack K. Roy Anh Tong Jaesik Choi 42 0 0 11 Mar 2016
Symmetry-invariant optimization in deep networks Vijay Badrinarayanan Bamdev Mishra R. Cipolla ODL 61 34 0 05 Nov 2015
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation Vijay Badrinarayanan Alex Kendall R. Cipolla SSeg 1.1K 15,882 0 02 Nov 2015