Understanding symmetries in deep networks

3 November 2015

Papers citing "Understanding symmetries in deep networks"

28 / 28 papers shown

Title
The Empirical Impact of Reducing Symmetries on the Performance of Deep Ensembles and MoE Andrei Chernov Oleg Novitskij 208 1 0 24 Feb 2025
Foldable SuperNets: Scalable Merging of Transformers with Different Initializations and Tasks Edan Kinderman Itay Hubara Haggai Maron Daniel Soudry MoMe 150 2 0 02 Oct 2024
Monomial Matrix Group Equivariant Neural Functional Networks Hoang V. Tran Thieu N. Vo Tho H. Tran An T. Nguyen Tan M. Nguyen 200 9 0 18 Sep 2024
Variational Inference Failures Under Model Symmetries: Permutation Invariant Posteriors for Bayesian Neural Networks Yoav Gelberg Tycho F. A. van der Ouderaa Mark van der Wilk Y. Gal AAML 145 4 0 10 Aug 2024
Scale Equivariant Graph Metanetworks Ioannis Kalogeropoulos Giorgos Bouritsas Yannis Panagakis 181 13 0 15 Jun 2024
The Empirical Impact of Neural Parameter Symmetries, or Lack Thereof Derek Lim Moe Putterman Robin Walters Haggai Maron Stefanie Jegelka 184 9 0 30 May 2024
Unification of Symmetries Inside Neural Networks: Transformer, Feedforward and Neural ODE Koji Hashimoto Yuji Hirono Akiyoshi Sannai AI4CE 106 10 0 04 Feb 2024
Testing RadiX-Nets: Advances in Viable Sparse Topologies Kevin Kwak Zack West Hayden Jananthan J. Kepner 51 1 0 06 Nov 2023
Exploring the Complexity of Deep Neural Networks through Functional Equivalence Guohao Shen 138 5 0 19 May 2023
Equivariant Architectures for Learning in Deep Weight Spaces Aviv Navon Aviv Shamsian Idan Achituve Ethan Fetaya Gal Chechik Haggai Maron 179 77 0 30 Jan 2023
On the Symmetries of Deep Learning Models and their Internal Representations Charles Godfrey Davis Brown Tegan H. Emerson Henry Kvinge 160 51 0 27 May 2022
Rethinking Multidimensional Discriminator Output for Generative Adversarial Networks M. Dai Haibin Hang A. Srivastava 90 3 0 08 Sep 2021
Segmentation of Shoulder Muscle MRI Using a New Region and Edge based Deep Auto-Encoder Dr. Saddam Hussain Khan Asifullah Khan Yeon Soo Lee Mehdi Hassan Woong-Kyo Jeong 81 26 0 26 Aug 2021
On Stein Variational Neural Network Ensembles Francesco DÁngelo Vincent Fortuin F. Wenzel UQCV BDL 123 29 0 20 Jun 2021
Noether's Learning Dynamics: Role of Symmetry Breaking in Neural Networks Hidenori Tanaka D. Kunin 147 31 0 06 May 2021
Neural Teleportation M. Armenta Thierry Judge Nathan Painchaud Youssef Skandarani Carl Lemaire Gabriel Gibeau Sanchez Philippe Spino Pierre-Marc Jodoin 115 19 0 02 Dec 2020
The Representation Theory of Neural Networks M. Armenta Pierre-Marc Jodoin 165 33 0 23 Jul 2020
Evolution of Image Segmentation using Deep Convolutional Neural Network: A Survey F. Sultana Abu Sufian P. Dutta SSeg 183 265 0 13 Jan 2020
Leader Stochastic Gradient Descent for Distributed Training of Deep Learning Models: Extension Yunfei Teng Wenbo Gao F. Chalus A. Choromańska Shiqian Ma Adrian Weller 188 14 0 24 May 2019
Meta-Learning Mean Functions for Gaussian Processes Vincent Fortuin Heiko Strathmann Gunnar Rätsch BDL FedML MLT 188 32 0 23 Jan 2019
Improving Optimization for Models With Continuous Symmetry Breaking Kushagra Pandey Stephan Mandt DRL 100 15 0 08 Mar 2018
Riemannian approach to batch normalization Minhyung Cho Jaehyung Lee 144 94 0 27 Sep 2017
Are Saddles Good Enough for Deep Learning? Adepu Ravi Sankar V. Balasubramanian 106 5 0 07 Jun 2017
Sharp Minima Can Generalize For Deep Nets Laurent Dinh Razvan Pascanu Samy Bengio Yoshua Bengio ODL 257 792 0 15 Mar 2017
Faster Eigenvector Computation via Shift-and-Invert Preconditioning Dan Garber Laurent Dinh Chi Jin Jascha Narain Sohl-Dickstein Samy Bengio Praneeth Netrapalli Aaron Sidford 467 80 0 26 May 2016
Searching for Topological Symmetry in Data Haystack K. Roy Anh Tong Jaesik Choi 56 0 0 11 Mar 2016
Symmetry-invariant optimization in deep networks Vijay Badrinarayanan Bamdev Mishra R. Cipolla ODL 124 34 0 05 Nov 2015
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation Vijay Badrinarayanan Alex Kendall R. Cipolla SSeg 1.4K 16,223 0 02 Nov 2015