$$\mathcal{G}$-SGD: Optimizing ReLU Neural Networks in its Positively Scale-Invariant Space$

$\mathcal{G}$ -SGD: Optimizing ReLU Neural Networks in its Positively Scale-Invariant Space

11 February 2018

Papers citing "$\mathcal{G}$-SGD: Optimizing ReLU Neural Networks in its Positively Scale-Invariant Space"

10 / 10 papers shown

Title
Latent Space Translation via Inverse Relative Projection Valentino Maiorca Luca Moschella Marco Fumero Francesco Locatello Emanuele Rodolà 34 1 0 21 Jun 2024
Symmetries, flat minima, and the conserved quantities of gradient flow Bo-Lu Zhao I. Ganev Robin G. Walters Rose Yu Nima Dehmamy 42 16 0 31 Oct 2022
Symmetry Teleportation for Accelerated Optimization B. Zhao Nima Dehmamy Robin G. Walters Rose Yu ODL 23 20 0 21 May 2022
Batch Normalization Preconditioning for Neural Network Training Susanna Lange Kyle E. Helfrich Qiang Ye 22 9 0 02 Aug 2021
An Embedding of ReLU Networks and an Analysis of their Identifiability Pierre Stock Rémi Gribonval 26 17 0 20 Jul 2021
The Representation Theory of Neural Networks M. Armenta Pierre-Marc Jodoin 19 30 0 23 Jul 2020
New Interpretations of Normalization Methods in Deep Learning Jiacheng Sun Xiangyong Cao Hanwen Liang Weiran Huang Zewei Chen Zhenguo Li 9 34 0 16 Jun 2020
Shared Representational Geometry Across Neural Networks Qihong Lu Po-Hsuan Chen Jonathan W. Pillow Peter J. Ramadge K. A. Norman Uri Hasson OOD 8 11 0 28 Nov 2018
Capacity Control of ReLU Neural Networks by Basis-path Norm Shuxin Zheng Qi Meng Huishuai Zhang Wei-neng Chen Nenghai Yu Tie-Yan Liu 16 23 0 19 Sep 2018
Improving neural networks by preventing co-adaptation of feature detectors Geoffrey E. Hinton Nitish Srivastava A. Krizhevsky Ilya Sutskever Ruslan Salakhutdinov VLM 266 7,634 0 03 Jul 2012