All You Need is Beyond a Good Init: Exploring Better Solution for Training Extremely Deep Convolutional Neural Networks with Orthonormality and Modulation

6 March 2017

Papers citing "All You Need is Beyond a Good Init: Exploring Better Solution for Training Extremely Deep Convolutional Neural Networks with Orthonormality and Modulation"

17 / 17 papers shown

Title
Restyling Unsupervised Concept Based Interpretable Networks with Generative Models Jayneel Parekh Quentin Bouniot Pavlo Mozharovskyi A. Newson Florence dÁlché-Buc SSL 55 1 0 01 Jul 2024
Get the Best of Both Worlds: Improving Accuracy and Transferability by Grassmann Class Representation Haoqi Wang Zhizhong Li Wayne Zhang 13 1 0 03 Aug 2023
Group Orthogonalization Regularization For Vision Models Adaptation and Robustness Yoav Kurtz Noga Bar Raja Giryes 24 0 0 16 Jun 2023
Curve Your Enthusiasm: Concurvity Regularization in Differentiable Generalized Additive Models Julien N. Siems Konstantin Ditschuneit Winfried Ripken Alma Lindborg Maximilian Schambach Johannes Otterbach Martin Genzel 14 6 0 19 May 2023
Batch Normalization Explained Randall Balestriero Richard G. Baraniuk AAML 28 16 0 29 Sep 2022
Maximum Class Separation as Inductive Bias in One Matrix Tejaswi Kasarla Gertjan J. Burghouts Max van Spengler Elise van der Pol Rita Cucchiara Pascal Mettes 19 22 0 17 Jun 2022
Entangled Residual Mappings Mathias Lechner Ramin Hasani Z. Babaiee Radu Grosu Daniela Rus T. Henzinger Sepp Hochreiter 6 4 0 02 Jun 2022
Feedback Gradient Descent: Efficient and Stable Optimization with Orthogonality for DNNs Fanchen Bu D. Chang 17 6 0 12 May 2022
Orthogonal Graph Neural Networks Kai Guo Kaixiong Zhou Xia Hu Yu Li Yi Chang Xin Wang 41 34 0 23 Sep 2021
Existence, Stability and Scalability of Orthogonal Convolutional Neural Networks E. M. Achour Franccois Malgouyres Franck Mamalet 16 20 0 12 Aug 2021
Improving Molecular Graph Neural Network Explainability with Orthonormalization and Induced Sparsity Ryan Henderson Djork-Arné Clevert F. Montanari 17 26 0 11 May 2021
Deep Isometric Learning for Visual Recognition Haozhi Qi Chong You X. Wang Yi-An Ma Jitendra Malik VLM 22 53 0 30 Jun 2020
On Generalization Bounds of a Family of Recurrent Neural Networks Minshuo Chen Xingguo Li T. Zhao 11 70 0 28 Oct 2019
Orthogonal Deep Neural Networks K. Jia Shuai Li Yuxin Wen Tongliang Liu Dacheng Tao 26 131 0 15 May 2019
Collaborative Spatio-temporal Feature Learning for Video Action Recognition C. Li Qiaoyong Zhong Di Xie Shiliang Pu 8 82 0 04 Mar 2019
On Tighter Generalization Bound for Deep Neural Networks: CNNs, ResNets, and Beyond Xingguo Li Junwei Lu Zhaoran Wang Jarvis D. Haupt T. Zhao 25 78 0 13 Jun 2018
Optimization on Submanifolds of Convolution Kernels in CNNs Mete Ozay Takayuki Okatani 43 46 0 22 Oct 2016