Normalizing the Normalizers: Comparing and Extending Network
Normalization Schemes

Normalizing the Normalizers: Comparing and Extending Network Normalization Schemes

14 November 2016

Papers citing "Normalizing the Normalizers: Comparing and Extending Network Normalization Schemes"

17 / 17 papers shown

Title
Unconditional stability of a recurrent neural circuit implementing divisive normalization Shivang Rawat David J. Heeger Stefano Martiniani 24 0 0 27 Sep 2024
Scaling Forward Gradient With Local Losses Mengye Ren Simon Kornblith Renjie Liao Geoffrey E. Hinton 81 49 0 07 Oct 2022
Neural Sampling Machine with Stochastic Synapse allows Brain-like Learning and Inference S. Dutta Georgios Detorakis A. Khanna B. Grisafe Emre Neftci S. Datta BDL 19 44 0 20 Feb 2021
Group Whitening: Balancing Learning Efficiency and Representational Capacity Lei Huang Yi Zhou Li Liu Fan Zhu Ling Shao 28 21 0 28 Sep 2020
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 34 79 0 17 Sep 2020
Kernelized information bottleneck leads to biologically plausible 3-factor Hebbian learning in deep networks Roman Pogodin P. Latham 24 34 0 12 Jun 2020
Filter Response Normalization Layer: Eliminating Batch Dependence in the Training of Deep Neural Networks Saurabh Singh Shankar Krishnan UQCV 61 125 0 21 Nov 2019
Switchable Normalization for Learning-to-Normalize Deep Representation Ping Luo Ruimao Zhang Jiamin Ren Zhanglin Peng Jingyu Li 30 73 0 22 Jul 2019
EvalNorm: Estimating Batch Normalization Statistics for Evaluation Saurabh Singh Abhinav Shrivastava 26 51 0 12 Apr 2019
Micro-Batch Training with Batch-Channel Normalization and Weight Standardization Siyuan Qiao Huiyu Wang Chenxi Liu Wei Shen Alan Yuille MQ 32 144 0 25 Mar 2019
Training Faster by Separating Modes of Variation in Batch-normalized Models Mahdi M. Kalayeh M. Shah 27 42 0 07 Jun 2018
Decorrelated Batch Normalization Lei Huang Dawei Yang B. Lang Jia Deng 16 190 0 23 Apr 2018
Frank-Wolfe Network: An Interpretable Deep Structure for Non-Sparse Coding Dong Liu Ke Sun Zhangyang Wang Runsheng Liu Zhengjun Zha 24 12 0 28 Feb 2018
Comparison of Batch Normalization and Weight Normalization Algorithms for the Large-scale Image Classification Igor Gitman Boris Ginsburg 8 65 0 24 Sep 2017
Just DIAL: DomaIn Alignment Layers for Unsupervised Domain Adaptation Fabio Maria Carlucci Lorenzo Porzi Barbara Caputo Elisa Ricci Samuel Rota Buló OOD 21 48 0 21 Feb 2017
Cosine Normalization: Using Cosine Similarity Instead of Dot Product in Neural Networks Chunjie Luo Jianfeng Zhan Lei Wang Qiang Yang 24 198 0 20 Feb 2017
Bridging the Gaps Between Residual Learning, Recurrent Neural Networks and Visual Cortex Q. Liao T. Poggio 213 255 0 13 Apr 2016