Online Normalization for Training Neural Networks

Online Normalization for Training Neural Networks

15 May 2019

S. D. L. Fuente

Papers citing "Online Normalization for Training Neural Networks"

11 / 11 papers shown

Title
AlphaGrad: Non-Linear Gradient Normalization Optimizer Soham Sane ODL 56 0 0 22 Apr 2025
Toward Equation of Motion for Deep Neural Networks: Continuous-time Gradient Descent and Discretization Error Analysis Taiki Miyagawa 42 9 0 28 Oct 2022
SML:Enhance the Network Smoothness with Skip Meta Logit for CTR Prediction Wenlong Deng Lang Lang Z. Liu B. Liu 21 0 0 09 Oct 2022
RevBiFPN: The Fully Reversible Bidirectional Feature Pyramid Network Vitaliy Chiley Vithursan Thangarasa Abhay Gupta Anshul Samar Joel Hestness D. DeCoste 48 8 0 28 Jun 2022
Understanding the Generalization Benefit of Normalization Layers: Sharpness Reduction Kaifeng Lyu Zhiyuan Li Sanjeev Arora FAtt 37 69 0 14 Jun 2022
One model to enhance them all: array geometry agnostic multi-channel personalized speech enhancement H. Taherian Sefik Emre Eskimez Takuya Yoshioka Huaming Wang Zhuo Chen Xuedong Huang 19 21 0 20 Oct 2021
Continual Backprop: Stochastic Gradient Descent with Persistent Randomness Shibhansh Dohare R. Sutton A. R. Mahmood CLL 38 80 0 13 Aug 2021
Momentum^2 Teacher: Momentum Teacher with Momentum Statistics for Self-Supervised Learning Zeming Li Songtao Liu Jian-jun Sun 48 16 0 19 Jan 2021
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 31 79 0 17 Sep 2020
Pipelined Backpropagation at Scale: Training Large Models without Batches Atli Kosson Vitaliy Chiley Abhinav Venigalla Joel Hestness Urs Koster 33 33 0 25 Mar 2020
Synaptic Metaplasticity in Binarized Neural Networks Axel Laborieux M. Ernoult T. Hirtzlin D. Querlioz CLL 24 62 0 07 Mar 2020