Is Batch Norm unique? An empirical investigation and prescription to emulate the best properties of common normalizers without batch dependence

21 October 2020

Papers citing "Is Batch Norm unique? An empirical investigation and prescription to emulate the best properties of common normalizers without batch dependence"

2 / 2 papers shown

Title
The large learning rate phase of deep learning: the catapult mechanism Aitor Lewkowycz Yasaman Bahri Ethan Dyer Jascha Narain Sohl-Dickstein Guy Gur-Ari ODL 153 232 0 04 Mar 2020
Dynamical Isometry and a Mean Field Theory of CNNs: How to Train 10,000-Layer Vanilla Convolutional Neural Networks Lechao Xiao Yasaman Bahri Jascha Narain Sohl-Dickstein S. Schoenholz Jeffrey Pennington 220 347 0 14 Jun 2018