Dynamical Isometry for Residual Networks

5 October 2022

Papers citing "Dynamical Isometry for Residual Networks"

3 / 3 papers shown

Title
Most Activation Functions Can Win the Lottery Without Excessive Depth R. Burkholz MLT 61 18 0 04 May 2022
High-Performance Large-Scale Image Recognition Without Normalization Andrew Brock Soham De Samuel L. Smith Karen Simonyan VLM 223 512 0 11 Feb 2021
Dynamical Isometry and a Mean Field Theory of CNNs: How to Train 10,000-Layer Vanilla Convolutional Neural Networks Lechao Xiao Yasaman Bahri Jascha Narain Sohl-Dickstein S. Schoenholz Jeffrey Pennington 220 348 0 14 Jun 2018