ReZero is All You Need: Fast Convergence at Large Depth

10 March 2020

Papers citing "ReZero is All You Need: Fast Convergence at Large Depth"

6 / 56 papers shown

Title
Reservoir Transformers Sheng Shen Alexei Baevski Ari S. Morcos Kurt Keutzer Michael Auli Douwe Kiela 25 17 0 30 Dec 2020
On the Transfer of Disentangled Representations in Realistic Settings Andrea Dittadi Frederik Trauble Francesco Locatello M. Wuthrich Vaibhav Agrawal Ole Winther Stefan Bauer Bernhard Schölkopf OOD 20 80 0 27 Oct 2020
Speech Recognition and Multi-Speaker Diarization of Long Conversations H. H. Mao Shuyang Li Julian McAuley G. Cottrell VLM 20 39 0 16 May 2020
Set Functions for Time Series Max Horn Michael Moor Christian Bock Bastian Alexander Rieck Karsten M. Borgwardt AI4TS 27 143 0 26 Sep 2019
Bag of Tricks for Image Classification with Convolutional Neural Networks Tong He Zhi-Li Zhang Hang Zhang Zhongyue Zhang Junyuan Xie Mu Li 216 1,398 0 04 Dec 2018
Dynamical Isometry and a Mean Field Theory of CNNs: How to Train 10,000-Layer Vanilla Convolutional Neural Networks Lechao Xiao Yasaman Bahri Jascha Narain Sohl-Dickstein S. Schoenholz Jeffrey Pennington 220 348 0 14 Jun 2018