Luck Matters: Understanding Training Dynamics of Deep ReLU Networks

31 May 2019

Papers citing "Luck Matters: Understanding Training Dynamics of Deep ReLU Networks"

3 / 3 papers shown

Title
The Neural Race Reduction: Dynamics of Abstraction in Gated Networks Andrew M. Saxe Shagun Sodhani Sam Lewallen AI4CE 28 34 0 21 Jul 2022
Understanding Robustness in Teacher-Student Setting: A New Perspective Zhuolin Yang Zhaoxi Chen Tiffany Cai Xinyun Chen Bo-wen Li Yuandong Tian AAML 27 2 0 25 Feb 2021
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 281 2,889 0 15 Sep 2016