A Coordinate-Free Construction of Scalable Natural Gradient

30 August 2018

Papers citing "A Coordinate-Free Construction of Scalable Natural Gradient"

4 / 4 papers shown

Title
Depth Without the Magic: Inductive Bias of Natural Gradient Descent A. Kerekes Anna Mészáros Ferenc Huszár ODL 37 4 0 22 Nov 2021
Fast Convergence of Natural Gradient Descent for Overparameterized Neural Networks Guodong Zhang James Martens Roger C. Grosse ODL 22 124 0 27 May 2019
An Empirical Study of Large-Batch Stochastic Gradient Descent with Structured Covariance Noise Yeming Wen Kevin Luk Maxime Gazeau Guodong Zhang Harris Chan Jimmy Ba ODL 25 22 0 21 Feb 2019
Three Mechanisms of Weight Decay Regularization Guodong Zhang Chaoqi Wang Bowen Xu Roger C. Grosse 22 256 0 29 Oct 2018