Shampoo: Preconditioned Stochastic Tensor Optimization

26 February 2018

Papers citing "Shampoo: Preconditioned Stochastic Tensor Optimization"

6 / 56 papers shown

Title
Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers Robin M. Schmidt Frank Schneider Philipp Hennig ODL 47 162 0 03 Jul 2020
Training (Overparametrized) Neural Networks in Near-Linear Time Jan van den Brand Binghui Peng Zhao Song Omri Weinstein ODL 34 83 0 20 Jun 2020
Practical Quasi-Newton Methods for Training Deep Neural Networks D. Goldfarb Yi Ren Achraf Bahamou ODL 29 104 0 16 Jun 2020
ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning Z. Yao A. Gholami Sheng Shen Mustafa Mustafa Kurt Keutzer Michael W. Mahoney ODL 39 275 0 01 Jun 2020
Scalable Second Order Optimization for Deep Learning Rohan Anil Vineet Gupta Tomer Koren Kevin Regan Y. Singer ODL 27 29 0 20 Feb 2020
Matrix-Free Preconditioning in Online Learning Ashok Cutkosky Tamás Sarlós ODL 32 16 0 29 May 2019