AdaSGD: Bridging the gap between SGD and Adam

30 June 2020

Papers citing "AdaSGD: Bridging the gap between SGD and Adam"

1 / 1 papers shown

Title
Deconstructing What Makes a Good Optimizer for Language Models Rosie Zhao Depen Morwani David Brandfonbrener Nikhil Vyas Sham Kakade 47 17 0 10 Jul 2024