Scaling the Wild: Decentralizing Hogwild!-style Shared-memory SGD

13 March 2022

Vyacheslav Kungurtsev

Dan Alistarh

Papers citing "Scaling the Wild: Decentralizing Hogwild!-style Shared-memory SGD"

2 / 2 papers shown

Title
Asynchronous Stochastic Gradient Descent with Decoupled Backpropagation and Layer-Wise Updates Cabrel Teguemne Fokam Khaleelulla Khan Nazeer Lukas König David Kappel Anand Subramoney 28 0 0 08 Oct 2024
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 281 2,889 0 15 Sep 2016