Sync-Switch: Hybrid Parameter Synchronization for Distributed Deep Learning

16 April 2021

Papers citing "Sync-Switch: Hybrid Parameter Synchronization for Distributed Deep Learning"

4 / 4 papers shown

Title
FuncPipe: A Pipelined Serverless Framework for Fast and Cost-efficient Training of Deep Learning Models Yunzhuo Liu Bo Jiang Tian Guo Zimeng Huang Wen-ping Ma Xinbing Wang Chenghu Zhou 19 9 0 28 Apr 2022
On the Future of Cloud Engineering David Bermbach A. Chandra C. Krintz A. Gokhale Aleksander Slominski L. Thamsen Everton Cavalcante Tian Guo Ivona Brandić R. Wolski 35 23 0 19 Aug 2021
Quantifying and Improving Performance of Distributed Deep Learning with Cloud Storage Nicholas Krichevsky M. S. Louis Tian Guo 25 9 0 13 Aug 2021
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 281 2,889 0 15 Sep 2016