Cloudless-Training: A Framework to Improve Efficiency of Geo-Distributed ML Training

9 March 2023

Papers citing "Cloudless-Training: A Framework to Improve Efficiency of Geo-Distributed ML Training"

2 / 2 papers shown

Title
Nebula-I: A General Framework for Collaboratively Training Deep Learning Models on Low-Bandwidth Cloud Clusters Yang Xiang Zhihua Wu Weibao Gong Siyu Ding Xianjie Mo ... Yue Yu Ge Li Yu Sun Yanjun Ma Dianhai Yu 19 4 0 19 May 2022
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism M. Shoeybi M. Patwary Raul Puri P. LeGresley Jared Casper Bryan Catanzaro MoE 245 1,817 0 17 Sep 2019