BaPipe: Exploration of Balanced Pipeline Parallelism for DNN Training

23 December 2020

Papers citing "BaPipe: Exploration of Balanced Pipeline Parallelism for DNN Training"

3 / 3 papers shown

Title
FTPipeHD: A Fault-Tolerant Pipeline-Parallel Distributed Training Framework for Heterogeneous Edge Devices Yuhao Chen Qianqian Yang Shibo He Zhiguo Shi Jiming Chen 16 3 0 06 Oct 2021
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism M. Shoeybi M. Patwary Raul Puri P. LeGresley Jared Casper Bryan Catanzaro MoE 245 1,817 0 17 Sep 2019
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Z. Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 716 6,743 0 26 Sep 2016