PipeOptim: Ensuring Effective 1F1B Schedule with Optimizer-Dependent Weight Prediction

1 December 2023

Papers citing "PipeOptim: Ensuring Effective 1F1B Schedule with Optimizer-Dependent Weight Prediction"

2 / 2 papers shown

Title
Chimera: Efficiently Training Large-Scale Neural Networks with Bidirectional Pipelines Shigang Li Torsten Hoefler GNN AI4CE LRM 77 131 0 14 Jul 2021
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Z. Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 716 6,743 0 26 Sep 2016