FALCON: Pinpointing and Mitigating Stragglers for Large-Scale Hybrid-Parallel Training

16 October 2024

Wei Wang

Papers citing "FALCON: Pinpointing and Mitigating Stragglers for Large-Scale Hybrid-Parallel Training"

1 / 1 papers shown

Title
Understanding Stragglers in Large Model Training Using What-if Analysis Jinkun Lin Ziheng Jiang Zuquan Song Sida Zhao Menghan Yu ... Shuguang Wang Haibin Lin Xin Liu Aurojit Panda Jinyang Li 22 0 0 09 May 2025