Synthesizing Optimal Collective Algorithms

19 August 2020

Papers citing "Synthesizing Optimal Collective Algorithms"

5 / 5 papers shown

Title
MSCCL++: Rethinking GPU Communication Abstractions for Cutting-edge AI Applications Aashaka Shah Abhinav Jangda B. Li Caio Rocha Changho Hwang ... Peng Cheng Qinghua Zhou Roshan Dathathri Saeed Maleki Ziyue Yang GNN 47 0 0 11 Apr 2025
PID-Comm: A Fast and Flexible Collective Communication Framework for Commodity Processing-in-DIMM Devices Si Ung Noh Junguk Hong Chaemin Lim Seong-Yeol Park Jeehyun Kim Hanjun Kim Youngsok Kim Jinho Lee 34 6 0 13 Apr 2024
Bidirectional Reactive Programming for Machine Learning D. Potop-Butucaru Albert Cohen Gordon Plotkin Hugo Pompougnac KELM AI4CE 11 0 0 28 Nov 2023
OSDP: Optimal Sharded Data Parallel for Distributed Deep Learning Youhe Jiang Fangcheng Fu Xupeng Miao Xiaonan Nie Bin Cui 22 11 0 17 May 2023
Themis: A Network Bandwidth-Aware Collective Scheduling Policy for Distributed Training of DL Models Saeed Rashidi William Won S. Srinivasan Srinivas Sridharan T. Krishna GNN 17 29 0 09 Oct 2021