Sparsity-Aware Communication for Distributed Graph Neural Network Training

Sparsity-Aware Communication for Distributed Graph Neural Network Training

International Conference on Parallel Processing (ICPP), 2024

7 April 2025

Ujjaini Mukhodopadhyay

Katherine Yelick

ArXiv (abs)PDF HTML

Papers citing "Sparsity-Aware Communication for Distributed Graph Neural Network Training"

14 / 14 papers shown

Title
Digital Twin-Driven Pavement Health Monitoring and Maintenance Optimization Using Graph Neural Networks Mohsin Mahmud Topu Mahfuz Ahmed Anik Azmine Toushik Wasi Md Manjurul Ahsan AI4CE 80 0 0 04 Nov 2025
BNS-GCN: Efficient Full-Graph Training of Graph Convolutional Networks with Partition-Parallelism and Random Boundary Node SamplingConference on Machine Learning and Systems (MLSys), 2022 Cheng Wan Youjie Li Ang Li Namjae Kim Yingyan Lin GNN 239 90 0 21 Mar 2022
Dorylus: Affordable, Scalable, and Accurate GNN Training with Distributed CPU Servers and Serverless ThreadsUSENIX Symposium on Operating Systems Design and Implementation (OSDI), 2021 John Thorpe Yifan Qiao Jon Eyolfson Shen Teng Guanzhou Hu ... Jinliang Wei Keval Vora Ravi Netravali Yang Wang G. Xu GNN 244 158 0 24 May 2021
DistGNN: Scalable Distributed Training for Large-Scale Graph Neural NetworksInternational Conference for High Performance Computing, Networking, Storage and Analysis (SC), 2021 Vasimuddin Sanchit Misra Guixiang Ma Ramanarayan Mohanty E. Georganas A. Heinecke Dhiraj D. Kalamkar Nesreen Ahmed Sasikanth Avancha GNN 266 147 0 14 Apr 2021
Computing Graph Neural Networks: A Survey from Algorithms to AcceleratorsACM Computing Surveys (ACM CSUR), 2020 S. Abadal Akshay Jain Robert Guirado Jorge López-Alonso Eduard Alarcón GNN 428 263 0 30 Sep 2020
Reducing Communication in Graph Neural Network Training Alok Tripathy Katherine Yelick A. Buluç GNN 221 112 0 07 May 2020
Open Graph Benchmark: Datasets for Machine Learning on GraphsNeural Information Processing Systems (NeurIPS), 2020 Weihua Hu Matthias Fey Marinka Zitnik Yuxiao Dong Hongyu Ren Bowen Liu Michele Catasta J. Leskovec 696 3,176 0 02 May 2020
GraphSAINT: Graph Sampling Based Inductive Learning MethodInternational Conference on Learning Representations (ICLR), 2019 Hanqing Zeng Hongkuan Zhou Ajitesh Srivastava Rajgopal Kannan Viktor Prasanna GNN 474 1,063 0 10 Jul 2019
A Comprehensive Survey on Graph Neural Networks Zonghan Wu Shirui Pan Fengwen Chen Guodong Long Chengqi Zhang Philip S. Yu FaML GNN AI4TS AI4CE 1.4K 10,026 0 03 Jan 2019
FastGCN: Fast Learning with Graph Convolutional Networks via Importance Sampling Jie Chen Tengfei Ma Cao Xiao GNN 326 1,643 0 30 Jan 2018
Inductive Representation Learning on Large GraphsNeural Information Processing Systems (NeurIPS), 2017 William L. Hamilton Z. Ying J. Leskovec 1.5K 17,742 0 07 Jun 2017
Semi-Supervised Classification with Graph Convolutional Networks Thomas Kipf Max Welling GNN SSL 1.7K 32,431 0 09 Sep 2016
Exploiting Multiple Levels of Parallelism in Sparse Matrix-Matrix Multiplication A. Azad Grey Ballard A. Buluç J. Demmel L. Grigori O. Schwartz Sivan Toledo Samuel Williams 208 110 0 03 Oct 2015
Recent Advances in Graph Partitioning A. Buluç Henning Meyerhenke Ilya Safro Peter Sanders Christian Schulz 273 591 0 13 Nov 2013