Layer-Dependent Importance Sampling for Training Deep and Large Graph Convolutional Networks

17 November 2019

Quanquan Gu

Papers citing "Layer-Dependent Importance Sampling for Training Deep and Large Graph Convolutional Networks"

50 / 166 papers shown

Title
TpuGraphs: A Performance Prediction Dataset on Large Tensor Computational Graphs P. Phothilimthana Sami Abu-El-Haija Kaidi Cao Bahare Fatemi Mike Burrows Charith Mendis Bryan Perozzi GNN AI4TS 27 17 0 25 Aug 2023
GNNPipe: Scaling Deep GNN Training with Pipelined Model Parallelism Jingji Chen Zhuoming Chen Xuehai Qian GNN AI4CE 27 3 0 19 Aug 2023
The Snowflake Hypothesis: Training Deep GNN with One Node One Receptive field Kun Wang Guohao Li Shilong Wang Guibin Zhang K. Wang Yang You Xiaojiang Peng Yuxuan Liang Yang Wang 29 8 0 19 Aug 2023
Communication-Free Distributed GNN Training with Vertex Cut Kaidi Cao Rui Deng Shirley Wu E-Wen Huang Karthik Subbian J. Leskovec GNN 11 3 0 06 Aug 2023
VQGraph: Rethinking Graph Representation Space for Bridging GNNs and MLPs Ling Yang Ye Tian Minkai Xu Zhongyi Liu Shenda Hong Wei Qu Wentao Zhang Bin Cui Muhan Zhang J. Leskovec 27 13 0 04 Aug 2023
SimTeG: A Frustratingly Simple Approach Improves Textual Graph Learning Keyu Duan Qian Liu Tat-Seng Chua Shuicheng Yan Wei Tsang Ooi Qizhe Xie Junxian He 22 56 0 03 Aug 2023
Accelerating Sampling and Aggregation Operations in GNN Frameworks with GPU Initiated Direct Storage Accesses Jeongmin Brian Park Vikram Sharma Mailthody Zaid Qureshi Wen-mei W. Hwu GNN 23 11 0 28 Jun 2023
PolicyClusterGCN: Identifying Efficient Clusters for Training Graph Convolutional Networks Saket Gurukar S. Venkatakrishnan B. Ravindran Srinivas Parthasarathy GNN 20 0 0 25 Jun 2023
A Survey on Graph Neural Network Acceleration: Algorithms, Systems, and Customized Hardware Shichang Zhang Atefeh Sohrabizadeh Cheng Wan Zijie Huang Ziniu Hu Yewen Wang Yingyan Lin Lin Jason Cong Yizhou Sun GNN AI4CE 29 22 0 24 Jun 2023
BatchGNN: Efficient CPU-Based Distributed GNN Training on Very Large Graphs Loc Hoang Rita Brugarolas Brufau Ke Ding Bo Wu GNN 27 2 0 23 Jun 2023
Graph Ladling: Shockingly Simple Parallel GNN Training without Intermediate Communication A. Jaiswal Shiwei Liu Tianlong Chen Ying Ding Zhangyang Wang GNN 36 5 0 18 Jun 2023
GC-Flow: A Graph-Based Flow Network for Effective Clustering Tianchun Wang F. Mirzazadeh X. Zhang Jing Chen BDL 40 7 0 26 May 2023
The Evolution of Distributed Systems for Graph Neural Networks and their Origin in Graph Processing and Deep Learning: A Survey Jana Vatter R. Mayer Hans-Arno Jacobsen GNN AI4TS AI4CE 37 23 0 23 May 2023
Tokenized Graph Transformer with Neighborhood Augmentation for Node Classification in Large Graphs Jinsong Chen Chang-Shu Liu Kai-Xin Gao Gaichao Li Kun He 21 4 0 22 May 2023
Learning Large Graph Property Prediction via Graph Segment Training Kaidi Cao P. Phothilimthana Sami Abu-El-Haija Dustin Zelle Yanqi Zhou Charith Mendis J. Leskovec Bryan Perozzi 21 8 0 21 May 2023
Communication-Efficient Graph Neural Networks with Probabilistic Neighborhood Expansion Analysis and Caching Tim Kaler A. Iliopoulos P. Murzynowski Tao B. Schardl C. E. Leiserson Jie Chen GNN 22 15 0 04 May 2023
GraphMAE2: A Decoding-Enhanced Masked Self-Supervised Graph Learner Zhenyu Hou Yufei He Yukuo Cen Xiao Liu Yuxiao Dong Evgeny Kharlamov Jie Tang SSL 21 103 0 10 Apr 2023
Provably Convergent Subgraph-wise Sampling for Fast GNN Training Jie Wang Zhihao Shi Xize Liang Shuiwang Ji Bin Li Feng Wu 20 0 0 17 Mar 2023
Boosting Distributed Full-graph GNN Training with Asynchronous One-bit Communication Mengdie Zhang Qi Hu Peng Sun Yonggang Wen Tianwei Zhang GNN 32 4 0 02 Mar 2023
Asymmetric Learning for Graph Neural Network based Link Prediction Kai-Lang Yao Wusuo Li 27 1 0 01 Mar 2023
Graph-based Knowledge Distillation: A survey and experimental evaluation Jing Liu Tongya Zheng Guanzheng Zhang Qinfen Hao 29 8 0 27 Feb 2023
Joint Edge-Model Sparse Learning is Provably Efficient for Graph Neural Networks Shuai Zhang M. Wang Pin-Yu Chen Sijia Liu Songtao Lu Miaoyuan Liu MLT 19 16 0 06 Feb 2023
LazyGNN: Large-Scale Graph Neural Networks via Lazy Propagation Rui Xue Haoyu Han MohamadAli Torkamani Jian Pei Xiaorui Liu GNN 31 19 0 03 Feb 2023
Simplifying Subgraph Representation Learning for Scalable Link Prediction Paul Louis Shweta Ann Jacob Amirali Salehi-Abari 18 8 0 29 Jan 2023
Graph Neural Networks can Recover the Hidden Features Solely from the Graph Structure Ryoma Sato 28 5 0 26 Jan 2023
GIPA: A General Information Propagation Algorithm for Graph Learning Houyi Li Zhihong Chen Zhao Li Qinkai Zheng Peng Zhang Shuigeng Zhou 43 0 0 19 Jan 2023
FreshGNN: Reducing Memory Access via Stable Historical Embeddings for Graph Neural Network Training Kezhao Huang Haitian Jiang Minjie Wang Guangxuan Xiao David Wipf Xiang Song Quan Gan Zengfeng Huang Jidong Zhai Zheng-Wei Zhang GNN 23 2 0 18 Jan 2023
Hierarchical Estimation for Effective and Efficient Sampling Graph Neural Network Y. Li Bingbing Xu Qi Cao Yige Yuan Huawei Shen 16 0 0 16 Nov 2022
Self-Supervised Graph Structure Refinement for Graph Neural Networks Jianan Zhao Qianlong Wen Mingxuan Ju Chuxu Zhang Yanfang Ye 30 20 0 12 Nov 2022
A Comprehensive Survey on Distributed Training of Graph Neural Networks Haiyang Lin Mingyu Yan Xiaochun Ye Dongrui Fan Shirui Pan Wenguang Chen Yuan Xie GNN 25 24 0 10 Nov 2022
Characterizing the Efficiency of Graph Neural Network Frameworks with a Magnifying Glass Xin Huang Jongryool Kim Brad Rees Chul-Ho Lee GNN 21 4 0 06 Nov 2022
Efficient Graph Neural Network Inference at Large Scale Xin-pu Gao Wentao Zhang Yingxia Shao Quoc Viet Hung Nguyen Bin Cui Hongzhi Yin AI4CE GNN 41 9 0 01 Nov 2022
Distributed Graph Neural Network Training: A Survey Yingxia Shao Hongzheng Li Xizhi Gu Hongbo Yin Yawen Li Xupeng Miao Wentao Zhang Bin Cui Lei Chen GNN AI4CE 11 55 0 01 Nov 2022
Layer-Neighbor Sampling -- Defusing Neighborhood Explosion in GNNs M. F. Balin Ümit V. Çatalyürek 19 15 0 24 Oct 2022
Binary Graph Convolutional Network with Capacity Exploration Junfu Wang Yuanfang Guo Liang Yang Yun-an Wang GNN 17 5 0 24 Oct 2022
RSC: Accelerating Graph Neural Networks Training via Randomized Sparse Computations Zirui Liu Sheng-Wei Chen Kaixiong Zhou Daochen Zha Xiao Huang Xia Hu 29 14 0 19 Oct 2022
EGG-GAE: scalable graph neural networks for tabular data imputation Lev Telyatnikov Simone Scardapane GNN 23 13 0 19 Oct 2022
SA-MLP: Distilling Graph Knowledge from GNNs into Structure-Aware MLP Jie Chen Shouzhen Chen Mingyuan Bai Junbin Gao Junping Zhang Jian Pu 34 10 0 18 Oct 2022
Old can be Gold: Better Gradient Flow can Make Vanilla-GCNs Great Again Ajay Jaiswal Peihao Wang Tianlong Chen Justin F. Rousseau Ying Ding Zhangyang Wang 24 10 0 14 Oct 2022
A Comprehensive Study on Large-Scale Graph Training: Benchmarking and Rethinking Keyu Duan Zirui Liu Peihao Wang Wenqing Zheng Kaixiong Zhou Tianlong Chen Xia Hu Zhangyang Wang GNN 36 57 0 14 Oct 2022
Hierarchical Graph Transformer with Adaptive Node Sampling Zaixin Zhang Qi Liu Qingyong Hu Cheekong Lee 70 81 0 08 Oct 2022
DiP-GNN: Discriminative Pre-Training of Graph Neural Networks Simiao Zuo Haoming Jiang Qingyu Yin Xianfeng Tang Bing Yin Tuo Zhao 14 0 0 15 Sep 2022
Analyzing the Effect of Sampling in GNNs on Individual Fairness Rebecca Salganik Fernando Diaz G. Farnadi 24 1 0 08 Sep 2022
Rethinking Efficiency and Redundancy in Training Large-scale Graphs Xin Liu Xunbin Xiong Mingyu Yan Runzhen Xue Shirui Pan Xiaochun Ye Dongrui Fan 13 1 0 02 Sep 2022
Graph Generative Model for Benchmarking Graph Neural Networks Minji Yoon Yue Wu John Palowitch Bryan Perozzi Ruslan Salakhutdinov 17 7 0 10 Jul 2022
Generalization Guarantee of Training Graph Convolutional Networks with Graph Topology Sampling Hongkang Li M. Wang Sijia Liu Pin-Yu Chen Jinjun Xiong GNN 16 27 0 07 Jul 2022
Sampling Enclosing Subgraphs for Link Prediction Paul Louis Shweta Ann Jacob Amirali Salehi-Abari GNN 22 14 0 23 Jun 2022
GraphFM: Improving Large-Scale GNN Training via Feature Momentum Haiyang Yu Limei Wang Bokun Wang Meng Liu Tianbao Yang Shuiwang Ji GNN AI4CE 29 39 0 14 Jun 2022
NAGphormer: A Tokenized Graph Transformer for Node Classification in Large Graphs Jinsong Chen Kaiyuan Gao Gaichao Li Kun He 16 64 0 10 Jun 2022
Alternately Optimized Graph Neural Networks Haoyu Han Xiaorui Liu Haitao Mao Torkamani Ali Feng Shi Victor E. Lee Jiliang Tang GNN 31 8 0 08 Jun 2022