Training Graph Neural Networks with 1000 Layers

14 June 2021

Papers citing "Training Graph Neural Networks with 1000 Layers"

50 / 152 papers shown

Title
Label Deconvolution for Node Representation Learning on Large-scale Attributed Graphs against Learning Bias Zhihao Shi Jie Wang Fanghua Lu Hanzhu Chen Defu Lian Zheng Wang Jieping Ye Feng Wu AI4CE 19 6 0 26 Sep 2023
Weakly Supervised Semantic Segmentation by Knowledge Graph Inference Jia Zhang Bo Peng Xi Wu 19 3 0 25 Sep 2023
A Model-Agnostic Graph Neural Network for Integrating Local and Global Information Wenzhuo Zhou Annie Qu Keiland W Cooper Norbert Fortin B. Shahbaba 23 1 0 23 Sep 2023
Article Classification with Graph Neural Networks and Multigraphs Khang Ly Yury Kashnitsky Savvas Chamezopoulos Valeria Krzhizhanovskaya 11 0 0 20 Sep 2023
Rank Collapse Causes Over-Smoothing and Over-Correlation in Graph Neural Networks Andreas Roth Thomas Liebig 29 11 0 31 Aug 2023
GNNPipe: Scaling Deep GNN Training with Pipelined Model Parallelism Jingji Chen Zhuoming Chen Xuehai Qian GNN AI4CE 27 3 0 19 Aug 2023
Towards Zero Memory Footprint Spiking Neural Network Training Bin Lei Sheng Lin Pei-Hung Lin C. Liao Caiwen Ding 21 0 0 16 Aug 2023
Language is All a Graph Needs Ruosong Ye Caiqi Zhang Runhui Wang Shuyuan Xu Yongfeng Zhang AI4CE 45 150 0 14 Aug 2023
SimTeG: A Frustratingly Simple Approach Improves Textual Graph Learning Keyu Duan Qian Liu Tat-Seng Chua Shuicheng Yan Wei Tsang Ooi Qizhe Xie Junxian He 22 56 0 03 Aug 2023
Revisiting Implicit Models: Sparsity Trade-offs Capability in Weight-tied Model for Vision Tasks Haobo Song Soumajit Majumder Tao R. Lin VLM 13 0 0 16 Jul 2023
Exploring the Potential of Large Language Models (LLMs) in Learning on Graphs Zhikai Chen Haitao Mao Hang Li Wei Jin Haifang Wen ... Shuaiqiang Wang Dawei Yin Wenqi Fan Hui Liu Jiliang Tang AI4CE 33 265 0 07 Jul 2023
Deep Equilibrium Multimodal Fusion Jinhong Ni Yalong Bai Wei Zhang Ting Yao Tao Mei 19 1 0 29 Jun 2023
Mirage: Towards Low-interruption Services on Batch GPU Clusters with Reinforcement Learning Qi-Dong Ding Pengfei Zheng Shreyas Kudari Shivaram Venkataraman Zhao-jie Zhang VLM OffRL 6 3 0 25 Jun 2023
A Survey on Graph Neural Network Acceleration: Algorithms, Systems, and Customized Hardware Shichang Zhang Atefeh Sohrabizadeh Cheng Wan Zijie Huang Ziniu Hu Yewen Wang Yingyan Lin Lin Jason Cong Yizhou Sun GNN AI4CE 29 22 0 24 Jun 2023
Principles for Initialization and Architecture Selection in Graph Neural Networks with ReLU Activations G. Dezoort Boris Hanin AI4CE 17 3 0 20 Jun 2023
Graph Ladling: Shockingly Simple Parallel GNN Training without Intermediate Communication A. Jaiswal Shiwei Liu Tianlong Chen Ying Ding Zhangyang Wang GNN 31 5 0 18 Jun 2023
Towards Deep Attention in Graph Neural Networks: Problems and Remedies Soo Yong Lee Fanchen Bu Jaemin Yoo Kijung Shin GNN 9 30 0 04 Jun 2023
Oversmoothing: A Nightmare for Graph Contrastive Learning? Jintang Li Wangbin Sun Ruofan Wu Yuchang Zhu Liang Chen Zibin Zheng 11 2 0 03 Jun 2023
Centered Self-Attention Layers Ameen Ali Tomer Galanti Lior Wolf 28 6 0 02 Jun 2023
Improving Adversarial Robustness of DEQs with Explicit Regulations Along the Neural Dynamics Zonghan Yang Peng Li Tianyu Pang Yang Liu AAML 21 3 0 02 Jun 2023
A Closer Look at the Adversarial Robustness of Deep Equilibrium Models Zonghan Yang Tianyu Pang Yang Liu AAML 11 14 0 02 Jun 2023
Harnessing Explanations: LLM-to-LM Interpreter for Enhanced Text-Attributed Graph Representation Learning Xiaoxin He Xavier Bresson T. Laurent Adam Perold Yann LeCun Bryan Hooi 31 71 0 31 May 2023
Dink-Net: Neural Clustering on Large Graphs Yue Liu K. Liang Jun-Xiong Xia Sihang Zhou Xihong Yang Xinwang Liu Stan Z. Li GNN 30 54 0 28 May 2023
The Evolution of Distributed Systems for Graph Neural Networks and their Origin in Graph Processing and Deep Learning: A Survey Jana Vatter R. Mayer Hans-Arno Jacobsen GNN AI4TS AI4CE 31 23 0 23 May 2023
Train Your Own GNN Teacher: Graph-Aware Distillation on Textual Graphs Costas Mavromatis V. Ioannidis Shen Wang Da Zheng Soji Adeshina Jun Ma Han Zhao Christos Faloutsos George Karypis 13 29 0 20 Apr 2023
ElegansNet: a brief scientific report and initial experiments Francesco Bardozzo Andrea Terlizzi Pietro Lio' R. Tagliaferri 16 1 0 06 Apr 2023
Are More Layers Beneficial to Graph Transformers? Haiteng Zhao Shuming Ma Dongdong Zhang Zhi-Hong Deng Furu Wei 27 12 0 01 Mar 2023
Framelet Message Passing Xinliang Liu Bingxin Zhou Chutian Zhang Yu Guang Wang 21 5 0 28 Feb 2023
DRGCN: Dynamic Evolving Initial Residual for Deep Graph Convolutional Networks L. Zhang Xiaodong Yan Jianshan He Ruopeng Li Wei Chu GNN 9 12 0 10 Feb 2023
Reversible Vision Transformers K. Mangalam Haoqi Fan Yanghao Li Chaoxiong Wu Bo Xiong Christoph Feichtenhofer Jitendra Malik ViT 11 45 0 09 Feb 2023
On Over-Squashing in Message Passing Neural Networks: The Impact of Width, Depth, and Topology Francesco Di Giovanni Lorenzo Giusti Federico Barbero Giulia Luise Pietro Lio' Michael M. Bronstein 31 110 0 06 Feb 2023
An Implicit GNN Solver for Poisson-like problems Matthieu Nastorg M. Bucci T. Faney J. Gratien Guillaume Charpiat Marc Schoenauer AI4CE 34 2 0 06 Feb 2023
LazyGNN: Large-Scale Graph Neural Networks via Lazy Propagation Rui Xue Haoyu Han MohamadAli Torkamani Jian Pei Xiaorui Liu GNN 20 19 0 03 Feb 2023
Predicting the Silent Majority on Graphs: Knowledge Transferable Graph Neural Network Wendong Bi Bingbing Xu Xiaoqian Sun Li Xu Huawei Shen Xueqi Cheng 15 16 0 02 Feb 2023
Visiting Distant Neighbors in Graph Convolutional Networks Ali Hashemi H. Makse GNN 14 1 0 26 Jan 2023
SGCN: Exploiting Compressed-Sparse Features in Deep Graph Convolutional Network Accelerators Mingi Yoo Jaeyong Song Jounghoo Lee Namhyung Kim Youngsok Kim Jinho Lee GNN 33 17 0 25 Jan 2023
GIPA: A General Information Propagation Algorithm for Graph Learning Houyi Li Zhihong Chen Zhao Li Qinkai Zheng Peng Zhang Shuigeng Zhou 41 0 0 19 Jan 2023
Learning Graph Algorithms With Recurrent Graph Neural Networks Florian Grötschla Joël Mathys Roger Wattenhofer GNN 8 6 0 09 Dec 2022
Re^2TAL: Rewiring Pretrained Video Backbones for Reversible Temporal Action Localization Chen Zhao Shuming Liu K. Mangalam Bernard Ghanem 16 17 0 25 Nov 2022
TuneUp: A Simple Improved Training Strategy for Graph Neural Networks Weihua Hu Kaidi Cao Kexin Huang E-Wen Huang Karthik Subbian Kenji Kawaguchi J. Leskovec 24 0 0 26 Oct 2022
Learning on Large-scale Text-attributed Graphs via Variational Inference Jianan Zhao Meng Qu Chaozhuo Li Hao Yan Qian Liu Rui Li Xing Xie Jian Tang VLM 8 131 0 26 Oct 2022
MGNNI: Multiscale Graph Neural Networks with Implicit Layers Juncheng Liu Bryan Hooi Kenji Kawaguchi X. Xiao AI4CE 13 20 0 15 Oct 2022
Teaching Yourself: Graph Self-Distillation on Neighborhood for Node Classification Lirong Wu Jun-Xiong Xia Haitao Lin Zhangyang Gao Zicheng Liu Guojiang Zhao Stan Z. Li 61 6 0 05 Oct 2022
TPGNN: Learning High-order Information in Dynamic Graphs via Temporal Propagation Zehong Wang Qi Li Donghua Yu 25 2 0 03 Oct 2022
MLPInit: Embarrassingly Simple GNN Training Acceleration with MLP Initialization Xiaotian Han Tong Zhao Yozen Liu Xia Hu Neil Shah GNN 33 36 0 30 Sep 2022
How Powerful is Implicit Denoising in Graph Neural Networks Songtao Liu Rex Ying Hanze Dong Lu Lin Jinghui Chen Di Wu GNN AI4CE 12 3 0 29 Sep 2022
A Survey on Graph Neural Networks and Graph Transformers in Computer Vision: A Task-Oriented Perspective Chaoqi Chen Yushuang Wu Qiyuan Dai Hong-Yu Zhou Mutian Xu Sibei Yang Xiaoguang Han Yizhou Yu ViT MedIm AI4CE 25 73 0 27 Sep 2022
Analysis and Optimization of GNN-Based Recommender Systems on Persistent Memory Yuwei Hu Jiajie Li Zhongming Yu Zhiru Zhang GNN 27 0 0 25 Jul 2022
ViGAT: Bottom-up event recognition and explanation in video using factorized graph attention network Nikolaos Gkalelis Dimitrios Daskalakis Vasileios Mezaris 8 10 0 20 Jul 2022
XG-BoT: An Explainable Deep Graph Neural Network for Botnet Detection and Forensics Wai Weng Lo Gayan K. Kulatilleke Mohanad Sarhan S. Layeghy Marius Portmann 19 41 0 19 Jul 2022