Rank Collapse Causes Over-Smoothing and Over-Correlation in Graph Neural Networks

31 August 2023

Papers citing "Rank Collapse Causes Over-Smoothing and Over-Correlation in Graph Neural Networks"

13 / 13 papers shown

Title
Generalized Probabilistic Attention Mechanism in Transformers DongNyeong Heo Heeyoul Choi 44 0 0 21 Oct 2024
Pretraining Graph Transformers with Atom-in-a-Molecule Quantum Properties for Improved ADMET Modeling Alessio Fallani Ramil I. Nugmanov Jose A. Arjona-Medina Jörg Kurt Wegner Alexandre Tkatchenko Kostiantyn Chernichenko MedIm AI4CE 19 0 0 10 Oct 2024
Preventing Representational Rank Collapse in MPNNs by Splitting the Computational Graph Andreas Roth Franka Bause Nils M. Kriege Thomas Liebig 15 2 0 17 Sep 2024
Simplifying the Theory on Over-Smoothing Andreas Roth 28 1 0 16 Jul 2024
Differential Encoding for Improved Representation Learning over Graphs Haimin Zhang Jiahao Xia Min Xu 33 0 0 03 Jul 2024
Spectral Graph Pruning Against Over-Squashing and Over-Smoothing Adarsh Jamadandi Celia Rubio-Madrigal R. Burkholz 28 1 0 06 Apr 2024
Distilling Influences to Mitigate Prediction Churn in Graph Neural Networks Andreas Roth Thomas Liebig 47 0 0 02 Oct 2023
Gradient Gating for Deep Multi-Rate Learning on Graphs T. Konstantin Rusch B. Chamberlain Michael W. Mahoney Michael M. Bronstein Siddhartha Mishra 68 53 0 02 Oct 2022
Transforming PageRank into an Infinite-Depth Graph Neural Network Andreas Roth Thomas Liebig GNN 28 13 0 01 Jul 2022
Orthogonal Graph Neural Networks Kai Guo Kaixiong Zhou Xia Hu Yu Li Yi Chang Xin Wang 41 34 0 23 Sep 2021
Beyond Low-frequency Information in Graph Convolutional Networks Deyu Bo Xiao Wang C. Shi Huawei Shen GNN 84 445 0 04 Jan 2021
Geom-GCN: Geometric Graph Convolutional Networks Hongbin Pei Bingzhen Wei Kevin Chen-Chuan Chang Yu Lei Bo Yang GNN 167 1,058 0 13 Feb 2020
Multi-scale Attributed Node Embedding Benedek Rozemberczki Carl Allen Rik Sarkar GNN 139 828 0 28 Sep 2019