A Note on Over-Smoothing for Graph Neural Networks

23 June 2020

Papers citing "A Note on Over-Smoothing for Graph Neural Networks"

45 / 45 papers shown

Title
Scalability Matters: Overcoming Challenges in InstructGLM with Similarity-Degree-Based Sampling Hyun Lee Chris Yi Maminur Islam B.D.S. Aritra 24 0 0 02 May 2025
What makes a good feedforward computational graph? Alex Vitvitskyi J. G. Araújo Marc Lackenby Petar Velickovic 80 1 0 10 Feb 2025
A Privacy-Preserving Domain Adversarial Federated learning for multi-site brain functional connectivity analysis Y. Zhang Likai Wang Kuan-Jui Su Aiying Zhang Hao Zhu Xiaowen Liu Hui Shen Vince D. Calhoun Yuping Wang H. Deng 56 0 0 03 Feb 2025
Understanding Oversmoothing in GNNs as Consensus in Opinion Dynamics Keqin Wang Yulong Yang Ishan Saha Christine Allen-Blanchette 51 1 0 31 Jan 2025
Understanding the Effect of GCN Convolutions in Regression Tasks Juntong Chen Johannes Schmidt-Hieber Claire Donnat Olga Klopp GNN 29 0 0 26 Oct 2024
OmniXAS: A Universal Deep-Learning Framework for Materials X-ray Absorption Spectra Shubha R. Kharel Fanchen Meng Xiaohui Qu Matthew R. Carbone Deyu Lu 24 0 0 29 Sep 2024
Preventing Representational Rank Collapse in MPNNs by Splitting the Computational Graph Andreas Roth Franka Bause Nils M. Kriege Thomas Liebig 33 2 0 17 Sep 2024
RIDA: A Robust Attack Framework on Incomplete Graphs Jianke Yu Hanchen Wang Chen Chen Xiaoyang Wang Wenjie Zhang Ying Zhang Ying Zhang Xijuan Liu GNN OOD AAML 36 1 0 25 Jul 2024
Graph Neural Reaction Diffusion Models Moshe Eliasof Eldad Haber Eran Treister DiffM AI4CE 26 2 0 16 Jun 2024
Bundle Neural Networks for message diffusion on graphs Jacob Bamberger Federico Barbero Xiaowen Dong Michael M. Bronstein 37 1 0 24 May 2024
Three Revisits to Node-Level Graph Anomaly Detection: Outliers, Message Passing and Hyperbolic Neural Networks Jing Gu Dongmian Zou 32 3 0 06 Mar 2024
GRASP: GRAph-Structured Pyramidal Whole Slide Image Representation Ali Khajegili Mirabadi Graham Archibald Amirali Darbandsari A. Contreras-Sanz Ramin Nakhli ... C. Gilks Peter C Black Gang Wang H. Farahani A. Bashashati 32 5 0 06 Feb 2024
Graph Convolutions Enrich the Self-Attention in Transformers! Jeongwhan Choi Hyowon Wi Jayoung Kim Yehjin Shin Kookjin Lee Nathaniel Trask Noseong Park 25 4 0 07 Dec 2023
Dirichlet Energy Enhancement of Graph Neural Networks by Framelet Augmentation Jialin Chen Yuelin Wang Cristian Bodnar Rex Ying Pietro Lió Yu Guang Wang 27 10 0 09 Nov 2023
URLOST: Unsupervised Representation Learning without Stationarity or Topology Zeyu Yun Juexiao Zhang Bruno A. Olshausen Yann LeCun 23 0 0 06 Oct 2023
Information Flow in Graph Neural Networks: A Clinical Triage Use Case Víctor Valls Mykhaylo Zayats Alessandra Pascale 19 1 0 12 Sep 2023
Unifying over-smoothing and over-squashing in graph neural networks: A physics informed approach and beyond Zhiqi Shao Dai Shi Andi Han Yi Guo Qianchuan Zhao Junbin Gao 24 11 0 06 Sep 2023
Rank Collapse Causes Over-Smoothing and Over-Correlation in Graph Neural Networks Andreas Roth Thomas Liebig 29 11 0 31 Aug 2023
How Curvature Enhance the Adaptation Power of Framelet GCNs Dai Shi Yi Guo Zhiqi Shao Junbin Gao 21 14 0 19 Jul 2023
Supervised Attention Using Homophily in Graph Neural Networks Michail Chatzianastasis Giannis Nikolentzos Michalis Vazirgiannis GNN 11 0 0 11 Jul 2023
A Neural Collapse Perspective on Feature Evolution in Graph Neural Networks Vignesh Kothapalli Tom Tirer Joan Bruna 32 10 0 04 Jul 2023
Centered Self-Attention Layers Ameen Ali Tomer Galanti Lior Wolf 28 6 0 02 Jun 2023
A Fractional Graph Laplacian Approach to Oversmoothing Sohir Maskey Raffaele Paolino Aras Bacho Gitta Kutyniok 22 29 0 22 May 2023
Dynamic Causal Explanation Based Diffusion-Variational Graph Neural Network for Spatio-temporal Forecasting G. Liang Prayag Tiwari Sławomir Nowaczyk Stefan Byttner F. Alonso-Fernandez DiffM 33 11 0 16 May 2023
Dynamic Graph Representation Learning with Neural Networks: A Survey Leshanshui Yang Sébastien Adam Clément Chatelain AI4TS AI4CE 26 14 0 12 Apr 2023
On the Connection Between MPNN and Graph Transformer Chen Cai Truong Son-Hy Rose Yu Yusu Wang 28 50 0 27 Jan 2023
Adaptive Depth Graph Attention Networks Jingbo Zhou Yixuan Du Ruqiong Zhang Rui Zhang GNN 34 1 0 16 Jan 2023
Revisiting Over-smoothing and Over-squashing Using Ollivier-Ricci Curvature K. Nguyen Hieu Nong T. Nguyen Nhat Ho Khuong N. Nguyen Vinh Phu Nguyen 19 61 0 28 Nov 2022
Old can be Gold: Better Gradient Flow can Make Vanilla-GCNs Great Again Ajay Jaiswal Peihao Wang Tianlong Chen Justin F. Rousseau Ying Ding Zhangyang Wang 22 10 0 14 Oct 2022
From Local to Global: Spectral-Inspired Graph Neural Networks Ningyuan Huang Soledad Villar Carey E. Priebe Da Zheng Cheng-Fu Huang Lin F. Yang Vladimir Braverman 18 14 0 24 Sep 2022
FedEgo: Privacy-preserving Personalized Federated Graph Learning with Ego-graphs Taolin Zhang Chuan Chen Yaomin Chang Lin Shu Zibin Zheng FedML 21 14 0 29 Aug 2022
Tuning the Geometry of Graph Neural Networks Sowon Jeong Claire Donnat AI4CE 32 1 0 12 Jul 2022
Pure Transformers are Powerful Graph Learners Jinwoo Kim Tien Dat Nguyen Seonwoo Min Sungjun Cho Moontae Lee Honglak Lee Seunghoon Hong 32 187 0 06 Jul 2022
Model Degradation Hinders Deep Graph Neural Networks Wentao Zhang Zeang Sheng Ziqi Yin Yuezihan Jiang Yikuan Xia Jun Gao Zhi-Xin Yang Bin Cui GNN AI4CE 21 39 0 09 Jun 2022
VRAG: Region Attention Graphs for Content-Based Video Retrieval K. Ng Ser-Nam Lim G. Lee 17 4 0 18 May 2022
NC-DRE: Leveraging Non-entity Clue Information for Document-level Relation Extraction L. Zhang Yidong Cheng 11 2 0 01 Apr 2022
Preventing Over-Smoothing for Hypergraph Neural Networks Guan-Wun Chen Jiying Zhang Xi Xiao Yang Li 21 22 0 31 Mar 2022
Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice Peihao Wang Wenqing Zheng Tianlong Chen Zhangyang Wang ViT 14 127 0 09 Mar 2022
Equilibrium Aggregation: Encoding Sets via Optimization Sergey Bartunov F. Fuchs Timothy Lillicrap 17 7 0 25 Feb 2022
A Piece-wise Polynomial Filtering Approach for Graph Neural Networks Vijay Lingam C. Ekbote Manan Sharma Rahul Ragesh Arun Shankar Iyer Sundararajan Sellamanickam 24 5 0 07 Dec 2021
On Provable Benefits of Depth in Training Graph Convolutional Networks Weilin Cong M. Ramezani M. Mahdavi 19 73 0 28 Oct 2021
Scalable deeper graph neural networks for high-performance materials property prediction Sadman Sadeed Omee Steph-Yves M. Louis Nihang Fu Lai Wei Sourin Dey Rongzhi Dong Qinyang Li Jianjun Hu 68 73 0 25 Sep 2021
Evaluating Deep Graph Neural Networks Wentao Zhang Zeang Sheng Yuezihan Jiang Yikuan Xia Jun Gao Zhi-Xin Yang Bin Cui GNN AI4CE 16 31 0 02 Aug 2021
Dirichlet Energy Constrained Learning for Deep Graph Neural Networks Kaixiong Zhou Xiao Shi Huang Daochen Zha Rui Chen Li Li Soo-Hyun Choi Xia Hu GNN AI4CE 22 113 0 06 Jul 2021
Simple GNN Regularisation for 3D Molecular Property Prediction & Beyond Jonathan Godwin Michael Schaarschmidt Alex Gaunt Alvaro Sanchez-Gonzalez Yulia Rubanova Petar Velivcković J. Kirkpatrick Peter W. Battaglia 31 61 0 15 Jun 2021