Representing Long-Range Context for Graph Neural Networks with Global Attention

21 January 2022

Papers citing "Representing Long-Range Context for Graph Neural Networks with Global Attention"

50 / 133 papers shown

Title
Graph Fourier Transformer with Structure-Frequency Information Yonghui Zhai Yang Zhang Minghao Shang Lihua Pang Yaxin Ren 29 0 0 28 Apr 2025
Federated Prototype Graph Learning Zhengyu Wu Xunkai Li Y. X. Zhu R. Li Guoren Wang Chenghu Zhou FedML 31 0 0 13 Apr 2025
Inductive Link Prediction on N-ary Relational Facts via Semantic Hypergraph Reasoning Gongzhu Yin H. Zhang Yuchen Yang Y. Luo LRM 73 0 0 26 Mar 2025
Unlocking the Potential of Classic GNNs for Graph-level Tasks: Simple Architectures Meet Excellence Yuankai Luo Lei Shi Xiao-Ming Wu AI4CE 57 0 0 13 Feb 2025
Simple Path Structural Encoding for Graph Transformers Louis Airale Antonio Longa Mattia Rigon Andrea Passerini Roberto Passerone 87 0 0 13 Feb 2025
Using Random Noise Equivariantly to Boost Graph Neural Networks Universally X. Wang Muhan Zhang 94 0 0 04 Feb 2025
Policy Guided Tree Search for Enhanced LLM Reasoning Yang Li LRM 45 0 0 04 Feb 2025
Longer Attention Span: Increasing Transformer Context Length with Sparse Graph Processing Techniques Nathaniel Tomczak Sanmukh Kuppannagari 84 0 0 31 Jan 2025
Know Unreported Roadway Incidents in Real-time: Early Traffic Anomaly Detection Haocheng Duan Hao Wu Sean Qian 82 0 0 14 Dec 2024
A Context-Enhanced Framework for Sequential Graph Reasoning Shuo Shi Chao Peng Chenyang Xu Zhengfeng Yang 106 0 0 12 Dec 2024
RL-MILP Solver: A Reinforcement Learning Approach for Solving Mixed-Integer Linear Programs with Graph Neural Networks Tae-Hoon Lee Min-Soo Kim 68 0 0 29 Nov 2024
GrokFormer: Graph Fourier Kolmogorov-Arnold Transformers Guoguo Ai Guansong Pang Hezhe Qiao Yuan Gao Hui Yan 54 0 0 26 Nov 2024
Edge Weight Prediction For Category-Agnostic Pose Estimation Or Hirschorn S. Avidan 64 0 0 25 Nov 2024
On the importance of local and global feature learning for automated measurable residual disease detection in flow cytometry data Lisa Weijler Michael Reiter Pedro Hermosilla Margarita Maurer-Granofszky Michael N. Dworzak 69 0 0 23 Nov 2024
Scalable Message Passing Neural Networks: No Need for Attention in Large Graph Representation Learning Haitz Sáez de Ocáriz Borde Artem Lukoianov Anastasis Kratsios Michael M. Bronstein Xiaowen Dong GNN 28 1 0 29 Oct 2024
A Hierarchical Language Model For Interpretable Graph Reasoning Sambhav Khurana Xiner Li Shurui Gui Shuiwang Ji LRM 21 0 0 29 Oct 2024
A Cosmic-Scale Benchmark for Symmetry-Preserving Data Processing Julia Balla S. Mishra-Sharma C. Cuesta-Lázaro Tommi Jaakkola Tess E. Smidt 19 0 0 27 Oct 2024
DuoGNN: Topology-aware Graph Neural Network with Homophily and Heterophily Interaction-Decoupling K. Mancini I. Rekik 28 1 0 29 Sep 2024
KnowFormer: Revisiting Transformers for Knowledge Graph Reasoning Junnan Liu Qianren Mao Weifeng Jiang Jianxin Li 20 0 0 19 Sep 2024
Contrastive Representation Learning for Dynamic Link Prediction in Temporal Networks Amirhossein Nouranizadeh Fatemeh Tabatabaei Far Mohammad Rahmati AI4TS 12 0 0 22 Aug 2024
TSC: A Simple Two-Sided Constraint against Over-Smoothing Furong Peng Kang Liu Xuan Lu Yuhua Qian HongRen Yan Chao Ma 35 0 0 06 Aug 2024
TorchGT: A Holistic System for Large-scale Graph Transformer Training Mengdie Zhang Jie Sun Qi Hu Peng Sun Zeke Wang Yonggang Wen Tianwei Zhang GNN 23 1 0 19 Jul 2024
When Heterophily Meets Heterogeneity: New Graph Benchmarks and Effective Methods Junhong Lin Xiaojie Guo Shuaicheng Zhang Dawei Zhou Yada Zhu Julian Shun 33 0 0 15 Jul 2024
SPIN: SE(3)-Invariant Physics Informed Network for Binding Affinity Prediction Seungyeon Choi Sangmin Seo Sanghyun Park 22 0 0 10 Jul 2024
Foundations and Frontiers of Graph Learning Theory Yu Huang Min Zhou Menglin Yang Zhen Wang Muhan Zhang Jie Wang Hong Xie Hao Wang Defu Lian Enhong Chen AI4CE GNN 35 2 0 03 Jul 2024
Differential Encoding for Improved Representation Learning over Graphs Haimin Zhang Jiahao Xia Min Xu 25 0 0 03 Jul 2024
Leveraging Contrastive Learning for Enhanced Node Representations in Tokenized Graph Transformers Jinsong Chen Hanpeng Liu J. Hopcroft Kun He 16 1 0 27 Jun 2024
NTFormer: A Composite Node Tokenized Graph Transformer for Node Classification Jinsong Chen Siyu Jiang Kun He 26 1 0 27 Jun 2024
Effective Edge-wise Representation Learning in Edge-Attributed Bipartite Graphs Hewen Wang Renchi Yang Xiaokui Xiao 20 1 0 19 Jun 2024
A Unified Framework for Combinatorial Optimization Based on Graph Neural Networks Yaochu Jin Xueming Yan Shiqing Liu Xiangyu Wang 26 3 0 19 Jun 2024
A Scalable and Effective Alternative to Graph Transformers Kaan Sancak Zhigang Hua Jin Fang Yan Xie Andrey Malevich Bo Long M. F. Balin Ümit V. Çatalyürek 29 1 0 17 Jun 2024
A Comprehensive Graph Pooling Benchmark: Effectiveness, Robustness and Generalizability Pengyun Wang Junyu Luo Yanxin Shen Siyu Heng Xiao Luo 31 1 0 13 Jun 2024
Learning Job Title Representation from Job Description Aggregation Network Napat Laosaengpha Thanit Tativannarat Chawan Piansaddhayanon Attapol Rutherford E. Chuangsuwanich 21 0 0 12 Jun 2024
Learning Long Range Dependencies on Graphs via Random Walks Dexiong Chen Till Hendrik Schulz Karsten Borgwardt 18 1 0 05 Jun 2024
Understanding Auditory Evoked Brain Signal via Physics-informed Embedding Network with Multi-Task Transformer Wanli Ma Xuegang Tang Jin Gu Ying Wang Yuling Xia 23 0 0 04 Jun 2024
What Improves the Generalization of Graph Transformers? A Theoretical Dive into the Self-attention and Positional Encoding Hongkang Li Meng Wang Tengfei Ma Sijia Liu Zaixi Zhang Pin-Yu Chen MLT AI4CE 37 7 0 04 Jun 2024
Dual-perspective Cross Contrastive Learning in Graph Transformers Zelin Yao Chuang Liu Xueqi Ma Mukun Chen Jia Wu Xiantao Cai Bo Du Wenbin Hu 32 0 0 01 Jun 2024
Graph External Attention Enhanced Transformer Jianqing Liang Min Chen Jiye Liang 25 0 0 31 May 2024
Automatic Graph Topology-Aware Transformer Chao Wang Jiaxuan Zhao Lingling Li Licheng Jiao Fang Liu Shuyuan Yang ViT 12 1 0 30 May 2024
Probabilistic Graph Rewiring via Virtual Nodes Chendi Qian Andrei Manolache Christopher Morris Mathias Niepert AI4CE 22 1 0 27 May 2024
Attending to Topological Spaces: The Cellular Transformer Rubén Ballester Pablo Hernández-García Mathilde Papillon Claudio Battiloro Nina Miolane Tolga Birdal Carles Casacuberta Sergio Escalera Mustafa Hajij 29 3 0 23 May 2024
Advancing Graph Convolutional Networks via General Spectral Wavelets Nian Liu Xiaoxin He T. Laurent Francesco Di Giovanni Michael M. Bronstein Xavier Bresson 24 0 0 22 May 2024
Understanding Virtual Nodes: Oversquashing and Node Heterogeneity Joshua Southern Francesco Di Giovanni Michael M. Bronstein J. Lutzeyer 38 1 0 22 May 2024
Graph as Point Set Xiyuan Wang Pan Li Muhan Zhang GNN 3DPC PINN 20 4 0 05 May 2024
ATNPA: A Unified View of Oversmoothing Alleviation in Graph Neural Networks Yufei Jin Xingquan Zhu 38 2 0 02 May 2024
FairGT: A Fairness-aware Graph Transformer Renqiang Luo Huafei Huang Shuo Yu Xiuzhen Zhang Feng Xia 19 8 0 26 Apr 2024
Gradformer: Graph Transformer with Exponential Decay Chuang Liu Zelin Yao Yibing Zhan Xueqi Ma Shirui Pan Wenbin Hu 20 1 0 24 Apr 2024
GvT: A Graph-based Vision Transformer with Talking-Heads Utilizing Sparsity, Trained from Scratch on Small Datasets Dongjing Shan guiqiang chen ViT 31 0 0 07 Apr 2024
VCR-Graphormer: A Mini-batch Graph Transformer via Virtual Connections Dongqi Fu Zhigang Hua Yan Xie Jin Fang Si Zhang Kaan Sancak Hao Wu Andrey Malevich Jingrui He Bo Long 18 18 0 24 Mar 2024
GTC: GNN-Transformer Co-contrastive Learning for Self-supervised Heterogeneous Graph Representation Yundong Sun Dongjie Zhu Yansong Wang Zhaoshuo Tian ViT SSL 22 13 0 22 Mar 2024