Rethinking Graph Transformers with Spectral Attention

7 June 2021

Papers citing "Rethinking Graph Transformers with Spectral Attention"

50 / 305 papers shown

Title
DRew: Dynamically Rewired Message Passing with Delay Benjamin Gutteridge Xiaowen Dong Michael M. Bronstein Francesco Di Giovanni 36 58 0 13 May 2023
AGFormer: Efficient Graph Representation with Anchor-Graph Transformer Bo Jiang Fei Xu Ziyan Zhang Jin Tang Feiping Nie 31 4 0 12 May 2023
Towards Better Graph Representation Learning with Parameterized Decomposition & Filtering Mingqi Yang Wenjie Feng Yanming Shen Bryan Hooi 30 4 0 10 May 2023
Transformer-Based Hierarchical Clustering for Brain Network Analysis Wei Dai Hejie Cui Xuan Kan Ying Guo S. V. Rooij Carl Yang 32 12 0 06 May 2023
Hierarchical Transformer for Scalable Graph Learning Wenhao Zhu Tianyu Wen Guojie Song Xiaojun Ma Liang Wang 35 14 0 04 May 2023
BrainNPT: Pre-training of Transformer networks for brain network classification Jinlong Hu Ya-Lin Huang Nan Wang Shoubin Dong ViT MedIm 21 6 0 02 May 2023
Self-Attention in Colors: Another Take on Encoding Graph Structure in Transformers Romain Menegaux Emmanuel Jehanno Margot Selosse Julien Mairal 21 6 0 21 Apr 2023
Decouple Graph Neural Networks: Train Multiple Simple GNNs Simultaneously Instead of One Hongyuan Zhang Yanan Zhu Xuelong Li 19 9 0 20 Apr 2023
Improving Graph Neural Networks on Multi-node Tasks with the Labeling Trick Xiyuan Wang Pan Li Muhan Zhang AI4CE 28 4 0 20 Apr 2023
A Comprehensive Survey on Deep Graph Representation Learning Wei Ju Zheng Fang Yiyang Gu Zequn Liu Qingqing Long ... Jingyang Yuan Yusheng Zhao Yifan Wang Xiao Luo Ming Zhang GNN AI4TS 37 141 0 11 Apr 2023
Transformer and Snowball Graph Convolution Learning for Brain functional network Classification Jinlong Hu Ya-Lin Huang Shoubin Dong 22 1 0 28 Mar 2023
An Efficient Subgraph GNN with Provable Substructure Counting Power Zuoyu Yan Junru Zhou Liangcai Gao Zhi Tang Muhan Zhang GNN 22 12 0 19 Mar 2023
All4One: Symbiotic Neighbour Contrastive Learning via Self-Attention and Redundancy Reduction Imanol G. Estepa Ignacio Sarasúa Bhalaji Nagarajan P. Radeva SSL 40 8 0 16 Mar 2023
Exphormer: Sparse Transformers for Graphs Hamed Shirzad A. Velingker B. Venkatachalam Danica J. Sutherland A. Sinop 11 97 0 10 Mar 2023
Ewald-based Long-Range Message Passing for Molecular Graphs Arthur Kosmala Johannes Gasteiger Nicholas Gao Stephan Günnemann 68 25 0 08 Mar 2023
Graph Positional Encoding via Random Feature Propagation Moshe Eliasof Fabrizio Frasca Beatrice Bevilacqua Eran Treister Gal Chechik Haggai Maron 22 18 0 06 Mar 2023
Specformer: Spectral Graph Neural Networks Meet Transformers Deyu Bo Chuan Shi Lele Wang Renjie Liao 71 80 0 02 Mar 2023
Diffusing Graph Attention Daniel Glickman Eran Yahav GNN 40 3 0 01 Mar 2023
Are More Layers Beneficial to Graph Transformers? Haiteng Zhao Shuming Ma Dongdong Zhang Zhi-Hong Deng Furu Wei 27 12 0 01 Mar 2023
Single-Cell Multimodal Prediction via Transformers Wenzhuo Tang Haifang Wen Renming Liu Jiayuan Ding Wei Jin Yuying Xie Hui Liu Jiliang Tang AI4CE 24 11 0 01 Mar 2023
Contrastive Video Question Answering via Video Graph Transformer Junbin Xiao Pan Zhou Angela Yao Yicong Li Richang Hong Shuicheng Yan Tat-Seng Chua ViT 19 35 0 27 Feb 2023
HINormer: Representation Learning On Heterogeneous Information Networks with Graph Transformer Qiheng Mao Zemin Liu Chenghao Liu Jianling Sun 38 55 0 22 Feb 2023
Multiresolution Graph Transformers and Wavelet Positional Encoding for Learning Hierarchical Structures Nhat-Khang Ngô Truong Son-Hy Risi Kondor ViT AI4CE 29 2 0 17 Feb 2023
A Survey on Spectral Graph Neural Networks Deyu Bo Xiao Wang Yang Liu Yuan Fang Yawen Li Chuan Shi 35 25 0 11 Feb 2023
Attending to Graph Transformers Luis Muller Mikhail Galkin Christopher Morris Ladislav Rampášek 49 85 0 08 Feb 2023
GPS++: Reviving the Art of Message Passing for Molecular Property Prediction Dominic Masters Josef Dean Kerstin Klaser Zhiyi Li Sam Maddrell-Mander ... D. Beker Andrew Fitzgibbon Shenyang Huang Ladislav Rampášek Dominique Beaini 28 8 0 06 Feb 2023
On Over-Squashing in Message Passing Neural Networks: The Impact of Width, Depth, and Topology Francesco Di Giovanni Lorenzo Giusti Federico Barbero Giulia Luise Pietro Lio' Michael M. Bronstein 35 112 0 06 Feb 2023
Single Cells Are Spatial Tokens: Transformers for Spatial Transcriptomic Data Imputation Haifang Wen Wenzhuo Tang Wei Jin Jiayuan Ding Renming Liu Xinnan Dai Feng Shi Lulu Shang Jiliang Tang Yuying Xie 27 8 0 06 Feb 2023
Transformers Meet Directed Graphs Simon Geisler Yujia Li D. Mankowitz A. Cemgil Stephan Günnemann Cosmin Paduraru 27 35 0 31 Jan 2023
On the Connection Between MPNN and Graph Transformer Chen Cai Truong Son-Hy Rose Yu Yusu Wang 33 51 0 27 Jan 2023
Task-Agnostic Graph Neural Network Evaluation via Adversarial Collaboration Xiangyu Zhao Hannes Stärk Dominique Beaini Yiren Zhao Pietro Lio' 24 0 0 27 Jan 2023
Conditional Diffusion Based on Discrete Graph Structures for Molecular Graph Generation Han Huang Leilei Sun Bowen Du Weifeng Lv 40 40 0 01 Jan 2023
A Generalization of ViT/MLP-Mixer to Graphs Xiaoxin He Bryan Hooi T. Laurent Adam Perold Yann LeCun Xavier Bresson 36 88 0 27 Dec 2022
SLGTformer: An Attention-Based Approach to Sign Language Recognition Neil Song Yu Xiang SLR 22 0 0 21 Dec 2022
A Retrieve-and-Read Framework for Knowledge Graph Link Prediction Vardaan Pahuja Boshi Wang Hugo Latapie Jayanth Srinivasa Yu-Chuan Su 23 13 0 19 Dec 2022
Bridging Graph Position Encodings for Transformers with Weighted Graph-Walking Automata Patrick M. Soga David Chiang 27 0 0 13 Dec 2022
On the Trade-off between Over-smoothing and Over-squashing in Deep Graph Neural Networks Jhony H. Giraldo Konstantinos Skianis T. Bouwmans Fragkiskos D. Malliaros 16 45 0 05 Dec 2022
GraphGDP: Generative Diffusion Processes for Permutation Invariant Graph Generation Han Huang Leilei Sun Bowen Du Yanjie Fu Weifeng Lv DiffM 26 42 0 04 Dec 2022
PatchGT: Transformer over Non-trainable Clusters for Learning Graph Representations Han Gao Xuhong Han Jiaoyang Huang Jian-Xun Wang Liping Liu ViT GNN 11 8 0 26 Nov 2022
DBA: Efficient Transformer with Dynamic Bilinear Low-Rank Attention Bosheng Qin Juncheng Li Siliang Tang Yueting Zhuang 17 2 0 24 Nov 2022
Learnable Spectral Wavelets on Dynamic Graphs to Capture Global Interactions Anson Bastos Abhishek Nadgeri Kuldeep Singh Toyotaro Suzumura Manish Singh 35 7 0 22 Nov 2022
Learnable Graph Convolutional Attention Networks Adrián Javaloy Pablo Sánchez-Martín Amit Levi Isabel Valera GNN 24 10 0 21 Nov 2022
GPS++: An Optimised Hybrid MPNN/Transformer for Molecular Property Prediction Dominic Masters Josef Dean Kerstin Klaser Zhiyi Li Sam Maddrell-Mander Adam Sanders Hatem Helal D. Beker Ladislav Rampášek Dominique Beaini 26 23 0 18 Nov 2022
Adaptive Multi-Neighborhood Attention based Transformer for Graph Representation Learning Gaichao Li Jinsong Chen Kun He 16 3 0 15 Nov 2022
Learning Task-Aware Effective Brain Connectivity for fMRI Analysis with Graph Neural Networks Yue Yu Xuan Kan Hejie Cui Ran Xu Yu Zheng ... Kun Zhang Razieh Nabi Ying Guo Chaogang Zhang Carl Yang 11 17 0 01 Nov 2022
Generalized Laplacian Positional Encoding for Graph Representation Learning Sohir Maskey Alipanah Parviz Maximilian Thiessen Hannes Stärk Ylli Sadikaj Haggai Maron AI4CE 36 15 0 28 Oct 2022
Transformers over Directed Acyclic Graphs Yu Luo Veronika Thost Lei Shi GNN AI4CE 37 16 0 24 Oct 2022
FoSR: First-order spectral rewiring for addressing oversquashing in GNNs Kedar Karhadkar P. Banerjee Guido Montúfar 26 56 0 21 Oct 2022
Graphically Structured Diffusion Models Christian Weilbach William Harvey Frank D. Wood DiffM 32 7 0 20 Oct 2022
Extending Graph Transformers with Quantum Computed Aggregation Slimane Thabet Romain Fouilland L. Henriet GNN 25 3 0 19 Oct 2022