GraphiT: Encoding Graph Structure in Transformers

10 June 2021

Grégoire Mialon

Papers citing "GraphiT: Encoding Graph Structure in Transformers"

50 / 117 papers shown

Title
Expressive Sign Equivariant Networks for Spectral Geometric Learning Derek Lim Joshua Robinson Stefanie Jegelka Haggai Maron 71 16 0 04 Dec 2023
Effective Structural Encodings via Local Curvature Profiles Lukas Fesser Melanie Weber 19 3 0 24 Nov 2023
Cycle Invariant Positional Encoding for Graph Representation Learning Zuoyu Yan Teng Ma Liangcai Gao Zhi Tang Chao Chen Yusu Wang 28 4 0 24 Nov 2023
Exposition on over-squashing problem on GNNs: Current Methods, Benchmarks and Challenges Dai Shi Andi Han Lequan Lin Yi Guo Junbin Gao 47 12 0 13 Nov 2023
Hybrid Focal and Full-Range Attention Based Graph Transformers Minhong Zhu Zhenhao Zhao Weiran Cai 32 0 0 08 Nov 2023
MATA: Combining Learnable Node Matching with A Algorithm for Approximate Graph Edit Distance Computation Junfeng Liu Min Zhou Shuai Ma Lujia Pan 29 10 0 04 Nov 2023
Facilitating Graph Neural Networks with Random Walk on Simplicial Complexes Cai Zhou Xiyuan Wang Muhan Zhang 31 14 0 30 Oct 2023
Laplacian Canonization: A Minimalist Approach to Sign and Basis Invariant Spectral Embedding Jiangyan Ma Yifei Wang Yisen Wang 30 13 0 28 Oct 2023
In-Context Learning for Few-Shot Molecular Property Prediction Christopher Fifty J. Leskovec Sebastian Thrun 34 5 0 13 Oct 2023
Tailoring Self-Attention for Graph via Rooted Subtrees Siyuan Huang Yunchong Song Jiayue Zhou Zhouhan Lin 21 8 0 08 Oct 2023
Locality-Aware Graph-Rewiring in GNNs Federico Barbero A. Velingker Amin Saberi Michael M. Bronstein Francesco Di Giovanni 33 27 0 02 Oct 2023
Joint-Relation Transformer for Multi-Person Motion Prediction Qingyao Xu Wei Mao Jingze Gong Chenxin Xu Siheng Chen Weidi Xie Ya-Qin Zhang Yanfeng Wang ViT 28 9 0 09 Aug 2023
Graph Positional and Structural Encoder Semih Cantürk Renming Liu Olivier Lapointe-Gagné Vincent Létourneau Guy Wolf Dominique Beaini Ladislav Rampášek 31 13 0 14 Jul 2023
SGFormer: Simplifying and Empowering Transformers for Large-Graph Representations Qitian Wu Wen-Long Zhao Chenxiao Yang Hengrui Zhang Fan Nie Haitian Jiang Yatao Bian Junchi Yan AI4CE 35 75 0 19 Jun 2023
Virtual Node Tuning for Few-shot Node Classification Zhen Tan Ruocheng Guo Kaize Ding Huan Liu 19 35 0 09 Jun 2023
How does over-squashing affect the power of GNNs? Francesco Di Giovanni T. Konstantin Rusch Michael M. Bronstein Andreea Deac Marc Lackenby Siddhartha Mishra Petar Velivcković 26 34 0 06 Jun 2023
Classification of Edge-dependent Labels of Nodes in Hypergraphs Minyoung Choe Sunwoo Kim Jaemin Yoo Kijung Shin GNN 17 10 0 05 Jun 2023
GIMLET: A Unified Graph-Text Model for Instruction-Based Molecule Zero-Shot Learning Haiteng Zhao Shengchao Liu Chang Ma Hannan Xu Jie Fu Zhihong Deng Lingpeng Kong Qi Liu 23 60 0 28 May 2023
Graph Inductive Biases in Transformers without Message Passing Liheng Ma Chen Lin Derek Lim Adriana Romero Soriano P. Dokania Mark J. Coates Philip H. S. Torr Ser-Nam Lim AI4CE 21 85 0 27 May 2023
Union Subgraph Neural Networks Jiaxing Xu Aihu Zhang Qingtian Bian Vijay Prakash Dwivedi Yiping Ke GNN 19 6 0 25 May 2023
G-Adapter: Towards Structure-Aware Parameter-Efficient Transfer Learning for Graph Transformer Networks Anchun Gui Jinqiang Ye Han Xiao 22 19 0 17 May 2023
BrainNPT: Pre-training of Transformer networks for brain network classification Jinlong Hu Ya-Lin Huang Nan Wang Shoubin Dong ViT MedIm 18 6 0 02 May 2023
Self-Attention in Colors: Another Take on Encoding Graph Structure in Transformers Romain Menegaux Emmanuel Jehanno Margot Selosse Julien Mairal 21 6 0 21 Apr 2023
DG-Trans: Dual-level Graph Transformer for Spatiotemporal Incident Impact Prediction on Traffic Networks Yanshen Sun Kaiqun Fu Chang-Tien Lu AI4TS AI4CE 30 2 0 21 Mar 2023
An Efficient Subgraph GNN with Provable Substructure Counting Power Zuoyu Yan Junru Zhou Liangcai Gao Zhi Tang Muhan Zhang GNN 22 12 0 19 Mar 2023
Exphormer: Sparse Transformers for Graphs Hamed Shirzad A. Velingker B. Venkatachalam Danica J. Sutherland A. Sinop 11 96 0 10 Mar 2023
Ewald-based Long-Range Message Passing for Molecular Graphs Arthur Kosmala Johannes Gasteiger Nicholas Gao Stephan Günnemann 66 25 0 08 Mar 2023
Diffusing Graph Attention Daniel Glickman Eran Yahav GNN 38 3 0 01 Mar 2023
Are More Layers Beneficial to Graph Transformers? Haiteng Zhao Shuming Ma Dongdong Zhang Zhi-Hong Deng Furu Wei 27 12 0 01 Mar 2023
HINormer: Representation Learning On Heterogeneous Information Networks with Graph Transformer Qiheng Mao Zemin Liu Chenghao Liu Jianling Sun 38 55 0 22 Feb 2023
MulGT: Multi-task Graph-Transformer with Task-aware Knowledge Injection and Domain Knowledge-driven Pooling for Whole Slide Image Analysis Weiqin Zhao Shujun Wang Maximus C. F. Yeung Tianye Niu Lequan Yu 36 9 0 21 Feb 2023
Attending to Graph Transformers Luis Muller Mikhail Galkin Christopher Morris Ladislav Rampášek 44 85 0 08 Feb 2023
On Over-Squashing in Message Passing Neural Networks: The Impact of Width, Depth, and Topology Francesco Di Giovanni Lorenzo Giusti Federico Barbero Giulia Luise Pietro Lio' Michael M. Bronstein 35 112 0 06 Feb 2023
Transformers Meet Directed Graphs Simon Geisler Yujia Li D. Mankowitz A. Cemgil Stephan Günnemann Cosmin Paduraru 27 35 0 31 Jan 2023
On the Connection Between MPNN and Graph Transformer Chen Cai Truong Son-Hy Rose Yu Yusu Wang 28 50 0 27 Jan 2023
Learning Compiler Pass Orders using Coreset and Normalized Value Prediction Youwei Liang Kevin R. Stone A. Shameli Chris Cummins Mostafa Elhoushi ... Benoit Steiner Xiaomeng Yang P. Xie Hugh Leather Yuandong Tian 9 9 0 09 Jan 2023
A Generalization of ViT/MLP-Mixer to Graphs Xiaoxin He Bryan Hooi T. Laurent Adam Perold Yann LeCun Xavier Bresson 31 88 0 27 Dec 2022
SLGTformer: An Attention-Based Approach to Sign Language Recognition Neil Song Yu Xiang SLR 22 0 0 21 Dec 2022
TopoImb: Toward Topology-level Imbalance in Learning from Graphs Tianxiang Zhao Dongsheng Luo Xiang Zhang Suhang Wang AI4CE 28 11 0 16 Dec 2022
Bridging Graph Position Encodings for Transformers with Weighted Graph-Walking Automata Patrick M. Soga David Chiang 19 0 0 13 Dec 2022
PatchGT: Transformer over Non-trainable Clusters for Learning Graph Representations Han Gao Xuhong Han Jiaoyang Huang Jian-Xun Wang Liping Liu ViT GNN 11 8 0 26 Nov 2022
Adaptive Multi-Neighborhood Attention based Transformer for Graph Representation Learning Gaichao Li Jinsong Chen Kun He 10 3 0 15 Nov 2022
Transformers over Directed Acyclic Graphs Yu Luo Veronika Thost Lei Shi GNN AI4CE 35 16 0 24 Oct 2022
Not All Neighbors Are Worth Attending to: Graph Selective Attention Networks for Semi-supervised Learning Tiantian He Haicang Zhou Yew-Soon Ong Gao Cong GNN 66 4 0 14 Oct 2022
Expander Graph Propagation Andreea Deac Marc Lackenby Petar Velivcković 96 51 0 06 Oct 2022
LogGD:Detecting Anomalies from System Logs by Graph Neural Networks Yongzhen Xie Hongyu Zhang M. Babar AI4TS 10 20 0 16 Sep 2022
Deformable Graph Transformer Jinyoung Park Seongjun Yun Hyeon-ju Park Jaewoo Kang Jisu Jeong KyungHyun Kim Jung-Woo Ha Hyunwoo J. Kim 82 7 0 29 Jun 2022
Long Range Graph Benchmark Vijay Prakash Dwivedi Ladislav Rampášek Mikhail Galkin Alipanah Parviz Guy Wolf A. Luu Dominique Beaini 26 193 0 16 Jun 2022
KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction Han Li Dan Zhao Jianyang Zeng 25 60 0 02 Jun 2022
Generalised Implicit Neural Representations Daniele Grattarola P. Vandergheynst 19 30 0 31 May 2022