Transformer for Graphs: An Overview from Architecture Perspective

17 February 2022

Papers citing "Transformer for Graphs: An Overview from Architecture Perspective"

40 / 90 papers shown

Title
Machine Learning on Dynamic Graphs: A Survey on ApplicationsIEEE International Conference on Multimedia Big Data (ICMBD), 2023 Sanaz Hasanzadeh Fard AI4CE 182 7 0 16 Jan 2024
Graph Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Moritz Plenz Anette Frank KELM AI4CE 319 8 0 13 Jan 2024
Masked Modeling for Self-supervised Representation Learning on Vision and Beyond Siyuan Li Luyuan Zhang Zedong Wang Di Wu Lirong Wu ... Jun Xia Cheng Tan Yang Liu Baigui Sun Stan Z. Li SSL 219 26 0 31 Dec 2023
GraphGPT: Generative Pre-trained Graph Eulerian Transformer Qifang Zhao Weidong Ren Tianyu Li Hong Liu Xingsheng He Xiaoxiao Xu SLR 93 5 0 31 Dec 2023
CAT: A Causally Graph Attention Network for Trimming Heterophilic GraphInformation Sciences (Inf. Sci.), 2023 Silu He Qinyao Luo Xinsha Fu Ling Zhao Ronghua Du Haifeng Li 220 10 0 14 Dec 2023
Exploring Sparsity in Graph TransformersNeural Networks (Neural Netw.), 2023 Chuang Liu Yibing Zhan Xueqi Ma Liang Ding Dapeng Tao Hongzhi Zhang Wenbin Hu Bo Du 232 10 0 09 Dec 2023
Large-scale Graph Representation Learning of Dynamic Brain Connectome with Transformers Byung-Hoon Kim Jungwon Choi Eunggu Yun Kyungsang Kim Xiang Li Juho Lee AI4CE 116 4 0 04 Dec 2023
Hybrid Focal and Full-Range Attention Based Graph Transformers Minhong Zhu Zhenhao Zhao Weiran Cai 155 0 0 08 Nov 2023
Neural Atoms: Propagating Long-range Interaction in Molecular Graphs through Efficient Communication ChannelInternational Conference on Learning Representations (ICLR), 2023 Xuan Li Zhanke Zhou Jiangchao Yao Yu Rong Jun Liu Bo Han 258 11 0 02 Nov 2023
Graph Agent: Explicit Reasoning Agent for Graphs Qinyong Wang Zhenxiang Gao Rong Xu AI4CE 112 10 0 25 Oct 2023
Tailoring Self-Attention for Graph via Rooted SubtreesNeural Information Processing Systems (NeurIPS), 2023 Siyuan Huang Yunchong Song Jiayue Zhou Zhouhan Lin 142 10 0 08 Oct 2023
Where Did the Gap Go? Reassessing the Long-Range Graph Benchmark Jan Tönshoff Martin Ritzert Eran Rosenbluth Martin Grohe 313 72 0 01 Sep 2023
Enhancing Graph Transformers with Hierarchical Distance Structural EncodingNeural Information Processing Systems (NeurIPS), 2023 Yuan Luo Hongkang Li Lei Shi Xiao-Ming Wu 303 14 0 22 Aug 2023
CLGT: A Graph Transformer for Student Performance Prediction in Collaborative LearningAAAI Conference on Artificial Intelligence (AAAI), 2023 Tianhao Peng Yu Liang Wenjun Wu Jiankai Ren Zhao Pengrui Yanjun Pu 93 19 0 30 Jul 2023
Anticipating Technical Expertise and Capability Evolution in Research Communities using Dynamic Graph TransformersIEEE Transactions on Computational Social Systems (IEEE TCSS), 2023 Sameera Horawalavithana Ellyn Ayton A. Usenko Robin Cosbey Svitlana Volkova AI4TS 172 0 0 18 Jul 2023
Why Deep Models Often cannot Beat Non-deep Counterparts on Molecular Property Prediction? Jun Xia Lecheng Zhang Xiao Zhu Stan Z. Li 215 5 0 30 Jun 2023
Transforming Graphs for Enhanced Attribute Clustering: An Innovative Graph Transformer-Based Method Shuo Han Jiachegn Liu Jiayun Wu Yinan Chen Li Tao 229 1 0 20 Jun 2023
SGFormer: Simplifying and Empowering Transformers for Large-Graph RepresentationsNeural Information Processing Systems (NeurIPS), 2023 Qitian Wu Wen-Long Zhao Chenxiao Yang Hengrui Zhang Fan Nie Haitian Jiang Yatao Bian Junchi Yan AI4CE 350 171 0 19 Jun 2023
Learning Probabilistic Symmetrization for Architecture Agnostic EquivarianceNeural Information Processing Systems (NeurIPS), 2023 Jinwoo Kim Tien Dat Nguyen Ayhan Suleymanzade Hyeokjun An Seunghoon Hong 314 27 0 05 Jun 2023
Learning Subpocket Prototypes for Generalizable Structure-based Drug DesignInternational Conference on Machine Learning (ICML), 2023 Zaixin Zhang Qi Liu 161 43 0 22 May 2023
Tokenized Graph Transformer with Neighborhood Augmentation for Node Classification in Large Graphs Jinsong Chen Yu Xie Kai-Xin Gao Gaichao Li Kun He 157 4 0 22 May 2023
G-Adapter: Towards Structure-Aware Parameter-Efficient Transfer Learning for Graph Transformer NetworksAAAI Conference on Artificial Intelligence (AAAI), 2023 Anchun Gui Jinqiang Ye Han Xiao 124 29 0 17 May 2023
Towards Better Graph Representation Learning with Parameterized Decomposition & FilteringInternational Conference on Machine Learning (ICML), 2023 Mingqi Yang Wenjie Feng Yanming Shen Bryan Hooi 271 5 0 10 May 2023
Mlinear: Rethink the Linear Model for Time-series Forecasting Wei Li Xiangxu Meng Chuhao Chen Jianing Chen AI4TS 216 6 0 08 May 2023
Dynamic Graph Representation Learning with Neural Networks: A SurveyIEEE Access (IEEE Access), 2023 Leshanshui Yang Sébastien Adam Clément Chatelain AI4TS AI4CE 161 30 0 12 Apr 2023
Devil's on the Edges: Selective Quad Attention for Scene Graph GenerationComputer Vision and Pattern Recognition (CVPR), 2023 Deunsol Jung Sanghyun Kim Wonhui Kim Minsu Cho 3DPC GNN 145 37 0 07 Apr 2023
MulGT: Multi-task Graph-Transformer with Task-aware Knowledge Injection and Domain Knowledge-driven Pooling for Whole Slide Image AnalysisAAAI Conference on Artificial Intelligence (AAAI), 2023 Weiqin Zhao Shujun Wang Maximus C. F. Yeung Tianye Niu Lequan Yu 418 12 0 21 Feb 2023
Friend Ranking in Online Games via Pre-training Edge TransformersAnnual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2023 Liang Yao Jiazhen Peng Shenggong Ji Qiang Liu Hongyun Cai Feng He Feng He 134 0 0 20 Feb 2023
Attending to Graph Transformers Luis Muller Mikhail Galkin Christopher Morris Ladislav Rampášek 265 118 0 08 Feb 2023
Transformers Meet Directed GraphsInternational Conference on Machine Learning (ICML), 2023 Simon Geisler Yujia Li D. Mankowitz A. Cemgil Stephan Günnemann Cosmin Paduraru 279 47 0 31 Jan 2023
A Generalization of ViT/MLP-Mixer to GraphsInternational Conference on Machine Learning (ICML), 2022 Xiaoxin He Bryan Hooi T. Laurent Adam Perold Yann LeCun Xavier Bresson 211 118 0 27 Dec 2022
Adaptive Multi-Neighborhood Attention based Transformer for Graph Representation Learning Gaichao Li Jinsong Chen Kun He 132 3 0 15 Nov 2022
Transformers over Directed Acyclic GraphsNeural Information Processing Systems (NeurIPS), 2022 Yu Luo Veronika Thost Lei Shi GNN AI4CE 450 28 0 24 Oct 2022
Not All Neighbors Are Worth Attending to: Graph Selective Attention Networks for Semi-supervised Learning Tiantian He Haicang Zhou Yew-Soon Ong Gao Cong GNN 226 6 0 14 Oct 2022
Pure Transformers are Powerful Graph LearnersNeural Information Processing Systems (NeurIPS), 2022 Jinwoo Kim Tien Dat Nguyen Seonwoo Min Sungjun Cho Moontae Lee Honglak Lee Seunghoon Hong 317 241 0 06 Jul 2022
NAGphormer: A Tokenized Graph Transformer for Node Classification in Large GraphsInternational Conference on Learning Representations (ICLR), 2022 Jinsong Chen Ran Bi Gaichao Li Kun He 256 162 0 10 Jun 2022
BayesFormer: Transformer with Uncertainty Estimation Karthik Abinav Sankararaman Sinong Wang Han Fang UQCV BDL 207 19 0 02 Jun 2022
Trustworthy Graph Neural Networks: Aspects, Methods and TrendsProceedings of the IEEE (Proc. IEEE), 2022 He Zhang Bang Wu Lizhen Qu Shirui Pan Hanghang Tong Jian Pei 292 147 0 16 May 2022
Graph Lifelong Learning: A SurveyIEEE Computational Intelligence Magazine (IEEE CIM), 2022 F. Febrinanto Xiwei Xu Kristen Moore Chandra Thapa Charu C. Aggarwal CLL AI4CE 192 61 0 22 Feb 2022
NeuroBack: Improving CDCL SAT Solving using Graph Neural Networks Wenxi Wang Yang Hu Mohit Tiwari S. Khurshid K. McMillan Risto Miikkulainen GNN NAI 210 13 0 26 Oct 2021