v1v2v3v4v5v6v7v8 (latest)

From block-Toeplitz matrices to differential equations on graphs: towards a general theory for scalable masked Transformers

16 July 2021

Haoxian Chen

Valerii Likhosherstov

Papers citing "From block-Toeplitz matrices to differential equations on graphs: towards a general theory for scalable masked Transformers"

27 / 27 papers shown

Title
Graph Fourier Transformer with Structure-Frequency Information Yonghui Zhai Yang Zhang Minghao Shang Lihua Pang Yaxin Ren 137 0 0 28 Apr 2025
A Survey of Graph Transformers: Architectures, Theories and Applications Chaohao Yuan Kangfei Zhao Ercan Engin Kuruoglu Liang Wang Tingyang Xu Wenbing Huang Deli Zhao Hong Cheng Yu Rong 212 4 0 23 Feb 2025
Lightweight yet Efficient: An External Attentive Graph Convolutional Network with Positional Prompts for Sequential Recommendation Jinyu Zhang Chao Li Zhongying Zhao 145 1 0 21 Feb 2025
Learning the RoPEs: Better 2D and 3D Position Encodings with STRING Connor Schenck Isaac Reid M. Jacob Alex Bewley Joshua Ainslie ... Matthias Minderer Dmitry Kalashnikov Jonathan Tompson Vikas Sindhwani Krzysztof Choromanski 100 1 0 04 Feb 2025
GrokFormer: Graph Fourier Kolmogorov-Arnold Transformers Guoguo Ai Guansong Pang Hezhe Qiao Yuan Gao Hui Yan 193 1 0 26 Nov 2024
Graph Transformers Dream of Electric Flow Xiang Cheng Lawrence Carin S. Sra 101 0 0 22 Oct 2024
Linear Transformer Topological Masking with Graph Random Features Isaac Reid Kumar Avinava Dubey Deepali Jain Will Whitney Amr Ahmed ... Connor Schenck Richard E. Turner René Wagner Adrian Weller Krzysztof Choromanski 87 1 0 04 Oct 2024
Instruction-Based Molecular Graph Generation with Unified Text-Graph Diffusion Model Yuran Xiang Haiteng Zhao Chang Ma Zhi-Hong Deng 76 1 0 19 Aug 2024
Graph Transformers: A Survey Ahsan Shehzad Xiwei Xu Shagufta Abid Ciyuan Peng Shuo Yu Dongyu Zhang Karin Verspoor AI4CE 137 14 0 13 Jul 2024
Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers Xiuying Wei Skander Moalla Razvan Pascanu Çağlar Gülçehre 81 2 0 24 Jun 2024
Fast Tree-Field Integrators: From Low Displacement Rank to Topological Transformers Krzysztof Choromanski Arijit Sehanobish Somnath Basu Roy Chowdhury Han Lin Avinava Dubey Tamás Sarlós Snigdha Chaturvedi AI4CE 93 0 0 22 Jun 2024
Continuous Predictive Modeling of Clinical Notes and ICD Codes in Patient Health Records Mireia Hernandez Caralt Clarence Boon Liang Ng Marek Rei 65 1 0 19 May 2024
Gradformer: Graph Transformer with Exponential Decay Chuang Liu Zelin Yao Yibing Zhan Xueqi Ma Shirui Pan Wenbin Hu 95 4 0 24 Apr 2024
Graph Expansion in Pruned Recurrent Neural Network Layers Preserve Performance Suryam Arnav Kalra Arindam Biswas Pabitra Mitra Biswajit Basu GNN 72 0 0 17 Mar 2024
Polynormer: Polynomial-Expressive Graph Transformer in Linear Time Chenhui Deng Zichao Yue Zhiru Zhang 147 31 0 02 Mar 2024
Comparing Graph Transformers via Positional Encodings Mitchell Black Qingsong Wang Zhengchao Wan A. Nayyeri Yusu Wang 99 13 0 22 Feb 2024
Subgraphormer: Unifying Subgraph GNNs and Graph Transformers via Graph Products Guy Bar-Shalom Beatrice Bevilacqua Haggai Maron AI4CE 90 6 0 13 Feb 2024
Tensor-view Topological Graph Neural Network Tao Wen Elynn Chen Yuzhou Chen 127 10 0 22 Jan 2024
GIMLET: A Unified Graph-Text Model for Instruction-Based Molecule Zero-Shot Learning Haiteng Zhao Shengchao Liu Chang Ma Hannan Xu Jie Fu Zhihong Deng Lingpeng Kong Qi Liu 94 65 0 28 May 2023
Taming graph kernels with random features K. Choromanski 66 14 0 29 Apr 2023
Are More Layers Beneficial to Graph Transformers? Haiteng Zhao Shuming Ma Dongdong Zhang Zhi-Hong Deng Furu Wei 67 14 0 01 Mar 2023
Attending to Graph Transformers Luis Muller Mikhail Galkin Christopher Morris Ladislav Rampášek 104 93 0 08 Feb 2023
Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers K. Choromanski Shanda Li Valerii Likhosherstov Kumar Avinava Dubey Shengjie Luo Di He Yiming Yang Tamás Sarlós Thomas Weingarten Adrian Weller 108 8 0 03 Feb 2023
Mnemosyne: Learning to Train Transformers with Transformers Deepali Jain K. Choromanski Kumar Avinava Dubey Sumeet Singh Vikas Sindhwani Tingnan Zhang Jie Tan OffRL 138 9 0 02 Feb 2023
Efficient Graph Field Integrators Meet Point Clouds K. Choromanski Arijit Sehanobish Han Lin Yunfan Zhao Eli Berger ... Kumar Avinava Dubey Deepali Jain Tamás Sarlós Snigdha Chaturvedi Adrian Weller 82 5 0 02 Feb 2023
Karyotype AI for Precision Oncology Z. Shamsi D. Bryant Jacob M Wilson X. Qu Kumar Avinava Dubey ... F. Appelbaum K. Choromanski A. Bashir M. Fang Min Fang 90 0 0 20 Nov 2022
Recipe for a General, Powerful, Scalable Graph Transformer Ladislav Rampášek Mikhail Galkin Vijay Prakash Dwivedi Anh Tuan Luu Guy Wolf Dominique Beaini 177 582 0 25 May 2022