Sumformer: Universal Approximation for Efficient Transformers

5 July 2023

Papers citing "Sumformer: Universal Approximation for Efficient Transformers"

3 / 3 papers shown

Title
On the Theoretical Expressive Power and the Design Space of Higher-Order Graph Transformers Cai Zhou Rose Yu Yusu Wang 32 7 0 04 Apr 2024
DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Training Zhongkai Hao Chang Su Songming Liu Julius Berner Chengyang Ying Hang Su A. Anandkumar Jian Song Jun Zhu AI4TS AI4CE 22 21 0 06 Mar 2024
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 249 2,009 0 28 Jul 2020