Efficiently Modeling Long Sequences with Structured State Spaces

31 October 2021

Papers citing "Efficiently Modeling Long Sequences with Structured State Spaces"

25 / 1,125 papers shown

Title
ChordMixer: A Scalable Neural Attention Model for Sequences with Different Lengths Ruslan Khalitov Tong Yu Lei Cheng Zhirong Yang 25 12 0 12 Jun 2022
Towards a General Purpose CNN for Long Range Dependencies in $N$ D David W. Romero David M. Knigge Albert Gu Erik J. Bekkers E. Gavves Jakub M. Tomczak Mark Hoogendoorn 16 19 0 07 Jun 2022
Improving the Diagnosis of Psychiatric Disorders with Self-Supervised Graph State Space Models A. E. Gazzar R. Thomas G. Wingen AI4MH 11 6 0 07 Jun 2022
Entangled Residual Mappings Mathias Lechner Ramin Hasani Z. Babaiee Radu Grosu Daniela Rus T. Henzinger Sepp Hochreiter 6 4 0 02 Jun 2022
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness Tri Dao Daniel Y. Fu Stefano Ermon Atri Rudra Christopher Ré VLM 58 2,020 0 27 May 2022
Recognition Models to Learn Dynamics from Partial Observations with Neural ODEs Mona Buisson-Fenet V. Morgenthaler Sebastian Trimpe F. D. Meglio 40 6 0 25 May 2022
Recipe for a General, Powerful, Scalable Graph Transformer Ladislav Rampášek Mikhail Galkin Vijay Prakash Dwivedi A. Luu Guy Wolf Dominique Beaini 54 511 0 25 May 2022
Realization Theory Of Recurrent Neural ODEs Using Polynomial System Embeddings Martin Gonzalez Thibault Defourneau H. Hajri M. Petreczky 31 2 0 24 May 2022
FiLM: Frequency improved Legendre Memory Model for Long-term Time Series Forecasting Tian Zhou Ziqing Ma Xue Wang Qingsong Wen Liang Sun Tao Yao Wotao Yin Rong Jin AI4TS 121 167 0 18 May 2022
Long Movie Clip Classification with State-Space Video Models Md. Mohaiminul Islam Gedas Bertasius VLM 38 101 0 04 Apr 2022
Path Development Network with Finite-dimensional Lie Group Representation Han Lou Siran Li Hao Ni 11 7 0 02 Apr 2022
Diagonal State Spaces are as Effective as Structured State Spaces Ankit Gupta Albert Gu Jonathan Berant 37 290 0 27 Mar 2022
Continuous-Time Audiovisual Fusion with Recurrence vs. Attention for In-The-Wild Affect Recognition Vincent Karas M. Tellamekala Adria Mallol-Ragolta M. Valstar Björn W. Schuller 17 13 0 24 Mar 2022
projUNN: efficient method for training deep networks with unitary matrices B. Kiani Randall Balestriero Yann LeCun S. Lloyd 36 32 0 10 Mar 2022
It's Raw! Audio Generation with State-Space Models Karan Goel Albert Gu Chris Donahue Christopher Ré 14 185 0 20 Feb 2022
General-purpose, long-context autoregressive modeling with Perceiver AR Curtis Hawthorne Andrew Jaegle Cătălina Cangea Sebastian Borgeaud C. Nash ... Hannah R. Sheahan Neil Zeghidour Jean-Baptiste Alayrac João Carreira Jesse Engel 35 65 0 15 Feb 2022
Transferable Time-Series Forecasting under Causal Conditional Shift Zijian Li Ruichu Cai T. Fu Zhifeng Hao Kun Zhang TTA OOD AI4TS 20 23 0 05 Nov 2021
FlexConv: Continuous Kernel Convolutions with Differentiable Kernel Sizes David W. Romero Robert-Jan Bruintjes Jakub M. Tomczak Erik J. Bekkers Mark Hoogendoorn J. C. V. Gemert 80 81 0 15 Oct 2021
Networked Time Series Prediction with Incomplete Data via Generative Adversarial Network Yichen Zhu Bo Jiang Haiming Jin Mengtian Zhang Feng Gao Jianqiang Huang Tao Lin Xinbing Wang GNN AI4TS 40 5 0 05 Oct 2021
Closed-form Continuous-time Neural Models Ramin Hasani Mathias Lechner Alexander Amini Lucas Liebenwein Aaron Ray Max Tschaikowski G. Teschl Daniela Rus PINN AI4TS 23 82 0 25 Jun 2021
RNNs of RNNs: Recursive Construction of Stable Assemblies of Recurrent Neural Networks L. Kozachkov Michaela Ennis Jean-Jacques E. Slotine 14 18 0 16 Jun 2021
MLP-Mixer: An all-MLP Architecture for Vision Ilya O. Tolstikhin N. Houlsby Alexander Kolesnikov Lucas Beyer Xiaohua Zhai ... Andreas Steiner Daniel Keysers Jakob Uszkoreit Mario Lucic Alexey Dosovitskiy 265 2,603 0 04 May 2021
Creativity and Machine Learning: A Survey Giorgio Franceschelli Mirco Musolesi VLM AI4CE 29 40 0 06 Apr 2021
Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting Haoyi Zhou Shanghang Zhang J. Peng Shuai Zhang Jianxin Li Hui Xiong Wan Zhang AI4TS 169 3,876 0 14 Dec 2020
Efficient Transformers: A Survey Yi Tay Mostafa Dehghani Dara Bahri Donald Metzler VLM 74 1,101 0 14 Sep 2020