Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layers

26 October 2021

Papers citing "Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layers"

40 / 90 papers shown

Title
MambaVision: A Hybrid Mamba-Transformer Vision Backbone Ali Hatamizadeh Jan Kautz Mamba 40 56 0 10 Jul 2024
xLSTM-UNet can be an Effective 2D & 3D Medical Image Segmentation Backbone with Vision-LSTM (ViL) better than its Mamba Counterpart Tianrun Chen Chaotao Ding Lanyun Zhu Tao Xu Deyi Ji Yan Wang Ying-Dong Zang Z. Li MedIm Mamba 52 13 0 01 Jul 2024
SE(3)-Hyena Operator for Scalable Equivariant Learning Artem Moskalev Mangal Prakash Rui Liao Tommaso Mansi 46 2 0 01 Jul 2024
DeciMamba: Exploring the Length Extrapolation Potential of Mamba Assaf Ben-Kish Itamar Zimerman Shady Abu Hussein Nadav Cohen Amir Globerson Lior Wolf Raja Giryes Mamba 67 13 0 20 Jun 2024
MambaLRP: Explaining Selective State Space Sequence Models F. Jafari G. Montavon Klaus-Robert Müller Oliver Eberle Mamba 56 9 0 11 Jun 2024
Decision Mamba: A Multi-Grained State Space Model with Self-Evolution Regularization for Offline RL Qi Lv Xiang Deng Gongwei Chen Michael Yu Wang Liqiang Nie 75 7 0 08 Jun 2024
TSCMamba: Mamba Meets Multi-View Learning for Time Series Classification Md. Atik Ahamed Qiang Cheng Mamba 63 1 0 06 Jun 2024
GrootVL: Tree Topology is All You Need in State Space Model Yicheng Xiao Lin Song Shaoli Huang Jiangshan Wang Siyu Song Yixiao Ge Xiu Li Ying Shan Mamba 38 10 0 04 Jun 2024
LCM: Locally Constrained Compact Point Cloud Model for Masked Point Modeling Yaohua Zha Naiqi Li Yanzi Wang Tao Dai Hang Guo Bin Chen Zhi Wang Zhihao Ouyang Shu-Tao Xia Mamba 42 8 0 27 May 2024
MambaLLIE: Implicit Retinex-Aware Low Light Enhancement with Global-then-Local State Space Jiangwei Weng Zhiqiang Yan Ying Tai J. Qian Jian Yang Jun Li Mamba 29 10 0 25 May 2024
Mamba-in-Mamba: Centralized Mamba-Cross-Scan in Tokenized Mamba Model for Hyperspectral Image Classification Weilian Zhou Sei-ichiro Kamata Haipeng Wang Man-Sing Wong Huiying H. Hou Mamba 27 30 0 20 May 2024
SSAMBA: Self-Supervised Audio Representation Learning with Mamba State Space Model Siavash Shams Sukru Samet Dindar Xilin Jiang N. Mesgarani Mamba 64 18 0 20 May 2024
WaterMamba: Visual State Space Model for Underwater Image Enhancement Meisheng Guan Haiyong Xu G. Jiang Mei Yu Yeyao Chen Ting Luo Yang Song Mamba 37 2 0 14 May 2024
Sparse Reconstruction of Optical Doppler Tomography with Alternative State Space Model and Attention Zhenghong Li Jiaxiang Ren Wensheng Cheng C. Du Yingtian Pan Haibin Ling 50 0 0 26 Apr 2024
FusionMamba: Dynamic Feature Enhancement for Multimodal Image Fusion with Mamba Xinyu Xie Yawen Cui Chio-in Ieong Tao Tan Xiaozhi Zhang Mamba 42 39 0 15 Apr 2024
The Illusion of State in State-Space Models William Merrill Jackson Petty Ashish Sabharwal 46 43 0 12 Apr 2024
MambaAD: Exploring State Space Models for Multi-class Unsupervised Anomaly Detection Haoyang He Yuhu Bai Jiangning Zhang Qingdong He Hongxu Chen Zhenye Gan Chengjie Wang Xiangtai Li Guanzhong Tian Lei Xie Mamba 60 33 0 09 Apr 2024
Learning Enriched Features via Selective State Spaces Model for Efficient Image Deblurring Huiyu Gao Depeng Dang 34 13 0 29 Mar 2024
Serpent: Scalable and Efficient Image Restoration via Multi-scale Structured State Space Models Mohammad Shahab Sepehri Zalan Fabian Mahdi Soltanolkotabi 36 5 0 26 Mar 2024
Backpropagation through space, time, and the brain B. Ellenberger Paul Haider Jakob Jordan Kevin Max Ismael Jaras Laura Kriener Federico Benitez Mihai A. Petrovici 128 8 0 25 Mar 2024
MambaTalk: Efficient Holistic Gesture Synthesis with Selective State Space Models Zunnan Xu Yukang Lin Haonan Han Sicheng Yang Ronghui Li Yachao Zhang Xiu Li Mamba 46 25 0 14 Mar 2024
Vision-RWKV: Efficient and Scalable Visual Perception with RWKV-Like Architectures Yuchen Duan Weiyun Wang Zhe Chen Xizhou Zhu Lewei Lu Tong Lu Yu Qiao Hongsheng Li Jifeng Dai Wenhai Wang ViT 43 44 0 04 Mar 2024
Orchid: Flexible and Data-Dependent Convolution for Sequence Modeling Mahdi Karami Ali Ghodsi VLM 40 6 0 28 Feb 2024
Cross-LKTCN: Modern Convolution Utilizing Cross-Variable Dependency for Multivariate Time Series Forecasting Dependency for Multivariate Time Series Forecasting Donghao Luo Xue Wang BDL AI4TS 11 2 0 04 Jun 2023
Focus Your Attention (with Adaptive IIR Filters) Shahar Lutati Itamar Zimerman Lior Wolf 32 9 0 24 May 2023
Neural Machine Translation for Code Generation K. Dharma Clayton T. Morrison 32 4 0 22 May 2023
Unsupervised Feature Based Algorithms for Time Series Extrinsic Regression David Guijo Rubio Matthew Middlehurst Guilherme G. Arcencio Diego Furtado Silva A. Bagnall AI4TS 30 9 0 02 May 2023
Transcription free filler word detection with Neural semi-CRFs Ge Zhu Yujia Yan Juan-Pablo Caceres Z. Duan 19 3 0 11 Mar 2023
Hungry Hungry Hippos: Towards Language Modeling with State Space Models Daniel Y. Fu Tri Dao Khaled Kamal Saab A. Thomas Atri Rudra Christopher Ré 65 368 0 28 Dec 2022
Advancing the State-of-the-Art for ECG Analysis through Structured State Space Models Temesgen Mehari Nils Strodthoff 21 11 0 14 Nov 2022
Structured State Space Decoder for Speech Recognition and Synthesis Koichi Miyazaki Masato Murata Tomoki Koriyama 30 12 0 31 Oct 2022
S4ND: Modeling Images and Videos as Multidimensional Signals Using State Spaces Eric N. D. Nguyen Karan Goel Albert Gu Gordon W. Downs Preey Shah Tri Dao S. Baccus Christopher Ré VLM 22 38 0 12 Oct 2022
An Exploration of Hierarchical Attention Transformers for Efficient Long Document Classification Ilias Chalkidis Xiang Dai Manos Fergadiotis Prodromos Malakasiotis Desmond Elliott 32 33 0 11 Oct 2022
Liquid Structural State-Space Models Ramin Hasani Mathias Lechner Tsun-Hsuan Wang Makram Chahine Alexander Amini Daniela Rus AI4TS 99 95 0 26 Sep 2022
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness Tri Dao Daniel Y. Fu Stefano Ermon Atri Rudra Christopher Ré VLM 58 2,020 0 27 May 2022
Realization Theory Of Recurrent Neural ODEs Using Polynomial System Embeddings Martin Gonzalez Thibault Defourneau H. Hajri M. Petreczky 31 2 0 24 May 2022
Long Movie Clip Classification with State-Space Video Models Md. Mohaiminul Islam Gedas Bertasius VLM 38 101 0 04 Apr 2022
Diagonal State Spaces are as Effective as Structured State Spaces Ankit Gupta Albert Gu Jonathan Berant 37 290 0 27 Mar 2022
FlexConv: Continuous Kernel Convolutions with Differentiable Kernel Sizes David W. Romero Robert-Jan Bruintjes Jakub M. Tomczak Erik J. Bekkers Mark Hoogendoorn J. C. V. Gemert 80 81 0 15 Oct 2021
Recurrent Neural Networks for Multivariate Time Series with Missing Values Zhengping Che S. Purushotham Kyunghyun Cho David Sontag Yan Liu AI4TS 207 1,895 0 06 Jun 2016