Mamba-360: Survey of State Space Models as Transformer Alternative for Long Sequence Modelling: Methods, Applications, and Challenges

24 April 2024

Papers citing "Mamba-360: Survey of State Space Models as Transformer Alternative for Long Sequence Modelling: Methods, Applications, and Challenges"

50 / 54 papers shown

Title
Vision Mamba in Remote Sensing: A Comprehensive Survey of Techniques, Applications and Outlook Muyi Bao Shuchang Lyu Zhaoyang Xu Huiyu Zhou Jinchang Ren Shiming Xiang X. Li Guangliang Cheng Mamba 72 0 0 01 May 2025
From S4 to Mamba: A Comprehensive Survey on Structured State Space Models Shriyank Somvanshi Md Monzurul Islam Mahmuda Sultana Mimi Sazzad Bin Bashar Polock Gaurab Chhetri Subasish Das Mamba AI4TS 40 0 0 22 Mar 2025
Accelerating Model-Based Reinforcement Learning with State-Space World Models Maria Krinner Elie Aljalbout Angel Romero Davide Scaramuzza OffRL 57 1 0 27 Feb 2025
A Survey on Mamba Architecture for Vision Applications Fady Ibrahim Guangjun Liu Guanghui Wang Mamba 45 2 0 11 Feb 2025
A Deep State Space Model for Rainfall-Runoff Simulations Yihan Wang Lujun Zhang Annan Yu N. Benjamin Erichson Tiantian Yang 45 0 0 28 Jan 2025
A Comparative Study on Dynamic Graph Embedding based on Mamba and Transformers Ashish Parmanand Pandey Alan John Varghese Sarang Patil Mengjia Xu Mamba 86 0 0 15 Dec 2024
XYScanNet: A State Space Model for Single Image Deblurring Hanzhou Liu Chengkai Liu Jiacong Xu Peng Jiang Mi Lu Mamba 78 0 0 13 Dec 2024
xLSTM-Mixer: Multivariate Time Series Forecasting by Mixing via Scalar Memories Maurice Kraus Felix Divo D. Dhami Kristian Kersting AI4TS 20 2 0 22 Oct 2024
Demystifying the Token Dynamics of Deep Selective State Space Models Thieu N. Vo Tung D. Pham Xin T. Tong Tan Minh Nguyen Mamba 44 0 0 04 Oct 2024
Were RNNs All We Needed? Leo Feng Frederick Tung Mohamed Osama Ahmed Yoshua Bengio Hossein Hajimirsadegh AI4TS 20 14 1 02 Oct 2024
A Diagonal Structured State Space Model on Loihi 2 for Efficient Streaming Sequence Processing Svea Marie Meyer Philipp Weidel Philipp Plank L. Campos-Macias Sumit Bam Shrestha Philipp Stratmann M. R 31 2 0 23 Sep 2024
Integration of Mamba and Transformer -- MAT for Long-Short Range Time Series Forecasting with Application to Weather Dynamics Wenqing Zhang Junming Huang Ruotong Wang Changsong Wei Wenqian Huang Yuxin Qiao Mamba 13 0 0 13 Sep 2024
MambaDS: Near-Surface Meteorological Field Downscaling with Topography Constrained Selective State Space Modeling Zili Liu Hao Chen Lei Bai Wenyuan Li Wanli Ouyang Zhengxia Zou Zhenwei Shi Mamba 29 5 0 20 Aug 2024
Fading memory and the convolution theorem Juan-Pablo Ortega Florian Rossmannek 29 0 0 14 Aug 2024
RotRNN: Modelling Long Sequences with Rotations Rares Dolga Kai Biegun Jake Cunningham David Barber 32 2 0 09 Jul 2024
Venturing into Uncharted Waters: The Navigation Compass from Transformer to Mamba Yuchen Zou Yineng Chen Zuchao Li Lefei Zhang Hai Zhao 42 1 0 24 Jun 2024
MVGamba: Unify 3D Content Generation as State Space Sequence Modeling Xuanyu Yi Zike Wu Qiuhong Shen Qingshan Xu Pan Zhou Joo-Hwee Lim Shuicheng Yan Xinchao Wang Hanwang Zhang 54 12 0 10 Jun 2024
Convolution and Attention-Free Mamba-based Cardiac Image Segmentation Abbas Khan Muhammad Asad Martin Benning C. Roney Gregory Slabaugh Mamba 22 2 0 09 Jun 2024
Chimera: Effectively Modeling Multivariate Time Series with 2-Dimensional State Space Models Ali Behrouz Michele Santacatterina Ramin Zabih Mamba AI4TS 37 3 0 06 Jun 2024
Rethinking Scanning Strategies with Vision Mamba in Semantic Segmentation of Remote Sensing Imagery: An Experimental Study Qinfeng Zhu Yuan-Sheng Fang Yuanzhi Cai Cheng Chen Lei Fan Mamba 19 16 0 14 May 2024
Vision Mamba: A Comprehensive Survey and Taxonomy Xiao Liu Chenxu Zhang Lei Zhang Mamba 36 23 0 07 May 2024
Retinexmamba: Retinex-based Mamba for Low-light Image Enhancement Jiesong Bai Yuhao Yin Qiyuan He Yuanxian Li Xiaofeng Zhang Mamba 25 4 0 06 May 2024
Matten: Video Generation with Mamba-Attention Yu Gao Jiancheng Huang Xiaopeng Sun Zequn Jie Yujie Zhong Lin Ma 61 11 0 05 May 2024
SpikeMba: Multi-Modal Spiking Saliency Mamba for Temporal Video Grounding Wenrui Li Xiaopeng Hong Ruiqin Xiong Xiaopeng Fan Mamba 47 17 0 01 Apr 2024
Decision Mamba: Reinforcement Learning via Sequence Modeling with Selective State Spaces Toshihiro Ota Mamba 31 16 0 29 Mar 2024
MambaMixer: Efficient Selective State Space Models with Dual Token and Channel Selection Ali Behrouz Michele Santacatterina Ramin Zabih 37 32 0 29 Mar 2024
Heracles: A Hybrid SSM-Transformer Model for High-Resolution Image and Time-Series Analysis Badri N. Patro Suhas Ranganath Vinay P. Namboodiri Vijay Srinivas Agneeswaran 43 2 0 26 Mar 2024
ReMamber: Referring Image Segmentation with Mamba Twister Yu-Hao Yang Chaofan Ma Jiangchao Yao Zhun Zhong Ya-Qin Zhang Yanfeng Wang Mamba 58 20 0 26 Mar 2024
SiMBA: Simplified Mamba-Based Architecture for Vision and Multivariate Time series Badri N. Patro Vijay Srinivas Agneeswaran Mamba 49 50 0 22 Mar 2024
TimeMachine: A Time Series is Worth 4 Mambas for Long-term Forecasting Md. Atik Ahamed Qiang Cheng Mamba AI4TS 53 47 0 14 Mar 2024
MAMBA: an Effective World Model Approach for Meta-Reinforcement Learning Zohar Rimon Tom Jurgenson Orr Krupnik Gilad Adler Aviv Tamar 16 8 0 14 Mar 2024
Multichannel Long-Term Streaming Neural Speech Enhancement for Static and Moving Speakers Changsheng Quan Xiaofei Li 36 23 0 12 Mar 2024
LKM-UNet: Large Kernel Vision Mamba UNet for Medical Image Segmentation Jinhong Wang Jintai Chen D. Z. Chen Jian Wu Mamba 37 20 0 12 Mar 2024
Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models Soham De Samuel L. Smith Anushan Fernando Aleksandar Botev George-Christian Muraru ... David Budden Yee Whye Teh Razvan Pascanu Nando de Freitas Çağlar Gülçehre Mamba 51 116 0 29 Feb 2024
MambaIR: A Simple Baseline for Image Restoration with State-Space Model Hang Guo Jinmin Li Tao Dai Zhihao Ouyang Xudong Ren Shu-Tao Xia Mamba 50 196 0 23 Feb 2024
Graph Mamba: Towards Learning on Graphs with State Space Models Ali Behrouz Farnoosh Hashemi AI4CE 86 57 0 13 Feb 2024
Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data Shufan Li Harkanwar Singh Aditya Grover Mamba 69 56 0 08 Feb 2024
VM-UNet: Vision Mamba UNet for Medical Image Segmentation Jiacheng Ruan Suncheng Xiang Mamba 67 241 0 04 Feb 2024
Repeat After Me: Transformers are Better than State Space Models at Copying Samy Jelassi David Brandfonbrener Sham Kakade Eran Malach 92 77 0 01 Feb 2024
U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentation Jun Ma Feifei Li Bo Wang Mamba 74 314 0 09 Jan 2024
LLaVA-Phi: Efficient Multi-Modal Assistant with Small Language Model Yichen Zhu Minjie Zhu Ning Liu Zhicai Ou Xiaofeng Mou Jian Tang 63 89 0 04 Jan 2024
mPLUG-Owl: Modularization Empowers Large Language Models with Multimodality Qinghao Ye Haiyang Xu Guohai Xu Jiabo Ye Ming Yan ... Junfeng Tian Qiang Qi Ji Zhang Feiyan Huang Jingren Zhou VLM MLLM 203 883 0 27 Apr 2023
Resurrecting Recurrent Neural Networks for Long Sequences Antonio Orvieto Samuel L. Smith Albert Gu Anushan Fernando Çağlar Gülçehre Razvan Pascanu Soham De 83 258 0 11 Mar 2023
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models Junnan Li Dongxu Li Silvio Savarese Steven C. H. Hoi VLM MLLM 244 4,186 0 30 Jan 2023
Liquid Structural State-Space Models Ramin Hasani Mathias Lechner Tsun-Hsuan Wang Makram Chahine Alexander Amini Daniela Rus AI4TS 92 93 0 26 Sep 2022
Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering Pan Lu Swaroop Mishra Tony Xia Liang Qiu Kai-Wei Chang Song-Chun Zhu Oyvind Tafjord Peter Clark A. Kalyan ELM ReLM LRM 198 1,089 0 20 Sep 2022
Wave-ViT: Unifying Wavelet and Transformers for Visual Representation Learning Ting Yao Yingwei Pan Yehao Li Chong-Wah Ngo Tao Mei ViT 129 135 0 11 Jul 2022
Transformer Quality in Linear Time Weizhe Hua Zihang Dai Hanxiao Liu Quoc V. Le 71 220 0 21 Feb 2022
UniFormer: Unifying Convolution and Self-attention for Visual Recognition Kunchang Li Yali Wang Junhao Zhang Peng Gao Guanglu Song Yu Liu Hongsheng Li Yu Qiao ViT 142 360 0 24 Jan 2022
H-Transformer-1D: Fast One-Dimensional Hierarchical Attention for Sequences Zhenhai Zhu Radu Soricut 95 41 0 25 Jul 2021