Diagonal State Spaces are as Effective as Structured State Spaces

27 March 2022

Papers citing "Diagonal State Spaces are as Effective as Structured State Spaces"

50 / 226 papers shown

Title
Drama: Mamba-Enabled Model-Based Reinforcement Learning Is Sample and Parameter Efficient Wenlong Wang Ivana Dusparic Yucheng Shi Ke Zhang V. Cahill Mamba 43 0 0 11 Oct 2024
Parameter-Efficient Fine-Tuning of State Space Models Kevin Galim Wonjun Kang Yuchen Zeng H. Koo Kangwook Lee 29 4 0 11 Oct 2024
QuadMamba: Learning Quadtree-based Selective Scan for Visual State Space Model Fei Xie Weijia Zhang Zhongdao Wang Chao Ma Mamba 21 3 0 09 Oct 2024
EMMA: Empowering Multi-modal Mamba with Structural and Hierarchical Alignment Yifei Xing Xiangyuan Lan Ruiping Wang D. Jiang Wenjun Huang Qingfang Zheng Yaowei Wang Mamba 33 0 0 08 Oct 2024
SPikE-SSM: A Sparse, Precise, and Efficient Spiking State Space Model for Long Sequences Learning Yan Zhong Ruoyu Zhao Chao Wang Qinghai Guo Jianguo Zhang Zhichao Lu Luziwei Leng 28 2 0 07 Oct 2024
On Efficient Variants of Segment Anything Model: A Survey Xiaorui Sun J. Liu H. Shen Xiaofeng Zhu Ping Hu VLM 40 4 0 07 Oct 2024
Efficient and Robust Long-Form Speech Recognition with Hybrid H3-Conformer Tomoki Honda S. Sakai Tatsuya Kawahara 11 0 0 05 Oct 2024
Can Mamba Always Enjoy the "Free Lunch"? Ruifeng Ren Zhicong Li Yong Liu 36 1 0 04 Oct 2024
Demystifying the Token Dynamics of Deep Selective State Space Models Thieu N. Vo Tung D. Pham Xin T. Tong Tan Minh Nguyen Mamba 44 0 0 04 Oct 2024
Tuning Frequency Bias of State Space Models Annan Yu Dongwei Lyu S. H. Lim Michael W. Mahoney N. Benjamin Erichson 28 1 0 02 Oct 2024
FutureFill: Fast Generation from Convolutional Sequence Models Naman Agarwal Xinyi Chen Evan Dogariu Vlad Feinberg Daniel Suo Peter L. Bartlett Elad Hazan AI4TS MQ 25 2 0 02 Oct 2024
Were RNNs All We Needed? Leo Feng Frederick Tung Mohamed Osama Ahmed Yoshua Bengio Hossein Hajimirsadegh AI4TS 18 14 1 02 Oct 2024
Cottention: Linear Transformers With Cosine Attention Gabriel Mongaras Trevor Dohm Eric C. Larson 19 0 0 27 Sep 2024
Speech-Mamba: Long-Context Speech Recognition with Selective State Spaces Models Xiaoxue Gao Nancy F. Chen Mamba 17 1 0 27 Sep 2024
A Diagonal Structured State Space Model on Loihi 2 for Efficient Streaming Sequence Processing Svea Marie Meyer Philipp Weidel Philipp Plank L. Campos-Macias Sumit Bam Shrestha Philipp Stratmann M. R 31 2 0 23 Sep 2024
DocMamba: Efficient Document Pre-training with State Space Model Pengfei Hu Zhenrong Zhang Jiefeng Ma Shuhang Liu Jun Du Jianshu Zhang Mamba 23 1 0 18 Sep 2024
SkinMamba: A Precision Skin Lesion Segmentation Architecture with Cross-Scale Global State Modeling and Frequency Boundary Guidance Shun Zou Mingya Zhang Bingjian Fan Zhengyi Zhou Xiuguo Zou Mamba 19 3 0 17 Sep 2024
Famba-V: Fast Vision Mamba with Cross-Layer Token Fusion Hui Shen Zhongwei Wan Xin Wang Mi Zhang Mamba 29 6 0 15 Sep 2024
Self-supervised Learning for Acoustic Few-Shot Classification Jingyong Liang Bernd Meyer Issac Ning Lee Thanh-Toan Do SSL 33 0 0 15 Sep 2024
Learning Brain Tumor Representation in 3D High-Resolution MR Images via Interpretable State Space Models Qingqiao Hu Daoan Zhang Jiebo Luo Zhenyu Gong Benedikt Wiestler Jianguo Zhang Hongwei Bran Li 18 0 0 12 Sep 2024
Towards Efficient Modelling of String Dynamics: A Comparison of State Space and Koopman based Deep Learning Methods Rodrigo Diaz Carlos De La Vega Martin Mark Sandler 25 1 0 29 Aug 2024
SpikingSSMs: Learning Long Sequences with Sparse and Parallel Spiking State Space Models Shuaijie Shen Chao Wang Renzhuo Huang Yan Zhong Qinghai Guo Zhichao Lu Jianguo Zhang Luziwei Leng 19 7 0 27 Aug 2024
MambaOcc: Visual State Space Model for BEV-based Occupancy Prediction with Local Adaptive Reordering Yonglin Tian Songlin Bai Zhiyao Luo Yutong Wang Yisheng Lv Fei-Yue Wang Mamba 21 2 0 21 Aug 2024
Advancing Spatio-Temporal Processing in Spiking Neural Networks through Adaptation Maximilian Baronig Romain Ferrand Silvester Sabathiel R. Legenstein 34 4 0 14 Aug 2024
DyG-Mamba: Continuous State Space Modeling on Dynamic Graphs Dongyuan Li Shiyin Tan Ying Zhang Ming Jin Shirui Pan Manabu Okumura Renhe Jiang Mamba 16 2 0 13 Aug 2024
Pose Magic: Efficient and Temporally Consistent Human Pose Estimation with a Hybrid Mamba-GCN Network Xinyi Zhang Qiqi Bao Qinpeng Cui Wenming Yang Qingmin Liao 3DH Mamba 26 1 0 06 Aug 2024
LaMamba-Diff: Linear-Time High-Fidelity Diffusion Models Based on Local Attention and Mamba Yunxiang Fu Chaoqi Chen Yizhou Yu Mamba 53 3 0 05 Aug 2024
Long Range Switching Time Series Prediction via State Space Model Jiaming Zhang Yang Ding Yunfeng Gao 24 0 0 27 Jul 2024
Longhorn: State Space Models are Amortized Online Learners Bo Liu Rui Wang Lemeng Wu Yihao Feng Peter Stone Qian Liu 46 10 0 19 Jul 2024
VideoMamba: Spatio-Temporal Selective State Space Model Jinyoung Park Hee-Seon Kim Kangwook Ko Minbeom Kim Changick Kim Mamba 26 4 0 11 Jul 2024
Parallelizing Autoregressive Generation with Variational State Space Models Gaspard Lambrechts Yann Claes Pierre Geurts Damien Ernst 14 0 0 11 Jul 2024
Towards a theory of learning dynamics in deep state space models Jakub Smékal Jimmy T.H. Smith Michael Kleinman D. Biderman Scott W. Linderman 23 1 0 10 Jul 2024
RotRNN: Modelling Long Sequences with Rotations Rares Dolga Kai Biegun Jake Cunningham David Barber 32 2 0 09 Jul 2024
On the Power of Convolution Augmented Transformer Mingchen Li Xuechen Zhang Yixiao Huang Samet Oymak 32 0 0 08 Jul 2024
SpeakerBeam-SS: Real-time Target Speaker Extraction with Lightweight Conv-TasNet and State Space Modeling Hiroshi Sato Takafumi Moriya Masato Mimura Shota Horiguchi Tsubasa Ochiai Takanori Ashihara Atsushi Ando Kentaro Shinayama Marc Delcroix 30 1 0 01 Jul 2024
MMR-Mamba: Multi-Modal MRI Reconstruction with Mamba and Spatial-Frequency Information Fusion Jing Zou Lanqing Liu Qi Chen Shujun Wang Zhanli Hu Xiaohan Xing Jing Qin Mamba 24 2 0 27 Jun 2024
Soft Masked Mamba Diffusion Model for CT to MRI Conversion Zhenbin Wang Lei Zhang Lituan Wang Zhenwei Zhang Mamba MedIm 31 6 0 22 Jun 2024
KalMamba: Towards Efficient Probabilistic State Space Models for RL under Uncertainty P. Becker Niklas Freymuth Gerhard Neumann Mamba 16 2 0 21 Jun 2024
DeciMamba: Exploring the Length Extrapolation Potential of Mamba Assaf Ben-Kish Itamar Zimerman Shady Abu Hussein Nadav Cohen Amir Globerson Lior Wolf Raja Giryes Mamba 58 12 0 20 Jun 2024
Slot State Space Models Jindong Jiang Fei Deng Gautam Singh Minseung Lee Sungjin Ahn 39 4 0 18 Jun 2024
Separations in the Representational Capabilities of Transformers and Recurrent Architectures S. Bhattamishra Michael Hahn Phil Blunsom Varun Kanade GNN 26 8 0 13 Jun 2024
Q-S5: Towards Quantized State Space Models Steven Abreu Jens Egholm Pedersen Kade Heckel Alessandro Pierro MQ 16 6 0 13 Jun 2024
MaIL: Improving Imitation Learning with Mamba Xiaogang Jia Qian Wang Atalay Donat Bowen Xing Ge Li Hongyi Zhou Onur Celik Denis Blessing Rudolf Lioutikov Gerhard Neumann Mamba 25 9 0 12 Jun 2024
Short-Long Convolutions Help Hardware-Efficient Linear Attention to Focus on Long Sequences Zicheng Liu Siyuan Li Li Wang Zedong Wang Yunfan Liu Stan Z. Li 20 7 0 12 Jun 2024
RawBMamba: End-to-End Bidirectional State Space Model for Audio Deepfake Detection Yujie Chen Jiangyan Yi Jun Xue Chenglong Wang Xiaohui Zhang Shunbo Dong Siding Zeng Jianhua Tao Lv Zhao Cunhang Fan Mamba 30 15 0 10 Jun 2024
PointABM:Integrating Bidirectional State Space Model with Multi-Head Self-Attention for Point Cloud Analysis Jia-wei Chen Yu-jie Xiong Yong-Bin Gao Mamba 29 1 0 10 Jun 2024
What Can We Learn from State Space Models for Machine Learning on Graphs? Yinan Huang Siqi Miao Pan Li 39 7 0 09 Jun 2024
Exploring Adversarial Robustness of Deep State Space Models Biqing Qi Yang Luo Junqi Gao Pengfei Li Kai Tian Zhiyuan Ma Bowen Zhou AAML 32 1 0 08 Jun 2024
Decision Mamba: A Multi-Grained State Space Model with Self-Evolution Regularization for Offline RL Qi Lv Xiang Deng Gongwei Chen Michael Yu Wang Liqiang Nie 55 6 0 08 Jun 2024
LoCoCo: Dropping In Convolutions for Long Context Compression Ruisi Cai Yuandong Tian Zhangyang Wang Beidi Chen 25 3 0 08 Jun 2024