Venturing into Uncharted Waters: The Navigation Compass from Transformer to Mamba

24 June 2024

Yuchen Zou

Yineng Chen

Zuchao Li

Lefei Zhang

Hai Zhao

ArXiv PDF HTML

Papers citing "Venturing into Uncharted Waters: The Navigation Compass from Transformer to Mamba"

26 / 26 papers shown

Title
Dimba: Transformer-Mamba Diffusion Models Zhengcong Fei Mingyuan Fan Changqian Yu Debang Li Youqiang Zhang Junshi Huang Mamba 51 16 0 03 Jun 2024
LLEMamba: Low-Light Enhancement via Relighting-Guided Mamba with Deep Unfolding Network Xuanqi Zhang Haijin Zeng Jinwang Pan Qiangqiang Shen Yongyong Chen Mamba 34 4 0 03 Jun 2024
A Novel State Space Model with Local Enhancement and State Sharing for Image Fusion Zihan Cao Xiao Wu Liang-Jian Deng Yu Zhong Mamba 34 9 0 14 Apr 2024
MambaDFuse: A Mamba-based Dual-phase Model for Multi-modality Image Fusion Zhe Li Haiwei Pan Kejia Zhang Yuhua Wang Feng Yu Mamba 27 19 0 12 Apr 2024
FusionMamba: Efficient Image Fusion with State Space Model Siran Peng Xiangyu Zhu Haoyu Deng Zhen Lei Liang-Jian Deng Mamba 33 4 0 11 Apr 2024
SurvMamba: State Space Model with Multi-grained Multi-modal Interaction for Survival Prediction Ying Chen Jiajing Xie Yuxiang Lin Yuhang Song Wenxian Yang Rongshan Yu Mamba 22 5 0 11 Apr 2024
Heracles: A Hybrid SSM-Transformer Model for High-Resolution Image and Time-Series Analysis Badri N. Patro Suhas Ranganath Vinay P. Namboodiri Vijay Srinivas Agneeswaran 34 2 0 26 Mar 2024
ReMamber: Referring Image Segmentation with Mamba Twister Yu-Hao Yang Chaofan Ma Jiangchao Yao Zhun Zhong Ya-Qin Zhang Yanfeng Wang Mamba 52 20 0 26 Mar 2024
TimeMachine: A Time Series is Worth 4 Mambas for Long-term Forecasting Md. Atik Ahamed Qiang Cheng Mamba AI4TS 51 23 0 14 Mar 2024
VM-UNET-V2 Rethinking Vision Mamba UNet for Medical Image Segmentation Mingya Zhang Yue Yu Limei Gu Tingsheng Lin Xianping Tao Mamba 28 39 0 14 Mar 2024
Multichannel Long-Term Streaming Neural Speech Enhancement for Static and Moving Speakers Changsheng Quan Xiaofei Li 28 23 0 12 Mar 2024
ClinicalMamba: A Generative Clinical Language Model on Longitudinal Clinical Notes Zhichao Yang Avijit Mitra Sunjae Kwon Hong-ye Yu 28 18 0 09 Mar 2024
Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models Soham De Samuel L. Smith Anushan Fernando Aleksandar Botev George-Christian Muraru ... David Budden Yee Whye Teh Razvan Pascanu Nando de Freitas Çağlar Gülçehre Mamba 51 116 0 29 Feb 2024
Simple linear attention language models balance the recall-throughput tradeoff Simran Arora Sabri Eyuboglu Michael Zhang Aman Timalsina Silas Alberti Dylan Zinsley James Zou Atri Rudra Christopher Ré 34 60 0 28 Feb 2024
MambaIR: A Simple Baseline for Image Restoration with State-Space Model Hang Guo Jinmin Li Tao Dai Zhihao Ouyang Xudong Ren Shu-Tao Xia Mamba 42 196 0 23 Feb 2024
Pan-Mamba: Effective pan-sharpening with State Space Model Xuanhua He Ke Cao K. Yan Rui Li Chengjun Xie Jie Zhang Man Zhou Mamba 48 60 0 19 Feb 2024
PointMamba: A Simple State Space Model for Point Cloud Analysis Dingkang Liang Xin Zhou Wei Xu Xingkui Zhu Zhikang Zou Xiaoqing Ye Xinyu Wang Xiang Bai 77 87 0 16 Feb 2024
Graph Mamba: Towards Learning on Graphs with State Space Models Ali Behrouz Farnoosh Hashemi AI4CE 81 57 0 13 Feb 2024
Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data Shufan Li Harkanwar Singh Aditya Grover Mamba 66 56 0 08 Feb 2024
U-shaped Vision Mamba for Single Image Dehazing Zhuoran Zheng Chen Henry Wu 62 34 0 06 Feb 2024
VM-UNet: Vision Mamba UNet for Medical Image Segmentation Jiacheng Ruan Suncheng Xiang Mamba 59 241 0 04 Feb 2024
LOCOST: State-Space Models for Long Document Abstractive Summarization Florian Le Bronnec Song Duong Mathieu Ravaut Alexandre Allauzen Nancy F. Chen Vincent Guigue Alberto Lumbreras Laure Soulier Patrick Gallinari 24 6 0 31 Jan 2024
U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentation Jun Ma Feifei Li Bo Wang Mamba 74 314 0 09 Jan 2024
How to Train Your HiPPO: State Space Models with Generalized Orthogonal Basis Projections Albert Gu Isys Johnson Aman Timalsina Atri Rudra Christopher Ré Mamba 79 59 0 24 Jun 2022
U-Net: Convolutional Networks for Biomedical Image Segmentation Olaf Ronneberger Philipp Fischer Thomas Brox SSeg 3DV 226 74,467 0 18 May 2015
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 279 39,083 0 01 Sep 2014