Efficiently Modeling Long Sequences with Structured State Spaces

31 October 2021

Papers citing "Efficiently Modeling Long Sequences with Structured State Spaces"

50 / 1,127 papers shown

Title
MobileMamba: Lightweight Multi-Receptive Visual Mamba Network Haoyang He J. Zhang Yuxuan Cai Hongxu Chen Xiaobin Hu Zhenye Gan Y. Wang Chengjie Wang Yunsheng Wu Lei Xie Mamba 88 3 0 24 Nov 2024
State-Space Large Audio Language Models Saurabhchand Bhati Yuan Gong Leonid Karlinsky Hilde Kuehne Rogerio Feris James Glass 96 0 0 24 Nov 2024
Best of Both Worlds: Advantages of Hybrid Graph Sequence Models Ali Behrouz Ali Parviz Mahdi Karami Clayton Sanford Bryan Perozzi Vahab Mirrokni 81 2 0 23 Nov 2024
$Applications of fractional calculus in learned optimization$ Applications of fractional calculus in learned optimization Teodor Alexandru Szente James Harrison M. Zanfir C. Sminchisescu 66 0 0 22 Nov 2024
Fast convolution algorithm for state space models Gregory Beylkin 80 1 0 22 Nov 2024
EfficientViM: Efficient Vision Mamba with Hidden State Mixer based State Space Duality Sanghyeok Lee Joonmyung Choi Hyunwoo J. Kim 110 3 0 22 Nov 2024
Parameter Efficient Mamba Tuning via Projector-targeted Diagonal-centric Linear Transformation Seokil Ham H. Kim Sangmin Woo Changick Kim Mamba 183 0 0 21 Nov 2024
Hymba: A Hybrid-head Architecture for Small Language Models Xin Dong Y. Fu Shizhe Diao Wonmin Byeon Zijia Chen ... Min-Hung Chen Yoshi Suhara Y. Lin Jan Kautz Pavlo Molchanov Mamba 100 21 0 20 Nov 2024
Unlocking State-Tracking in Linear RNNs Through Negative Eigenvalues Riccardo Grazzi Julien N. Siems Jörg K.H. Franke Arber Zela Frank Hutter Massimiliano Pontil 92 11 0 19 Nov 2024
Bi-Mamba: Towards Accurate 1-Bit State Space Models Shengkun Tang Liqun Ma H. Li Mingjie Sun Zhiqiang Shen Mamba 73 3 0 18 Nov 2024
RAWMamba: Unified sRGB-to-RAW De-rendering With State Space Model Hongjun Chen Wencheng Han Huan Zheng Jianbing Shen Mamba 81 0 0 18 Nov 2024
MetaLA: Unified Optimal Linear Approximation to Softmax Attention Map Yuhong Chou Man Yao Kexin Wang Yuqi Pan Ruijie Zhu Yiran Zhong Yu Qiao J. Wu Bo Xu Guoqi Li 46 4 0 16 Nov 2024
Deep Loss Convexification for Learning Iterative Models Ziming Zhang Yuping Shao Yiqing Zhang Fangzhou Lin Haichong K. Zhang Elke Rundensteiner 3DPC 36 0 0 16 Nov 2024
XLSR-Mamba: A Dual-Column Bidirectional State Space Model for Spoofing Attack Detection Yang Xiao Rohan Kumar Das Mamba 31 1 0 15 Nov 2024
Multimodal Instruction Tuning with Hybrid State Space Models Jianing Zhou Han Li Shuai Zhang Ning Xie Ruijie Wang Xiaohan Nie Sheng Liu Lingyun Wang 40 0 0 13 Nov 2024
Mamba-based Decoder-Only Approach with Bidirectional Speech Modeling for Speech Recognition Yoshiki Masuyama Koichi Miyazaki Masato Murata Mamba 43 0 0 11 Nov 2024
LFSamba: Marry SAM with Mamba for Light Field Salient Object Detection Zhengyi Liu Longzhen Wang Xianyong Fang Zhengzheng Tu Linbo Wang Mamba 38 1 0 11 Nov 2024
SEM-Net: Efficient Pixel Modelling for image inpainting with Spatially Enhanced SSM Shuang Chen Haozheng Zhang Amir Atapour-Abarghouei Hubert P. H. Shum 36 0 0 10 Nov 2024
Bio-xLSTM: Generative modeling, representation and in-context learning of biological and chemical sequences Niklas Schmidinger Lisa Schneckenreiter Philipp Seidl Johannes Schimunek Pieter-Jan Hoedt Johannes Brandstetter Andreas Mayr Sohvi Luukkonen Sepp Hochreiter G. Klambauer MedIm 61 4 0 06 Nov 2024
Multivariate Data Augmentation for Predictive Maintenance using Diffusion Andrew Thompson Alexander Sommers Alicia Russell-Gilbert Logan Cummins Sudip Mittal Shahram Rahimi Maria Seale Joseph Jaboure Thomas Arnold Joshua Church DiffM 37 0 0 06 Nov 2024
MambaPEFT: Exploring Parameter-Efficient Fine-Tuning for Mamba Masakazu Yoshimura Teruaki Hayashi Yota Maeda Mamba 100 2 0 06 Nov 2024
DiMSUM: Diffusion Mamba -- A Scalable and Unified Spatial-Frequency Method for Image Generation Hao Phung Quan Dao T. Dao Hoang Phan Dimitris Metaxas Anh Tran Mamba 64 3 0 06 Nov 2024
A Mamba Foundation Model for Time Series Forecasting Haoyu Ma Yushu Chen Wenlai Zhao Jinzhe Yang Yingsheng Ji Xinghua Xu Xiaozhu Liu Hao Jing Shengzhuo Liu Guangwen Yang AI4TS Mamba 41 2 0 05 Nov 2024
Layer-Adaptive State Pruning for Deep State Space Models Minseon Gwak Seongrok Moon Joohwan Ko PooGyeon Park 25 0 0 05 Nov 2024
The Evolution of RWKV: Advancements in Efficient Language Modeling Akul Datta VLM 41 1 0 05 Nov 2024
ShadowMamba: State-Space Model with Boundary-Region Selective Scan for Shadow Removal Xiujin Zhu Chee-Onn Chow Joon Huang Chuah Mamba 42 0 0 05 Nov 2024
Modulating State Space Model with SlowFast Framework for Compute-Efficient Ultra Low-Latency Speech Enhancement Longbiao Cheng Ashutosh Pandey Buye Xu T. Delbruck V. Ithapu Shih-Chii Liu 37 0 0 04 Nov 2024
N-Gram Induction Heads for In-Context RL: Improving Stability and Reducing Data Needs Ilya Zisman Alexander Nikulin Andrei Polubarov Nikita Lyubaykin Vladislav Kurenkov Andrei Polubarov Igor Kiselev Vladislav Kurenkov OffRL 50 1 0 04 Nov 2024
Optical Flow Representation Alignment Mamba Diffusion Model for Medical Video Generation Zhenbin Wang Lei Zhang Lituan Wang Minjuan Zhu Zhenwei Zhang VGen MedIm 57 1 0 03 Nov 2024
MambaReg: Mamba-Based Disentangled Convolutional Sparse Coding for Unsupervised Deformable Multi-Modal Image Registration Kaiang Wen Bin Xie Bin Duan Yan Yan Mamba 21 0 0 03 Nov 2024
Provable Length Generalization in Sequence Prediction via Spectral Filtering Annie Marsden Evan Dogariu Naman Agarwal Xinyi Chen Daniel Suo Elad Hazan 34 1 0 01 Nov 2024
SambaMixer: State of Health Prediction of Li-ion Batteries using Mamba State Space Models José Ignacio Olalde-Verano Sascha Kirch Clara Pérez-Molina Sergio Martin Mamba 30 0 0 31 Oct 2024
NIMBA: Towards Robust and Principled Processing of Point Clouds With SSMs Nursena Köprücü Destiny Okpekpe Antonio Orvieto Mamba 36 1 0 31 Oct 2024
Video Token Merging for Long-form Video Understanding Seon-Ho Lee Jue Wang Zhikang Zhang D. Fan Xinyu Li 40 5 0 31 Oct 2024
Towards Dynamic Message Passing on Graphs Junshu Sun Chenxue Yang Xiangyang Ji Qingming Huang Shuhui Wang 37 0 0 31 Oct 2024
Advancing Efficient Brain Tumor Multi-Class Classification -- New Insights from the Vision Mamba Model in Transfer Learning Yinyi Lai Anbo Cao Yuan Gao Jiaqi Shang Zongyu Li Jia Guo Mamba 29 1 0 29 Oct 2024
Exploring contextual modeling with linear complexity for point cloud segmentation Yong Xien Chng Xuchong Qiu Yizeng Han Yifan Pu Jiewei Cao Gao Huang Mamba 33 1 0 28 Oct 2024
SepMamba: State-space models for speaker separation using Mamba Thor Højhus Avenstrup Boldizsár Elek István László Mádi András Bence Schin Morten Mørup Bjørn Sand Jensen Kenny Falkær Olsen Mamba 28 0 0 28 Oct 2024
FACTS: A Factored State-Space Framework For World Modelling Li Nanbo Firas Laakom Yucheng Xu Wenyi Wang Jürgen Schmidhuber AI4TS 139 0 0 28 Oct 2024
Wavelet-based Mamba with Fourier Adjustment for Low-light Image Enhancement Junhao Tan Songwen Pei Wei Qin Bo Fu Ximing Li Libo Huang Mamba 38 3 0 27 Oct 2024
Utilizing Image Transforms and Diffusion Models for Generative Modeling of Short and Long Time Series Ilan Naiman Nimrod Berman Itai Pemper Idan Arbiv Gal Fadlon Omri Azencot 32 11 0 25 Oct 2024
Multi-Agent Reinforcement Learning with Selective State-Space Models Jemma Daniel Ruan de Kock Louay Ben Nessir Sasha Abramowitz Omayma Mahjoub Wiem Khlifi Claude Formanek Arnu Pretorius Mamba 34 0 0 25 Oct 2024
Citywide Electric Vehicle Charging Demand Prediction Approach Considering Urban Region and Dynamic Influences Haoxuan Kuang Kunxiang Deng Linlin You Jun Li 20 0 0 24 Oct 2024
Taipan: Efficient and Expressive State Space Language Models with Selective Attention Chien Van Nguyen Huy Huu Nguyen Thang M. Pham Ruiyi Zhang Hanieh Deilamsalehy ... Ryan A. Rossi Trung Bui Viet Dac Lai Franck Dernoncourt Thien Huu Nguyen Mamba RALM 29 1 0 24 Oct 2024
Bio2Token: All-atom tokenization of any biomolecular structure with Mamba Andrew Liu Axel Elaldi Nathan Russell Olivia Viessmann Mamba 63 2 0 24 Oct 2024
SpikMamba: When SNN meets Mamba in Event-based Human Action Recognition Jiaqi Chen Yan Yang Shizhuo Deng Da Teng Liyuan Pan Mamba 24 1 0 22 Oct 2024
LLM-TS Integrator: Integrating LLM for Enhanced Time Series Modeling Can Chen Gabriel Oliveira Hossein Sharifi-Noghabi Tristan Sylvain AI4TS 26 1 0 21 Oct 2024
LMHaze: Intensity-aware Image Dehazing with a Large-scale Multi-intensity Real Haze Dataset Ruikun Zhang Hao-Liang Yang Yan Yang Ying Fu Liyuan Pan 30 3 0 21 Oct 2024
TimeMixer++: A General Time Series Pattern Machine for Universal Predictive Analysis Shiyu Wang Jiawei Li X. Shi Zhou Ye Baichuan Mo Wenze Lin Shengtong Ju Zhixuan Chu Ming Jin AI4TS 38 9 0 21 Oct 2024
Taming Mambas for Voxel Level 3D Medical Image Segmentation Luca Lumetti Vittorio Pipoli Kevin Marchesini Elisa Ficarra C. Grana Federico Bolelli MedIm Mamba 29 0 0 20 Oct 2024