Efficiently Modeling Long Sequences with Structured State Spaces

31 October 2021

Papers citing "Efficiently Modeling Long Sequences with Structured State Spaces"

50 / 1,127 papers shown

Title
MambaSOD: Dual Mamba-Driven Cross-Modal Fusion Network for RGB-D Salient Object Detection Yue Zhan Zhihong Zeng Haijun Liu Xiaoheng Tan Yinli Tian Mamba 35 3 0 19 Oct 2024
HiPPO-KAN: Efficient KAN Model for Time Series Analysis SangJong Lee Jin-Kwang Kim JunHo Kim TaeHan Kim James Lee AI4TS 23 2 0 19 Oct 2024
Spatial-Mamba: Effective Visual State Space Models via Structure-aware State Fusion Chaodong Xiao Minghan Li Zhengqiang Zhang Deyu Meng Lei Zhang Mamba 57 4 0 19 Oct 2024
Self-supervised contrastive learning performs non-linear system identification Rodrigo González Laiz Tobias Schmidt Steffen Schneider SSL 37 0 0 18 Oct 2024
Variable Aperture Bokeh Rendering via Customized Focal Plane Guidance Kang Chen Shijun Yan Aiwen Jiang Han Li Zhifeng Wang 45 0 0 18 Oct 2024
Rethinking Transformer for Long Contextual Histopathology Whole Slide Image Analysis Honglin Li Yunlong Zhang Pingyi Chen Zhongyi Shui Chenglu Zhu Lin Yang MedIm 38 4 0 18 Oct 2024
DiffImp: Efficient Diffusion Model for Probabilistic Time Series Imputation with Bidirectional Mamba Backbone Hongfan Gao Wangmeng Shen Xiangfei Qiu Ronghui Xu Jilin Hu Bin Yang 20 5 0 17 Oct 2024
Flash Inference: Near Linear Time Inference for Long Convolution Sequence Models and Beyond Costin-Andrei Oncescu Sanket Purandare Stratos Idreos Sham Kakade VLM AI4TS 3DV 21 0 0 16 Oct 2024
UMambaAdj: Advancing GTV Segmentation for Head and Neck Cancer in MRI-Guided RT with UMamba and nnU-Net ResEnc Planner Jintao Ren Kim Hochreuter Jesper Folsted Kallehauge Stine Korreman Mamba 26 1 0 16 Oct 2024
Long-LRM: Long-sequence Large Reconstruction Model for Wide-coverage Gaussian Splats Chen Ziwen Hao Tan Kai Zhang Sai Bi Fujun Luan Yicong Hong Li Fuxin Zexiang Xu 3DGS 3DV 36 16 0 16 Oct 2024
Rethinking Token Reduction for State Space Models Zheng Zhan Yushu Wu Zhenglun Kong Changdi Yang Yifan Gong Xuan Shen Xue Lin Pu Zhao Yanzhi Wang Mamba 32 4 0 16 Oct 2024
AI-Aided Kalman Filters Nir Shlezinger Guy Revach Anubhab Ghosh S. Chatterjee Shuo Tang Tales Imbiriba J. Duník O. Straka Pau Closas Yonina C. Eldar 72 3 0 16 Oct 2024
Towards Neural Scaling Laws for Time Series Foundation Models Qingren Yao Chao-Han Huck Yang Renhe Jiang Yuxuan Liang Ming Jin Shirui Pan AI4TS AI4CE 42 7 0 16 Oct 2024
Online learning in motion modeling for intra-interventional image sequences N. Gunnarsson Jens Sjölund Peter Kimstrand Thomas B. Schon 30 0 0 15 Oct 2024
UmambaTSF: A U-shaped Multi-Scale Long-Term Time Series Forecasting Method Using Mamba Li Wu Wenbin Pei Jiulong Jiao Qiang Zhang Mamba AI4TS 35 2 0 15 Oct 2024
State-space models can learn in-context by gradient descent Neeraj Mohan Sushma Yudou Tian Harshvardhan Mestha Nicolo Colombo David Kappel Anand Subramoney 41 3 0 15 Oct 2024
Mimetic Initialization Helps State Space Models Learn to Recall Asher Trockman Hrayr Harutyunyan J. Zico Kolter Sanjiv Kumar Srinadh Bhojanapalli Mamba 21 3 0 14 Oct 2024
V2M: Visual 2-Dimensional Mamba for Image Representation Learning Chengkun Wang Wenzhao Zheng Yuanhui Huang Jie Zhou Jiwen Lu Mamba 30 0 0 14 Oct 2024
GlobalMamba: Global Image Serialization for Vision Mamba Chengkun Wang Wenzhao Zheng Jie Zhou Jiwen Lu Mamba 40 0 0 14 Oct 2024
Towards Better Multi-head Attention via Channel-wise Sample Permutation Shen Yuan Hongteng Xu 17 1 0 14 Oct 2024
CleanUMamba: A Compact Mamba Network for Speech Denoising using Channel Pruning Sjoerd Groot Qinyu Chen Jan C. van Gemert Chang Gao Mamba 126 0 0 14 Oct 2024
Lambda-Skip Connections: the architectural component that prevents Rank Collapse Federico Arangath Joseph Jerome Sieber M. Zeilinger Carmen Amo Alonso 33 0 0 14 Oct 2024
Improving Generalization on the ProcGen Benchmark with Simple Architectural Changes and Scale Andrew Jesson Yiding Jiang OffRL 27 1 0 13 Oct 2024
Variational Diffusion Posterior Sampling with Midpoint Guidance Badr Moufad Yazid Janati Lisa Bedin Alain Durmus Randal Douc Eric Moulines Jimmy Olsson DiffM 35 1 0 13 Oct 2024
HASN: Hybrid Attention Separable Network for Efficient Image Super-resolution Weifeng Cao Xiaoyan Lei Jun Shi Wanyong Liang Jie Liu Zongfei Bai SupR 26 0 0 13 Oct 2024
Efficiently Scanning and Resampling Spatio-Temporal Tasks with Irregular Observations Bryce Ferenczi Michael G. Burke Tom Drummond 31 0 0 11 Oct 2024
Drama: Mamba-Enabled Model-Based Reinforcement Learning Is Sample and Parameter Efficient Wenlong Wang Ivana Dusparic Yucheng Shi Ke Zhang V. Cahill Mamba 143 0 0 11 Oct 2024
Parameter-Efficient Fine-Tuning of State Space Models Kevin Galim Wonjun Kang Yuchen Zeng H. Koo Kangwook Lee 29 4 0 11 Oct 2024
CountMamba: Exploring Multi-directional Selective State-Space Models for Plant Counting Hulingxiao He Yaqi Zhang Jinglin Xu Yuxin Peng Mamba 28 0 0 10 Oct 2024
QuadMamba: Learning Quadtree-based Selective Scan for Visual State Space Model Fei Xie Weijia Zhang Zhongdao Wang Chao Ma Mamba 24 3 0 09 Oct 2024
Toward Physics-guided Time Series Embedding Jiaxi Hu Bowen Zhang Qingsong Wen Fugee Tsung Yuxuan Liang AI4TS AI4CE 34 3 0 09 Oct 2024
Rodimus*: Breaking the Accuracy-Efficiency Trade-Off with Efficient Attentions Zhihao He Hang Yu Zi Gong Shizhan Liu Jianguo Li Weiyao Lin VLM 36 1 0 09 Oct 2024
Joint Fine-tuning and Conversion of Pretrained Speech and Language Models towards Linear Complexity Mutian He Philip N. Garner 82 0 0 09 Oct 2024
Stochastic Sparse Sampling: A Framework for Variable-Length Medical Time Series Classification Xavier Mootoo Alan A. Díaz-Montiel Milad Lankarany Hina Tabassum AI4TS 30 0 0 08 Oct 2024
A Survey: Collaborative Hardware and Software Design in the Era of Large Language Models Cong Guo Feng Cheng Zhixu Du James Kiessling Jonathan Ku ... Qilin Zheng Guanglei Zhou Hai Li-Wei Li Yiran Chen 31 7 0 08 Oct 2024
Monocular Visual Place Recognition in LiDAR Maps via Cross-Modal State Space Model and Multi-View Matching Gongxin Yao Xinyang Li Luowei Fu Yu Pan 30 1 0 08 Oct 2024
EMMA: Empowering Multi-modal Mamba with Structural and Hierarchical Alignment Yifei Xing Xiangyuan Lan Ruiping Wang D. Jiang Wenjun Huang Qingfang Zheng Yaowei Wang Mamba 35 0 0 08 Oct 2024
TIMBA: Time series Imputation with Bi-directional Mamba Blocks and Diffusion models Javier Solís-García Belén Vega-Márquez Juan A. Nepomuceno Isabel A. Nepomuceno-Chamorro Mamba AI4TS AI4CE 20 0 0 08 Oct 2024
Remote Sensing Image Segmentation Using Vision Mamba and Multi-Scale Multi-Frequency Feature Fusion Yice Cao Chenchen Liu Zhenhua Wu Wenxin Yao Liu Xiong Jie Chen Zhixiang Huang Mamba 37 2 0 08 Oct 2024
Amortized Control of Continuous State Space Feynman-Kac Model for Irregular Time Series Byoungwoo Park Hyungi Lee Juho Lee AI4TS 41 0 0 08 Oct 2024
IGroupSS-Mamba: Interval Group Spatial-Spectral Mamba for Hyperspectral Image Classification Yan He Bing Tu Puzhao Jiang Bo Liu Jun Li Antonio J. Plaza 39 10 0 07 Oct 2024
SPikE-SSM: A Sparse, Precise, and Efficient Spiking State Space Model for Long Sequences Learning Yan Zhong Ruoyu Zhao Chao Wang Qinghai Guo Jianguo Zhang Zhichao Lu Luziwei Leng 44 2 0 07 Oct 2024
On Efficient Variants of Segment Anything Model: A Survey Xiaorui Sun J. Liu H. Shen Xiaofeng Zhu Ping Hu VLM 45 4 0 07 Oct 2024
Neural Fourier Modelling: A Highly Compact Approach to Time-Series Analysis Minjung Kim Yusuke Hioka Michael Witbrock AI4TS 32 0 0 07 Oct 2024
Large Language Model Inference Acceleration: A Comprehensive Hardware Perspective Jinhao Li Jiaming Xu Shan Huang Yonghua Chen Wen Li ... Jiayi Pan Li Ding Hao Zhou Yu Wang Guohao Dai 62 16 0 06 Oct 2024
Accelerating Inference of Networks in the Frequency Domain Chenqiu Zhao Guanfang Dong Anup Basu 35 10 0 06 Oct 2024
LongGenBench: Long-context Generation Benchmark Xiang Liu Peijie Dong Xuming Hu Xiaowen Chu RALM 45 8 0 05 Oct 2024
Efficient and Robust Long-Form Speech Recognition with Hybrid H3-Conformer Tomoki Honda S. Sakai Tatsuya Kawahara 21 0 0 05 Oct 2024
Mamba Capsule Routing Towards Part-Whole Relational Camouflaged Object Detection Dingwen Zhang Liangbo Cheng Yi Liu Xinggang Wang J. Han Mamba 31 3 0 05 Oct 2024
System 2 Reasoning Capabilities Are Nigh Scott C. Lowe VLM LRM 46 0 0 04 Oct 2024