Efficiently Modeling Long Sequences with Structured State Spaces

31 October 2021

Papers citing "Efficiently Modeling Long Sequences with Structured State Spaces"

50 / 1,125 papers shown

Title
2DMCG:2DMambawith Change Flow Guidance for Change Detection in Remote Sensing JunYao Kaung HongWei Ge Mamba 143 0 0 01 Mar 2025
Concealed Adversarial attacks on neural networks for sequential data P. Sokerin Dmitry Anikin Sofia Krehova Alexey Zaytsev AAML AI4TS 44 0 0 28 Feb 2025
FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference Xunhao Lai Jianqiao Lu Yao Luo Yiyuan Ma Xun Zhou 63 5 0 28 Feb 2025
Visual Attention Exploration in Vision-Based Mamba Models Junpeng Wang Chin-Chia Michael Yeh Uday Singh Saini Mahashweta Das Mamba 54 0 0 28 Feb 2025
ProDapt: Proprioceptive Adaptation using Long-term Memory Diffusion Federico Pizarro Bejarano Bryson Jones Daniel Pastor Moreno J. Bowkett Paul Backes Angela P. Schoellig 31 0 0 28 Feb 2025
S4ConvD: Adaptive Scaling and Frequency Adjustment for Energy-Efficient Sensor Networks in Smart Buildings Melanie Schaller Bodo Rosenhahn 36 0 0 28 Feb 2025
Retrieval Backward Attention without Additional Training: Enhance Embeddings of Large Language Models via Repetition Yifei Duan Raphael Shang Deng Liang Yongqiang Cai 84 0 0 28 Feb 2025
TimesBERT: A BERT-Style Foundation Model for Time Series Understanding Haoran Zhang Yong Liu Yunzhong Qiu Haixuan Liu Zhongyi Pei Jianmin Wang Mingsheng Long AI4TS 45 0 0 28 Feb 2025
Thinking Slow, Fast: Scaling Inference Compute with Distilled Reasoners Daniele Paliotta Junxiong Wang Matteo Pagliardini Kevin Y. Li Aviv Bick J. Zico Kolter Albert Gu F. Fleuret Tri Dao ReLM LRM 43 7 0 27 Feb 2025
Accelerating Model-Based Reinforcement Learning with State-Space World Models Maria Krinner Elie Aljalbout Angel Romero Davide Scaramuzza OffRL 66 1 0 27 Feb 2025
Generalist World Model Pre-Training for Efficient Reinforcement Learning Yi Zhao Aidan Scannell Yuxin Hou Tianyu Cui Le Chen Dieter Buchler Arno Solin Juho Kannala J. Pajarinen OffRL OnRL 75 1 0 26 Feb 2025
Generalizable deep learning for photoplethysmography-based blood pressure estimation -- A Benchmarking Study Mohammad Moulaeifard Peter H. Charlton Nils Strodthoff OOD 67 1 0 26 Feb 2025
EEGM2: An Efficient Mamba-2-Based Self-Supervised Framework for Long-Sequence EEG Modeling Jiazhen Hong G. Mackellar Soheila Ghane Mamba 67 0 0 25 Feb 2025
MambaFlow: A Novel and Flow-guided State Space Model for Scene Flow Estimation Jiehao Luo Jintao Cheng Xiaoyu Tang Qingwen Zhang Bohuan Xue Rui Fan Mamba 44 0 0 24 Feb 2025
Mitigating Data Scarcity in Time Series Analysis: A Foundation Model with Series-Symbol Data Generation Wenxuan Wang K. Wu Yujian Betterest Li Dan Wang X. Zhang J. Liu AI4TS 65 0 0 24 Feb 2025
MambaPlace:Text-to-Point-Cloud Cross-Modal Place Recognition with Attention Mamba Mechanisms Tianyi Shang Zhenyu Li Wenhao Pei Pengjie Xu Mamba 73 0 0 24 Feb 2025
Vision-LSTM: xLSTM as Generic Vision Backbone Benedikt Alkin M. Beck Korbinian Poppel Sepp Hochreiter Johannes Brandstetter VLM 58 43 0 24 Feb 2025
TransMamba: Fast Universal Architecture Adaption from Transformers to Mamba Xiuwei Chen Sihao Lin Xiao Dong Z. Chen Meng Cao J. Han Hang Xu Xiaodan Liang Mamba 63 0 0 24 Feb 2025
OptionZero: Planning with Learned Options Po-Wei Huang Pei-Chiun Peng Hung Guei Ti-Rong Wu 53 0 0 23 Feb 2025
A Reverse Mamba Attention Network for Pathological Liver Segmentation Jun Zeng Debesh Jha Ertugrul Aktas Elif Keles A. Medetalibeyoğlu ... Robert Lewandowski Daniela Ladner Amir Borhani Gorkem Durak Ulas Bagci Mamba 49 1 0 23 Feb 2025
MAPN: Enhancing Heterogeneous Sparse Graph Representation by Mamba-based Asynchronous Aggregation Xuqi Mao Zhenying He Xiaoyang Sean Wang 50 0 0 23 Feb 2025
A Large Recurrent Action Model: xLSTM enables Fast Inference for Robotics Tasks Thomas Schmied Thomas Adler Vihang Patil M. Beck Korbinian Poppel Johannes Brandstetter G. Klambauer Razvan Pascanu Sepp Hochreiter 75 4 0 21 Feb 2025
Surface Vision Mamba: Leveraging Bidirectional State Space Model for Efficient Spherical Manifold Representation Rongzhao He Weihao Zheng Leilei Zhao Ying Wang Dalin Zhu Dan Wu Bin Hu Mamba 95 0 0 21 Feb 2025
Uncertainty Representations in State-Space Layers for Deep Reinforcement Learning under Partial Observability Carlos E. Luis A. Bottero Julia Vinogradska Felix Berkenkamp Jan Peters 78 1 0 20 Feb 2025
BP-SGCN: Behavioral Pseudo-Label Informed Sparse Graph Convolution Network for Pedestrian and Heterogeneous Trajectory Prediction Ruochen Li Stamos Katsigiannis Tae-Kyun Kim Hubert P. H. Shum 89 1 0 20 Feb 2025
CardiacMamba: A Multimodal RGB-RF Fusion Framework with State Space Models for Remote Physiological Measurement Zheng Wu Yiping Xie Bo Zhao Jiguang He Fei Luo Ning Deng Zitong Yu Mamba 44 1 0 20 Feb 2025
Slamming: Training a Speech Language Model on One GPU in a Day Gallil Maimon Avishai Elmakies Yossi Adi 38 3 0 19 Feb 2025
Disentangling Long-Short Term State Under Unknown Interventions for Online Time Series Forecasting Ruichu Cai Haiqin Huang Zhifang Jiang Zijian Li Changze Zhou Yuequn Liu Yuming Liu Z. Hao AI4TS CML 55 1 0 18 Feb 2025
Why does my medical AI look at pictures of birds? Exploring the efficacy of transfer learning across domain boundaries F. Jonske M. Kim Enrico Nasca J. Evers Johannes Haubold ... F. Nensa Michael Kamp C. Seibold Jan Egger Jens Kleesiek 79 1 0 17 Feb 2025
Image Forgery Localization with State Space Models Zijie Lou Gang Cao Kun Guo Shaowei Weng Lifang Yu Mamba 94 1 0 17 Feb 2025
Associative Recurrent Memory Transformer Ivan Rodkin Yuri Kuratov Aydar Bulatov Mikhail Burtsev 68 2 0 17 Feb 2025
On Vanishing Gradients, Over-Smoothing, and Over-Squashing in GNNs: Bridging Recurrent and Graph Learning Alvaro Arroyo Alessio Gravina Benjamin Gutteridge Federico Barbero Claudio Gallicchio Xiaowen Dong Michael M. Bronstein P. Vandergheynst 31 2 0 15 Feb 2025
Occlusion-aware Text-Image-Point Cloud Pretraining for Open-World 3D Object Recognition Khanh Nguyen Ghulam Mubashar Hassan Ajmal Saeed Mian 3DPC 49 0 0 15 Feb 2025
Memory, Benchmark & Robots: A Benchmark for Solving Complex Tasks with Reinforcement Learning Egor Cherepanov Nikita Kachaev A. Kovalev Aleksandr I. Panov OffRL 38 0 0 14 Feb 2025
LOB-Bench: Benchmarking Generative AI for Finance - an Application to Limit Order Book Data Peer Nagy Sascha Frey Kang Li Bidipta Sarkar Svitlana Vyetrenko Stefan Zohren Ani Calinescu Jakob Foerster 84 1 0 13 Feb 2025
SS4Rec: Continuous-Time Sequential Recommendation with State Space Models Wei Xiao Huiying Wang Qifeng Zhou 59 0 0 12 Feb 2025
A Survey on Mamba Architecture for Vision Applications Fady Ibrahim Guangjun Liu Guanghui Wang Mamba 53 2 0 11 Feb 2025
Sentient: Multi-Scenario Behavioral Intent Analysis for Advanced Persistent Threat Detection Wenhao Yan Ning An Wei Qiao Weiheng Wu Bo-Sian Jiang Yuling Liu Zhigang Lu JunRong Liu 57 0 0 10 Feb 2025
Koopman-Equivariant Gaussian Processes Petar Bevanda Max Beier Armin Lederer A. Capone Stefan Sosnowski Sandra Hirche AI4TS 63 1 0 10 Feb 2025
MoEMba: A Mamba-based Mixture of Experts for High-Density EMG-based Hand Gesture Recognition Mehran Shabanpour Kasra Rad Sadaf Khademi Arash Mohammadi 42 0 0 09 Feb 2025
CacheMamba: Popularity Prediction for Mobile Edge Caching Networks via Selective State Spaces Ghazaleh Kianfar Zohreh Hajiakhondi-Meybodi A. Mohammadi Mamba 50 0 0 09 Feb 2025
Scaling Laws in Patchification: An Image Is Worth 50,176 Tokens And More Feng Wang Yaodong Yu Guoyizhe Wei Wei Shao Yuyin Zhou Alan Yuille Cihang Xie ViT 94 4 0 06 Feb 2025
Sequence models for continuous cell cycle stage prediction from brightfield images Louis-Alexandre Leger Maxine Leonardi Andrea Salati Felix Naef Martin Weigert 57 1 0 04 Feb 2025
Accelerating Linear Recurrent Neural Networks for the Edge with Unstructured Sparsity Alessandro Pierro Steven Abreu Jonathan Timcheck Philipp Stratmann Andreas Wild S. Shrestha 65 0 0 03 Feb 2025
Generalization Error Analysis for Selective State-Space Models Through the Lens of Attention Arya Honarpisheh Mustafa Bozdag M. Sznaier Octavia Camps Mamba 67 1 0 03 Feb 2025
Sub-Sequential Physics-Informed Learning with State Space Model Chenhui Xu Dancheng Liu Yuting Hu Jiajie Li Ruiyang Qin Qingxiao Zheng Jinjun Xiong AI4CE PINN 146 0 0 01 Feb 2025
Exploring Linear Attention Alternative for Single Image Super-Resolution Rongchang Lu Changyu Li Donghang Li Guojing Zhang Jianqiang Huang X. Li 49 0 0 01 Feb 2025
HSRMamba: Contextual Spatial-Spectral State Space Model for Single Hyperspectral Super-Resolution Shi Chen Lefei Zhang L. Zhang Mamba 130 1 0 30 Jan 2025
HadamRNN: Binary and Sparse Ternary Orthogonal RNNs Armand Foucault Franck Mamalet François Malgouyres MQ 74 0 0 28 Jan 2025
A Deep State Space Model for Rainfall-Runoff Simulations Yihan Wang Lujun Zhang Annan Yu N. Benjamin Erichson Tiantian Yang 47 1 0 28 Jan 2025