Efficiently Modeling Long Sequences with Structured State Spaces

31 October 2021

Papers citing "Efficiently Modeling Long Sequences with Structured State Spaces"

50 / 1,125 papers shown

Title
Millions of States: Designing a Scalable MoE Architecture with RWKV-7 Meta-learner Liu Xiao Li Zhiyuan Lin Yueyu 31 0 0 11 Apr 2025
Learning Fine-grained Domain Generalization via Hyperbolic State Space Hallucination Qi Bi Jingjun Yi Haolan Zhan Wei Ji Gui-Song Xia 46 1 0 10 Apr 2025
ms-Mamba: Multi-scale Mamba for Time-Series Forecasting Yusuf Meric Karadag Sinan Kalkan Ipek Gursel Dino Mamba AI4TS AI4CE 50 0 0 10 Apr 2025
CAT: Circular-Convolutional Attention for Sub-Quadratic Transformers Yoshihiro Yamada ViT 23 0 0 09 Apr 2025
HGMamba: Enhancing 3D Human Pose Estimation with a HyperGCN-Mamba Network Hu Cui Tessai Hayama 3DH 48 0 0 09 Apr 2025
TSP-OCS: A Time-Series Prediction for Optimal Camera Selection in Multi-Viewpoint Surgical Video Analysis Xinyu Liu Xiaoguang Lin Xiang Liu Yong Yang H. Wang Qilong Sun 32 0 0 09 Apr 2025
DefMamba: Deformable Visual State Space Model Leiye Liu Miao Zhang Jihao Yin Tingwei Liu Wei Ji Yongri Piao Huchuan Lu Mamba 55 0 0 08 Apr 2025
Learnable Multi-Scale Wavelet Transformer: A Novel Alternative to Self-Attention Andrew Kiruluta Priscilla Burity Samantha Williams 25 3 0 08 Apr 2025
TAPNext: Tracking Any Point (TAP) as Next Token Prediction Artem Zholus Carl Doersch Yi Yang Skanda Koppula Viorica Patraucean Xu He Ignacio Rocco Mehdi S. M. Sajjadi Sarath Chandar Ross Goroshin 30 0 0 08 Apr 2025
Dynamic Vision Mamba Mengxuan Wu Zekai Li Zhiyuan Liang Moyang Li Xuanlei Zhao ... Xiaojiang Peng Konstantinos N. Plataniotis Kai Wang Wangbo Zhao Yang You Mamba 49 0 0 07 Apr 2025
REEF: Relevance-Aware and Efficient LLM Adapter for Video Understanding Sakib Reza Xiyun Song Heather Yu Zongfang Lin Mohsen Moghaddam Octavia Camps 23 0 0 07 Apr 2025
Unsupervised Estimation of Nonlinear Audio Effects: Comparing Diffusion-Based and Adversarial approaches Eloi Moliner Michal Švento Alec Wright Lauri Juvela Pavel Rajmic Vesa Valimaki DiffM 38 1 0 07 Apr 2025
Leveraging State Space Models in Long Range Genomics Matvei Popov Aymen Kallala Anirudha Ramesh Narimane Hennouni Shivesh Khaitan Rick Gentry Alain-Sam Cohen Mamba 60 0 0 07 Apr 2025
LDGNet: A Lightweight Difference Guiding Network for Remote Sensing Change Detection Chenfeng Xu 24 0 0 07 Apr 2025
GAMDTP: Dynamic Trajectory Prediction with Graph Attention Mamba Network Yunxiang Liu Hongkuo Niu Jianlin Zhu 27 0 0 07 Apr 2025
Gating is Weighting: Understanding Gated Linear Attention through In-context Learning Yingcong Li Davoud Ataee Tarzanagh A. S. Rawat Maryam Fazel Samet Oymak 25 0 0 06 Apr 2025
Diff-SSL-G-Comp: Towards a Large-Scale and Diverse Dataset for Virtual Analog Modeling Yicheng Gu Runsong Zhang Lauri Juvela Z. Wu DiffM 124 0 0 06 Apr 2025
Foundation Models for Time Series: A Survey Siva Rama Krishna Kottapalli Karthik Hubli Sandeep Chandrashekhara Garima Jain Sunayana Hubli Gayathri Botla Ramesh Doddaiah AI4TS AI4CE 27 0 0 05 Apr 2025
Simultaneous Learning of Optimal Transports for Training All-to-All Flow-Based Condition Transfer Model Kotaro Ikeda Masanori Koyama Jinzhe Zhang Kohei Hayashi Kenji Fukumizu OT 134 0 0 04 Apr 2025
Know What You do Not Know: Verbalized Uncertainty Estimation Robustness on Corrupted Images in Vision-Language Models Mirko Borszukovszki Ivo Pascal de Jong Matias Valdenegro-Toro 39 0 0 04 Apr 2025
The Use of Gaze-Derived Confidence of Inferred Operator Intent in Adjusting Safety-Conscious Haptic Assistance Jeremy D. Webb Michael Bowman Songpo Li Xiaoli Zhang 34 0 0 04 Apr 2025
Safety Modulation: Enhancing Safety in Reinforcement Learning through Cost-Modulated Rewards Hanping Zhang Yuhong Guo OffRL 38 0 0 03 Apr 2025
Learning Phase Distortion with Selective State Space Models for Video Turbulence Mitigation Xingguang Zhang Nicholas Chimitt Xijun Wang Yu Yuan Stanley H. Chan 36 0 0 03 Apr 2025
EvMic: Event-based Non-contact sound recovery from effective spatial-temporal modeling Hao Yin Shi Guo Xu Jia Xudong XU Lu Zhang Si Liu Dong Wang Huchuan Lu Tianfan Xue 23 0 0 03 Apr 2025
Audio-visual Controlled Video Diffusion with Masked Selective State Spaces Modeling for Natural Talking Head Generation Fa-Ting Hong Zunnan Xu Zixiang Zhou Jun Zhou Xiu Li Qin Lin Qinglin Lu D. Xu DiffM VGen 57 2 0 03 Apr 2025
State-Space Model Inspired Multiple-Input Multiple-Output Spiking Neurons Sanja Karilanova Subhrakanti Dey Ayca Ozcelikkale 43 0 0 03 Apr 2025
Test-Time Alignment for Tracking User Interest Shifts in Sequential Recommendation Changshuo Zhang Xiao Zhang Teng Shi Jun Xu Ji-Rong Wen 35 3 0 02 Apr 2025
FLAMES: A Hybrid Spiking-State Space Model for Adaptive Memory Retention in Event-Based Learning Biswadeep Chakraborty Saibal Mukhopadhyay 47 0 0 02 Apr 2025
ParallelFlow: Parallelizing Linear Transformers via Flow Discretization Nicola Muca Cirone C. Salvi 52 1 0 01 Apr 2025
FDDet: Frequency-Decoupling for Boundary Refinement in Temporal Action Detection Xinnan Zhu Yicheng Zhu Tixin Chen Wentao Wu Yuanjie Dang 49 0 0 01 Apr 2025
Scaling Up Resonate-and-Fire Networks for Fast Deep Learning Thomas E. Huber J. Lecomte Borislav Polovnikov Axel von Arnim 36 0 0 01 Apr 2025
Free Parametrization of L2-bounded State Space Models Leonardo Massai Giancarlo Ferrari-Trecate 37 0 0 31 Mar 2025
COSMO: Combination of Selective Memorization for Low-cost Vision-and-Language Navigation Siqi Zhang Yanyuan Qiao Qunbo Wang Zike Yan Qi Wu Zhihua Wei J. Liu 56 0 0 31 Mar 2025
Efficient Explicit Joint-level Interaction Modeling with Mamba for Text-guided HOI Generation Guohong Huang Ling-an Zeng Zexin Zheng Shengbo Gu Wei-Shi Zheng 39 0 0 29 Mar 2025
Fast Training of Recurrent Neural Networks with Stationary State Feedbacks Paul Caillon Erwan Fagnou Alexandre Allauzen 32 0 0 29 Mar 2025
EdgeInfinite: A Memory-Efficient Infinite-Context Transformer for Edge Devices Jiyu Chen Shuang Peng Daxiong Luo Fan Yang Renshou Wu Fangyuan Li Xiaoxin Chen 46 0 0 28 Mar 2025
Resona: Improving Context Copying in Linear Recurrence Models with Retrieval X. Wang Linrui Ma Jerry Huang Peng Lu Prasanna Parthasarathi Xiao-Wen Chang Boxing Chen Yufei Cui KELM 45 1 0 28 Mar 2025
Low Rank and Sparse Fourier Structure in Recurrent Networks Trained on Modular Addition Akshay Rangamani 40 0 0 28 Mar 2025
vGamba: Attentive State Space Bottleneck for efficient Long-range Dependencies in Visual Recognition Yunusa Haruna A. Lawan Mamba 52 0 0 27 Mar 2025
M-DocSum: Do LVLMs Genuinely Comprehend Interleaved Image-Text in Document Summarization? Haolong Yan Kaijun Tan Yeqing Shen Xin Huang Zheng Ge Xiangyu Zhang Si Li Daxin Jiang VLM 40 0 0 27 Mar 2025
Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmap Tong Nie Jian-jun Sun Wei Ma 66 1 0 27 Mar 2025
A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and Beyond Xiaoye Qu Yafu Li Zhaochen Su Weigao Sun Jianhao Yan ... Chaochao Lu Yue Zhang Xian-Sheng Hua Bowen Zhou Yu Cheng ReLM OffRL LRM 82 14 0 27 Mar 2025
VADMamba: Exploring State Space Models for Fast Video Anomaly Detection Jiahao Lyu Minghua Zhao Jing Hu Xuewen Huang Yifei Chen Shuangli Du Mamba 69 0 0 27 Mar 2025
Exploiting Temporal State Space Sharing for Video Semantic Segmentation Syed Ariff Syed Hesham Yun Liu Guolei Sun Henghui Ding Jing Yang Ender Konukoglu Xue Geng Xudong Jiang 53 1 0 26 Mar 2025
ReverBERT: A State Space Model for Efficient Text-Driven Speech Style Transfer Michael Brown Sofia Martinez Priya Singh 43 0 0 26 Mar 2025
Mamba-3D as Masked Autoencoders for Accurate and Data-Efficient Analysis of Medical Ultrasound Videos Jiaheng Zhou Yanfeng Zhou Wei Fang Yuxing Tang Le Lu Ge Yang Mamba 199 0 0 26 Mar 2025
Cross-Modal State-Space Graph Reasoning for Structured Summarization Hannah Kim Sofia Martinez Jason Lee 49 0 0 26 Mar 2025
EventMamba: Enhancing Spatio-Temporal Locality with State Space Models for Event-Based Video Reconstruction Chengjie Ge Xueyang Fu Peng He Kunyu Wang Chengzhi Cao Zheng-jun Zha Mamba 44 0 0 25 Mar 2025
Prompt-Guided Dual-Path UNet with Mamba for Medical Image Segmentation Shaolei Zhang Jinyan Liu Tianyi Qian Xuesong Li Mamba 48 0 0 25 Mar 2025
Experience Replay Addresses Loss of Plasticity in Continual Learning Jiuqi Wang Rohan Chandra Shangtong Zhang CLL KELM 44 0 0 25 Mar 2025