Long Range Language Modeling via Gated State Spaces

27 June 2022

Papers citing "Long Range Language Modeling via Gated State Spaces"

41 / 41 papers shown

Title
Image Recognition with Online Lightweight Vision Transformer: A Survey Zherui Zhang Rongtao Xu Jie Zhou Changwei Wang Xingtian Pei ... Jiguang Zhang Li Guo Longxiang Gao W. Xu Shibiao Xu ViT 39 0 0 06 May 2025
SSD-Poser: Avatar Pose Estimation with State Space Duality from Sparse Observations Shuting Zhao Linxin Bai Liangjing Shao Ye Zhang Xinrong Chen 17 0 0 25 Apr 2025
Simultaneous Learning of Optimal Transports for Training All-to-All Flow-Based Condition Transfer Model Kotaro Ikeda Masanori Koyama Jinzhe Zhang Kohei Hayashi Kenji Fukumizu OT 54 0 0 04 Apr 2025
EventMamba: Enhancing Spatio-Temporal Locality with State Space Models for Event-Based Video Reconstruction Chengjie Ge Xueyang Fu Peng He Kunyu Wang Chengzhi Cao Zheng-jun Zha Mamba 44 0 0 25 Mar 2025
From S4 to Mamba: A Comprehensive Survey on Structured State Space Models Shriyank Somvanshi Md Monzurul Islam Mahmuda Sultana Mimi Sazzad Bin Bashar Polock Gaurab Chhetri Subasish Das Mamba AI4TS 37 0 0 22 Mar 2025
MambaIC: State Space Models for High-Performance Learned Image Compression Fanhu Zeng Hao Tang Yihua Shao Siyu Chen Ling Shao Yan Wang Mamba 55 0 0 16 Mar 2025
BioMamba: Leveraging Spectro-Temporal Embedding in Bidirectional Mamba for Enhanced Biosignal Classification Jian Qian Teck Lun Goh Bingyu Xie Chengyao Zhu Biao Wan Yawen Guan Rachel Ding Chen Patrick Chiang Mamba 40 0 0 14 Mar 2025
Spectral State Space Model for Rotation-Invariant Visual Representation Learning Sahar Dastani Ali Bahri Moslem Yazdanpanah Mehrdad Noori David Osowiechi ... Farzad Beizaee Milad Cheraghalikhani A. Mondal H. Lombaert Christian Desrosiers 43 0 0 09 Mar 2025
Future-Aware Interaction Network For Motion Forecasting Shijie Li Xun Xu S. Yeo Xulei Yang Mamba 88 0 0 09 Mar 2025
CardiacMamba: A Multimodal RGB-RF Fusion Framework with State Space Models for Remote Physiological Measurement Zheng Wu Yiping Xie Bo Zhao Jiguang He Fei Luo Ning Deng Zitong Yu Mamba 42 1 0 20 Feb 2025
State-space models are accurate and efficient neural operators for dynamical systems Zheyuan Hu Nazanin Ahmadi Daryakenari Qianli Shen Kenji Kawaguchi George Karniadakis Mamba AI4CE 46 10 0 28 Jan 2025
MambaHSI: Spatial-Spectral Mamba for Hyperspectral Image Classification Yapeng Li Yong Luo L. Zhang Zengmao Wang Bo Du Mamba 52 57 0 10 Jan 2025
VMamba: Visual State Space Model Yue Liu Yunjie Tian Yuzhong Zhao Hongtian Yu Lingxi Xie Yaowei Wang Qixiang Ye Jianbin Jiao Yunfan Liu Mamba 106 592 0 31 Dec 2024
FACTS: A Factored State-Space Framework For World Modelling Li Nanbo Firas Laakom Yucheng Xu Wenyi Wang Jürgen Schmidhuber AI4TS 39 0 0 28 Oct 2024
HASN: Hybrid Attention Separable Network for Efficient Image Super-resolution Weifeng Cao Xiaoyan Lei Jun Shi Wanyong Liang Jie Liu Zongfei Bai SupR 14 0 0 13 Oct 2024
Large Language Model Inference Acceleration: A Comprehensive Hardware Perspective Jinhao Li Jiaming Xu Shan Huang Yonghua Chen Wen Li ... Jiayi Pan Li Ding Hao Zhou Yu Wang Guohao Dai 46 13 0 06 Oct 2024
SkinMamba: A Precision Skin Lesion Segmentation Architecture with Cross-Scale Global State Modeling and Frequency Boundary Guidance Shun Zou Mingya Zhang Bingjian Fan Zhengyi Zhou Xiuguo Zou Mamba 17 3 0 17 Sep 2024
Shuffle Mamba: State Space Models with Random Shuffle for Multi-Modal Image Fusion Ke Cao Xuanhua He Tao Hu Chengjun Xie Jie Zhang Man Zhou Danfeng Hong Mamba 13 3 0 03 Sep 2024
Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Models Aviv Bick Kevin Y. Li Eric P. Xing J. Zico Kolter Albert Gu Mamba 43 24 0 19 Aug 2024
DeciMamba: Exploring the Length Extrapolation Potential of Mamba Assaf Ben-Kish Itamar Zimerman Shady Abu Hussein Nadav Cohen Amir Globerson Lior Wolf Raja Giryes Mamba 56 12 0 20 Jun 2024
MambaLRP: Explaining Selective State Space Sequence Models F. Jafari G. Montavon Klaus-Robert Müller Oliver Eberle Mamba 43 9 0 11 Jun 2024
Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling Liliang Ren Yang Liu Yadong Lu Yelong Shen Chen Liang Weizhu Chen Mamba 64 54 0 11 Jun 2024
LCM: Locally Constrained Compact Point Cloud Model for Masked Point Modeling Yaohua Zha Naiqi Li Yanzi Wang Tao Dai Hang Guo Bin Chen Zhi Wang Zhihao Ouyang Shu-Tao Xia Mamba 37 8 0 27 May 2024
MambaTS: Improved Selective State Space Models for Long-term Time Series Forecasting Xiuding Cai Yaoyao Zhu Xueyao Wang Yu Yao Mamba AI4TS 14 7 0 26 May 2024
3DSS-Mamba: 3D-Spectral-Spatial Mamba for Hyperspectral Image Classification Yan He Bing Tu Bo Liu Jun Li Antonio J. Plaza Mamba 19 23 0 21 May 2024
MambaAD: Exploring State Space Models for Multi-class Unsupervised Anomaly Detection Haoyang He Yuhu Bai Jiangning Zhang Qingdong He Hongxu Chen Zhenye Gan Chengjie Wang Xiangtai Li Guanzhong Tian Lei Xie Mamba 47 32 0 09 Apr 2024
Learning Enriched Features via Selective State Spaces Model for Efficient Image Deblurring Huiyu Gao Depeng Dang 32 13 0 29 Mar 2024
MambaTalk: Efficient Holistic Gesture Synthesis with Selective State Space Models Zunnan Xu Yukang Lin Haonan Han Sicheng Yang Ronghui Li Yachao Zhang Xiu Li Mamba 44 24 0 14 Mar 2024
Orchid: Flexible and Data-Dependent Convolution for Sequence Modeling Mahdi Karami Ali Ghodsi VLM 21 6 0 28 Feb 2024
Investigating Recurrent Transformers with Dynamic Halt Jishnu Ray Chowdhury Cornelia Caragea 32 1 0 01 Feb 2024
Efficiency-oriented approaches for self-supervised speech representation learning Luis Lugo Valentin Vielzeuf SSL 19 1 0 18 Dec 2023
StableSSM: Alleviating the Curse of Memory in State-space Models through Stable Reparameterization Shida Wang Qianxiao Li 6 12 0 24 Nov 2023
Hieros: Hierarchical Imagination on Structured State Space Sequence World Models Paul Mattes Rainer Schlosser R. Herbrich 6 4 0 08 Oct 2023
Transformer-VQ: Linear-Time Transformers via Vector Quantization Albert Mohwald 13 15 0 28 Sep 2023
Plug-and-Play Document Modules for Pre-trained Models Chaojun Xiao Zhengyan Zhang Xu Han Chi-Min Chan Yankai Lin Zhiyuan Liu Xiangyang Li Zhonghua Li Zhao Cao Maosong Sun KELM 16 5 0 28 May 2023
Focus Your Attention (with Adaptive IIR Filters) Shahar Lutati Itamar Zimerman Lior Wolf 19 9 0 24 May 2023
Dialogue-Contextualized Re-ranking for Medical History-Taking Jian Zhu Ilya Valmianski Anitha Kannan 10 1 0 04 Apr 2023
Simple Hardware-Efficient Long Convolutions for Sequence Modeling Daniel Y. Fu Elliot L. Epstein Eric N. D. Nguyen A. Thomas Michael Zhang Tri Dao Atri Rudra Christopher Ré 11 51 0 13 Feb 2023
Transformer Quality in Linear Time Weizhe Hua Zihang Dai Hanxiao Liu Quoc V. Le 71 220 0 21 Feb 2022
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 246 1,982 0 28 Jul 2020
Efficient Content-Based Sparse Attention with Routing Transformers Aurko Roy M. Saffar Ashish Vaswani David Grangier MoE 228 502 0 12 Mar 2020