State-space models are accurate and efficient neural operators for dynamical systems

28 January 2025

Zheyuan Hu

Nazanin Ahmadi Daryakenari

Papers citing "State-space models are accurate and efficient neural operators for dynamical systems"

50 / 55 papers shown

Title
Neuronal Group Communication for Efficient Neural representation Zhengqi Pei Qingming Huang Shuhui Wang 75 0 0 19 Oct 2025
Physics-Informed Machine Learning in Biomedical Science and Engineering Nazanin Ahmadi Qianying Cao J. Humphrey George Karniadakis PINN AI4CE 114 0 0 06 Oct 2025
Merging Memory and Space: A State Space Neural Operator Nodens F. Koren Samuel Lanthaler 194 0 0 31 Jul 2025
Drivetrain simulation using variational autoencoders Pallavi Sharma Jorge-Humberto Urrea-Quintero Bogdan Bogdan Adrian-Dumitru Ciotec Laura Vasilie Henning Wessels Matteo Skull 844 0 0 01 Jul 2025
FMaMIL: Frequency-Driven Mamba Multi-Instance Learning for Weakly Supervised Lesion Segmentation in Medical Images Hangbei Cheng Xiaorong Dong Xueyu Liu Jianan Zhang Xuetao Ma Mingqiang Wei Liansheng Wang Junxin Chen Yongfei Wu Mamba 111 0 0 09 Jun 2025
Comba: Improving Bilinear RNNs with Closed-loop Control Jiaxi Hu Yongqi Pan Jusen Du Disen Lan Xiaqiang Tang Qingsong Wen Yuxuan Liang Weigao Sun 629 0 0 03 Jun 2025
Recurrent Neural Operators: Stable Long-Term PDE Prediction Zaijun Ye Chen-Song Zhang Wansheng Wang AI4CE 206 1 0 27 May 2025
Latent Mamba Operator for Partial Differential Equations Karn Tiwari Niladri Dutta N. M. A. Krishnan P. PrathoshA Mamba AI4CE 259 0 0 25 May 2025
GeoMaNO: Geometric Mamba Neural Operator for Partial Differential Equations Xi Han Jingwei Zhang Dimitris Samaras Fei Hou Hong Qin AI4CE 248 1 0 17 May 2025
Learning to Dissipate Energy in Oscillatory State-Space Models Jared Boyer T. Konstantin Rusch Daniela Rus 256 1 0 17 May 2025
Block-Biased Mamba for Long-Range Sequence Processing Annan Yu N. Benjamin Erichson Mamba 279 2 0 13 May 2025
Observability conditions for neural state-space models with eigenvalues and their roots of unity Andrew Gracyk 1.0K 0 0 22 Apr 2025
Sub-Sequential Physics-Informed Learning with State Space Model Chenhui Xu Dancheng Liu Yuting Hu Jiajie Li Ruiyang Qin Qingxiao Zheng Jinjun Xiong AI4CE PINN 991 5 0 01 Feb 2025
Automatic selection of the best neural architecture for time series forecasting via multi-objective optimization and Pareto optimality conditions Qianying Cao Shanqing Liu Alan John Varghese Jérome Darbon M. Triantafyllou George Karniadakis AI4TS 909 2 0 21 Jan 2025
Oscillatory State-Space ModelsInternational Conference on Learning Representations (ICLR), 2024 T. Konstantin Rusch Daniela Rus AI4TS 789 21 0 04 Oct 2024
Mamba Neural Operator: Who Wins? Transformers vs. State-Space Models for PDEs Chun-Wun Cheng Jiahao Huang Yi Zhang Guang Yang Carola-Bibiane Schonlieb Angelica I Aviles-Rivero Mamba AI4CE 304 11 0 03 Oct 2024
CMINNs: Compartment Model Informed Neural Networks -- Unlocking Drug Dynamics Nazanin Ahmadi Daryakenari Shupeng Wang George Karniadakis 766 12 0 19 Sep 2024
Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality Tri Dao Albert Gu Mamba 365 969 0 31 May 2024
Transformers as Neural Operators for Solutions of Differential Equations with Finite Regularity Benjamin Shih Ahmad Peyvan Zhongqiang Zhang George Karniadakis AI4CE 154 29 0 29 May 2024
Mamba: Linear-Time Sequence Modeling with Selective State Spaces Albert Gu Tri Dao Mamba 482 4,867 0 01 Dec 2023
Tackling the Curse of Dimensionality with Physics-Informed Neural NetworksNeural Networks (Neural Netw.), 2023 Zheyuan Hu K. Shukla George Karniadakis Kenji Kawaguchi PINN AI4CE 674 161 0 23 Jul 2023
Retentive Network: A Successor to Transformer for Large Language Models Yutao Sun Li Dong Shaohan Huang Shuming Ma Yuqing Xia Jilong Xue Jianyong Wang Furu Wei LRM 645 493 0 17 Jul 2023
HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide ResolutionNeural Information Processing Systems (NeurIPS), 2023 Eric N. D. Nguyen Michael Poli Marjan Faizi A. Thomas Callum Birch-Sykes ... Stefano Massaroli Yoshua Bengio Stefano Ermon S. Baccus Christopher Ré MedIm 247 377 0 27 Jun 2023
RWKV: Reinventing RNNs for the Transformer EraConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Bo Peng Eric Alcaide Quentin G. Anthony Alon Albalak Samuel Arcadinho ... Qihang Zhao P. Zhou Qinghua Zhou Jian Zhu Rui-Jie Zhu 518 809 0 22 May 2023
Neural Operator Learning for Long-Time Integration in Dynamical Systems with Recurrent Neural NetworksIEEE International Joint Conference on Neural Network (IJCNN), 2023 K. Michałowska S. Goswami George Karniadakis S. Riemer-Sørensen AI4CE 271 28 0 03 Mar 2023
GNOT: A General Neural Operator Transformer for Operator LearningInternational Conference on Machine Learning (ICML), 2023 Zhongkai Hao Zhengyi Wang Hang Su Chengyang Ying Yinpeng Dong Songming Liu Ze Cheng Jian Song Jun Zhu AI4CE 251 282 0 28 Feb 2023
Learning stiff chemical kinetics using extended deep neural operatorsComputer Methods in Applied Mechanics and Engineering (CMAME), 2023 S. Goswami Ameya Dilip Jagtap H. Babaee Bryan T. Susi George Karniadakis AI4CE 288 58 0 23 Feb 2023
Hyena Hierarchy: Towards Larger Convolutional Language ModelsInternational Conference on Machine Learning (ICML), 2023 Michael Poli Stefano Massaroli Eric Q. Nguyen Daniel Y. Fu Tri Dao S. Baccus Yoshua Bengio Stefano Ermon Christopher Ré VLM 495 407 0 21 Feb 2023
Deep neural operators can serve as accurate surrogates for shape optimization: A case study for airfoils K. Shukla Vivek Oommen Ahmad Peyvan Michael Penwarden L. Bravo A. Ghoshal Robert M. Kirby George Karniadakis 197 22 0 02 Feb 2023
Hungry Hungry Hippos: Towards Language Modeling with State Space ModelsInternational Conference on Learning Representations (ICLR), 2022 Daniel Y. Fu Tri Dao Khaled Kamal Saab A. Thomas Atri Rudra Christopher Ré 346 543 0 28 Dec 2022
Reliable extrapolation of deep neural operators informed by physics or sparse observationsSocial Science Research Network (SSRN), 2022 Min Zhu Handi Zhang Anran Jiao George Karniadakis Lu Lu 227 123 0 13 Dec 2022
Augmented Physics-Informed Neural Networks (APINNs): A gating network-based soft domain decomposition methodologyEngineering applications of artificial intelligence (EAAI), 2022 Zheyuan Hu Ameya Dilip Jagtap George Karniadakis Kenji Kawaguchi 246 112 0 16 Nov 2022
Physics-Informed Deep Neural Operator Networks S. Goswami Aniruddha Bora Yue Yu George Karniadakis PINN AI4CE 245 152 0 08 Jul 2022
Long Range Language Modeling via Gated State SpacesInternational Conference on Learning Representations (ICLR), 2022 Harsh Mehta Ankit Gupta Ashok Cutkosky Behnam Neyshabur Mamba 411 326 0 27 Jun 2022
Transformer for Partial Differential Equations' Operator Learning Zijie Li Kazem Meidani A. Farimani 295 242 0 26 May 2022
Physics guided neural networks for modelling of non-linear dynamicsNeural Networks (NN), 2022 Haakon Robinson Suraj Pawar Adil Rasheed Omer San PINN AI4TS AI4CE 143 64 0 13 May 2022
Efficiently Modeling Long Sequences with Structured State SpacesInternational Conference on Learning Representations (ICLR), 2021 Albert Gu Karan Goel Christopher Ré 858 2,723 0 31 Oct 2021
Learning Dissipative Dynamics in Chaotic Systems Zong-Yi Li Miguel Liu-Schiaffini Nikola B. Kovachki Burigede Liu Kamyar Azizzadenesheli K. Bhattacharya Andrew M. Stuart Anima Anandkumar AI4CE 258 41 0 13 Jun 2021
Choose a Transformer: Fourier or GalerkinNeural Information Processing Systems (NeurIPS), 2021 Shuhao Cao 297 328 0 31 May 2021
Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsIEEE International Conference on Computer Vision (ICCV), 2021 Ze Liu Yutong Lin Yue Cao Han Hu Yixuan Wei Zheng Zhang Stephen Lin B. Guo ViT 1.2K 27,575 0 25 Mar 2021
Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetsScience Advances (Sci Adv), 2021 Sizhuang He Hanwen Wang P. Perdikaris AI4CE 315 871 0 19 Mar 2021
Fourier Neural Operator for Parametric Partial Differential EquationsInternational Conference on Learning Representations (ICLR), 2020 Zong-Yi Li Nikola B. Kovachki Kamyar Azizzadenesheli Burigede Liu K. Bhattacharya Andrew M. Stuart Anima Anandkumar AI4CE 1.1K 3,194 0 18 Oct 2020
Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention Angelos Katharopoulos Apoorv Vyas Nikolaos Pappas Franccois Fleuret 628 2,235 0 29 Jun 2020
Language Models are Few-Shot LearnersNeural Information Processing Systems (NeurIPS), 2020 Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 1.9K 51,131 0 28 May 2020
Physics-Incorporated Convolutional Recurrent Neural Networks for Source Identification and Forecasting of Dynamical SystemsNeural Networks (NN), 2020 Priyabrata Saha Saurabh Dash Saibal Mukhopadhyay AI4CE 215 37 0 14 Apr 2020
Backpropagation Algorithms and Reservoir Computing in Recurrent Neural Networks for the Forecasting of Complex Spatiotemporal DynamicsNeural Networks (NN), 2019 Pantelis R. Vlachas Jaideep Pathak Brian R. Hunt T. Sapsis M. Girvan Edward Ott Petros Koumoutsakos AI4TS 249 439 0 09 Oct 2019
DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorsNature Machine Intelligence (NMI), 2019 Lu Lu Pengzhan Jin George Karniadakis 918 2,799 0 08 Oct 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 2.8K 106,604 0 11 Oct 2018
Can recurrent neural networks warp time? Corentin Tallec Yann Ollivier CLL AI4CE 292 149 0 23 Mar 2018
Attention Is All You NeedNeural Information Processing Systems (NeurIPS), 2017 Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 2.4K 157,616 0 12 Jun 2017