Lipschitz Recurrent Neural Networks

22 June 2020

Papers citing "Lipschitz Recurrent Neural Networks"

50 / 74 papers shown

Title
Block-Biased Mamba for Long-Range Sequence Processing Annan Yu N. Benjamin Erichson Mamba 35 0 0 13 May 2025
HadamRNN: Binary and Sparse Ternary Orthogonal RNNs Armand Foucault Franck Mamalet François Malgouyres MQ 74 0 0 28 Jan 2025
A Deep State Space Model for Rainfall-Runoff Simulations Yihan Wang Lujun Zhang Annan Yu N. Benjamin Erichson Tiantian Yang 47 1 0 28 Jan 2025
Deep Loss Convexification for Learning Iterative Models Ziming Zhang Yuping Shao Yiqing Zhang Fangzhou Lin Haichong K. Zhang Elke Rundensteiner 3DPC 36 0 0 16 Nov 2024
Utilizing Image Transforms and Diffusion Models for Generative Modeling of Short and Long Time Series Ilan Naiman Nimrod Berman Itai Pemper Idan Arbiv Gal Fadlon Omri Azencot 32 11 0 25 Oct 2024
Tuning Frequency Bias of State Space Models Annan Yu Dongwei Lyu S. H. Lim Michael W. Mahoney N. Benjamin Erichson 38 2 0 02 Oct 2024
Unconditional stability of a recurrent neural circuit implementing divisive normalization Shivang Rawat David J. Heeger Stefano Martiniani 19 0 0 27 Sep 2024
A Diagonal Structured State Space Model on Loihi 2 for Efficient Streaming Sequence Processing Svea Marie Meyer Philipp Weidel Philipp Plank L. Campos-Macias Sumit Bam Shrestha Philipp Stratmann M. R 36 4 0 23 Sep 2024
Reparameterized Multi-Resolution Convolutions for Long Sequence Modelling Harry Jake Cunningham Giorgio Giannone Mingtian Zhang M. Deisenroth 28 0 0 18 Aug 2024
Sequential Disentanglement by Extracting Static Information From A Single Sequence Element Nimrod Berman Ilan Naiman Idan Arbiv Gal Fadlon Omri Azencot CoGe 34 4 0 26 Jun 2024
Short-Long Convolutions Help Hardware-Efficient Linear Attention to Focus on Long Sequences Zicheng Liu Siyuan Li Li Wang Zedong Wang Yunfan Liu Stan Z. Li 33 7 0 12 Jun 2024
Rough Transformers: Lightweight and Continuous Time Series Modelling through Signature Patching Fernando Moreno-Pino Alvaro Arroyo H. Waldon Xiaowen Dong Álvaro Cartea AI4TS 32 1 0 31 May 2024
WaveCastNet: An AI-enabled Wavefield Forecasting Framework for Earthquake Early Warning Dongwei Lyu R. Nakata Pu Ren Michael W. Mahoney A. Pitarka Nori Nakata N. Benjamin Erichson 33 2 0 30 May 2024
Exploiting Chaotic Dynamics as Deep Neural Networks Shuhong Liu Nozomi Akashi Qingyao Huang Yasuo Kuniyoshi Kohei Nakajima 25 3 0 29 May 2024
LongVQ: Long Sequence Modeling with Vector Quantization on Structured Memory Zicheng Liu Li Wang Siyuan Li Zedong Wang Haitao Lin Stan Z. Li VLM 27 4 0 17 Apr 2024
Quantized Approximately Orthogonal Recurrent Neural Networks Armand Foucault Franck Mamalet Franccois Malgouyres MQ 13 1 0 05 Feb 2024
Input Convex Lipschitz RNN: A Fast and Robust Approach for Engineering Tasks Zihao Wang Zhen Wu 18 3 0 15 Jan 2024
Gradient Flossing: Improving Gradient Descent through Dynamic Control of Jacobians Rainer Engelken 8 5 0 28 Dec 2023
Delayed Memory Unit: Modelling Temporal Dependency Through Delay Gate Pengfei Sun Jibin Wu Malu Zhang P. Devos Dick Botteldooren 11 5 0 23 Oct 2023
Leveraging Low-Rank and Sparse Recurrent Connectivity for Robust Closed-Loop Control Neehal Tumma Mathias Lechner Noel Loo Ramin Hasani Daniela Rus 27 0 0 05 Oct 2023
Robustifying State-space Models for Long Sequences via Approximate Diagonalization Annan Yu Arnur Nigmetov Dmitriy Morozov Michael W. Mahoney N. Benjamin Erichson 19 10 0 02 Oct 2023
Contraction Properties of the Global Workspace Primitive Michaela Ennis L. Kozachkov Jean-Jacques E. Slotine 19 0 0 02 Oct 2023
A Unified Framework for Generative Data Augmentation: A Comprehensive Survey Yunhao Chen Zihui Yan Yunjie Zhu 29 3 0 30 Sep 2023
Traveling Waves Encode the Recent Past and Enhance Sequence Learning Thomas Anderson Keller L. Muller T. Sejnowski Max Welling AI4TS 28 13 0 03 Sep 2023
Persistent learning signals and working memory without continuous attractors Il Memming Park Ábel Ságodi Piotr Sokól 13 8 0 24 Aug 2023
Robustness Analysis of Continuous-Depth Models with Lagrangian Techniques Sophie A. Neubauer Radu Grosu 18 0 0 23 Aug 2023
Fading memory as inductive bias in residual recurrent networks I. Dubinin Felix Effenberger 38 4 0 27 Jul 2023
Physics-Informed Machine Learning for Modeling and Control of Dynamical Systems Truong X. Nghiem Ján Drgoňa Colin N. Jones Zoltán Nagy Roland Schwan ... J. Paulson Andrea Carron M. Zeilinger Wenceslao Shaw-Cortez D. Vrabie PINN AI4CE 32 30 0 24 Jun 2023
Generalized Teacher Forcing for Learning Chaotic Dynamics Florian Hess Zahra Monfared Manuela Brenner Daniel Durstewitz AI4CE 27 30 0 07 Jun 2023
Neural Differential Recurrent Neural Network with Adaptive Time Steps Yixuan Tan Liyan Xie Xiuyuan Cheng AI4TS 11 5 0 02 Jun 2023
Sequence Modeling with Multiresolution Convolutional Memory Jiaxin Shi Ke Alexander Wang E. Fox 34 13 0 02 May 2023
Resurrecting Recurrent Neural Networks for Long Sequences Antonio Orvieto Samuel L. Smith Albert Gu Anushan Fernando Çağlar Gülçehre Razvan Pascanu Soham De 88 265 0 11 Mar 2023
Estimating Treatment Effects from Irregular Time Series Observations with Hidden Confounders Defu Cao James Enouen Yujing Wang Xiangchen Song Chuizheng Meng Hao Niu Yan Liu CML 30 21 0 04 Mar 2023
Some Fundamental Aspects about Lipschitz Continuity of Neural Networks Grigory Khromov Sidak Pal Singh 24 7 0 21 Feb 2023
Estimating Treatment Effects in Continuous Time with Hidden Confounders Defu Cao James Enouen Y. Liu CML 35 2 0 19 Feb 2023
Gated Recurrent Neural Networks with Weighted Time-Delay Feedback N. Benjamin Erichson S. H. Lim Michael W. Mahoney 13 6 0 01 Dec 2022
Modeling Multivariate Biosignals With Graph Neural Networks and Structured State Space Models Siyi Tang Jared A. Dunnmon Liangqiong Qu Khaled Kamal Saab T. Baykaner Christopher Lee-Messer D. Rubin 22 21 0 21 Nov 2022
Flipped Classroom: Effective Teaching for Time Series Forecasting P. Teutsch Patrick Mäder AI4TS 21 8 0 17 Oct 2022
Fast Saturating Gate for Learning Long Time Scales with Recurrent Neural Networks Kentaro Ohno Sekitoshi Kanai Yasutoshi Ida 13 0 0 04 Oct 2022
Random orthogonal additive filters: a solution to the vanishing/exploding gradient of deep neural networks Andrea Ceni ODL 15 3 0 03 Oct 2022
Liquid Structural State-Space Models Ramin Hasani Mathias Lechner Tsun-Hsuan Wang Makram Chahine Alexander Amini Daniela Rus AI4TS 97 95 0 26 Sep 2022
On the Parameterization and Initialization of Diagonal State Space Models Albert Gu Ankit Gupta Karan Goel Christopher Ré 14 297 0 23 Jun 2022
Improving the Diagnosis of Psychiatric Disorders with Self-Supervised Graph State Space Models A. E. Gazzar R. Thomas G. Wingen AI4MH 11 6 0 07 Jun 2022
Path Development Network with Finite-dimensional Lie Group Representation Han Lou Siran Li Hao Ni 11 7 0 02 Apr 2022
projUNN: efficient method for training deep networks with unitary matrices B. Kiani Randall Balestriero Yann LeCun S. Lloyd 36 32 0 10 Mar 2022
Learning continuous models for continuous physics Aditi S. Krishnapriyan A. Queiruga N. Benjamin Erichson Michael W. Mahoney AI4CE 21 32 0 17 Feb 2022
Efficiently Modeling Long Sequences with Structured State Spaces Albert Gu Karan Goel Christopher Ré 22 1,648 0 31 Oct 2021
Cluster-and-Conquer: A Framework For Time-Series Forecasting Reese Pathak Rajat Sen Nikhil S. Rao N. Benjamin Erichson Michael I. Jordan Inderjit S. Dhillon AI4TS 13 2 0 26 Oct 2021
Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layers Albert Gu Isys Johnson Karan Goel Khaled Kamal Saab Tri Dao Atri Rudra Christopher Ré 32 546 0 26 Oct 2021
FlexConv: Continuous Kernel Convolutions with Differentiable Kernel Sizes David W. Romero Robert-Jan Bruintjes Jakub M. Tomczak Erik J. Bekkers Mark Hoogendoorn J. C. V. Gemert 80 81 0 15 Oct 2021