Parallelizing non-linear sequential models over the sequence length

Parallelizing non-linear sequential models over the sequence length

21 September 2023

Joshua Selfridge

Papers citing "Parallelizing non-linear sequential models over the sequence length"

14 / 14 papers shown

Title
It's All Connected: A Journey Through Test-Time Memorization, Attentional Bias, Retention, and Online Optimization Ali Behrouz Meisam Razaviyayn Peilin Zhong Vahab Mirrokni 36 0 0 17 Apr 2025
PCM : Picard Consistency Model for Fast Parallel Sampling of Diffusion Models Junhyuk So Jiwoong Shin Chaeyeon Jang Eunhyeok Park DiffM 48 0 0 25 Mar 2025
Fixed-Point RNNs: From Diagonal to Dense in a Few Iterations Sajad Movahedi Felix Sarnthein Nicola Muca Cirone Antonio Orvieto 46 2 0 13 Mar 2025
Towards Scalable and Stable Parallelization of Nonlinear RNNs Xavier Gonzalez Andrew Warrington Jimmy T.H. Smith Scott W. Linderman 83 8 0 17 Jan 2025
Unlocking State-Tracking in Linear RNNs Through Negative Eigenvalues Riccardo Grazzi Julien N. Siems Jörg K.H. Franke Arber Zela Frank Hutter Massimiliano Pontil 84 11 0 19 Nov 2024
Real-Time Recurrent Learning using Trace Units in Reinforcement Learning Esraa Elelimy Adam White Michael H. Bowling Martha White OffRL 31 2 0 02 Sep 2024
Rethinking Transformers in Solving POMDPs Chenhao Lu Ruizhe Shi Yuyao Liu Kaizhe Hu Simon S. Du Huazhe Xu AI4CE 19 2 0 27 May 2024
Accelerating Parallel Sampling of Diffusion Models Zhiwei Tang Jiasheng Tang Hao Luo Fan Wang Tsung-Hui Chang 30 11 0 15 Feb 2024
Sequence Modeling with Multiresolution Convolutional Memory Jiaxin Shi Ke Alexander Wang E. Fox 34 13 0 02 May 2023
Resurrecting Recurrent Neural Networks for Long Sequences Antonio Orvieto Samuel L. Smith Albert Gu Anushan Fernando Çağlar Gülçehre Razvan Pascanu Soham De 88 265 0 11 Mar 2023
Liquid Structural State-Space Models Ramin Hasani Mathias Lechner Tsun-Hsuan Wang Makram Chahine Alexander Amini Daniela Rus AI4TS 97 95 0 26 Sep 2022
Matching Normalizing Flows and Probability Paths on Manifolds Heli Ben-Hamu Samuel N. Cohen Joey Bose Brandon Amos Aditya Grover Maximilian Nickel Ricky T. Q. Chen Y. Lipman 50 39 0 11 Jul 2022
FlexConv: Continuous Kernel Convolutions with Differentiable Kernel Sizes David W. Romero Robert-Jan Bruintjes Jakub M. Tomczak Erik J. Bekkers Mark Hoogendoorn J. C. V. Gemert 74 81 0 15 Oct 2021
Symplectic Recurrent Neural Networks Zhengdao Chen Jianyu Zhang Martín Arjovsky Léon Bottou 139 219 0 29 Sep 2019