Learning Long Term Dependencies via Fourier Recurrent Units

Learning Long Term Dependencies via Fourier Recurrent Units

17 March 2018

Inderjit S. Dhillon

ArXiv (abs)PDF HTML

Papers citing "Learning Long Term Dependencies via Fourier Recurrent Units"

19 / 19 papers shown

Title
Vim-F: Visual State Space Model Benefiting from Learning in the Frequency Domain Juntao Zhang Kun Bian Peng Cheng You Zhou Jianning Liu Wenbo An Jun Zhou Kun Shao Mamba 124 3 0 08 Jan 2025
Fourier-RNNs for Modelling Noisy Physics Data Vignesh Gopakumar Stanislas Pamela L. Zanisi AI4TS 62 2 0 13 Feb 2023
Fast-FNet: Accelerating Transformer Encoder Models via Efficient Fourier Layers Nurullah Sevim Ege Ozan Özyedek Furkan Şahinuç Aykut Koç 72 12 0 26 Sep 2022
FiLM: Frequency improved Legendre Memory Model for Long-term Time Series Forecasting Tian Zhou Ziqing Ma Xue Wang Qingsong Wen Liang Sun Tao Yao Wotao Yin Rong Jin AI4TS 186 187 0 18 May 2022
Oscillatory Fourier Neural Network: A Compact and Efficient Architecture for Sequential Processing Bing Han Cheng Wang Kaushik Roy 51 7 0 14 Sep 2021
Energy time series forecasting-Analytical and empirical assessment of conventional and machine learning models Hala Hamdoun A. Sagheer Hassan A. Youness AI4TS 47 12 0 24 Aug 2021
FNet: Mixing Tokens with Fourier Transforms James Lee-Thorp Joshua Ainslie Ilya Eckstein Santiago Ontanon 123 533 0 09 May 2021
Language Through a Prism: A Spectral Approach for Multiscale Language Representations Alex Tamkin Dan Jurafsky Noah D. Goodman 86 45 0 09 Nov 2020
Recurrent Conditional Heteroskedasticity T.-N. Nguyen Minh-Ngoc Tran Robert Kohn BDL 59 11 0 25 Oct 2020
RNN Training along Locally Optimal Trajectories via Frank-Wolfe Algorithm Yun Yue Ming Li Venkatesh Saligrama Ziming Zhang 46 4 0 12 Oct 2020
HiPPO: Recurrent Memory with Optimal Polynomial Projections Albert Gu Tri Dao Stefano Ermon Atri Rudra Christopher Ré 139 543 0 17 Aug 2020
Deep Independently Recurrent Neural Network (IndRNN) Shuai Li Wanqing Li Chris Cook Yanbo Gao 66 51 0 11 Oct 2019
Multiresolution Transformer Networks: Recurrence is Not Essential for Modeling Hierarchical Structure Vikas Garg Inderjit S. Dhillon Hsiang-Fu Yu 55 7 0 27 Aug 2019
Streaming Adaptation of Deep Forecasting Models using Adaptive Recurrent Units Prathamesh Deshpande Sunita Sarawagi AI4TS AI4CE 45 12 0 24 Jun 2019
Population-based Global Optimisation Methods for Learning Long-term Dependencies with RNNs Bryan Lim S. Zohren Stephen J. Roberts 15 2 0 23 May 2019
AntisymmetricRNN: A Dynamical System View on Recurrent Neural Networks B. Chang Minmin Chen E. Haber Ed H. Chi PINN GNN 117 207 0 26 Feb 2019
A Convergence Theory for Deep Learning via Over-Parameterization Zeyuan Allen-Zhu Yuanzhi Li Zhao Song AI4CE ODL 301 1,470 0 09 Nov 2018
On the Convergence Rate of Training Recurrent Neural Networks Zeyuan Allen-Zhu Yuanzhi Li Zhao Song 232 192 0 29 Oct 2018
h-detach: Modifying the LSTM Gradient Towards Better Optimization Devansh Arpit Bhargav Kanuparthi Giancarlo Kerg Nan Rosemary Ke Ioannis Mitliagkas Yoshua Bengio 103 32 0 06 Oct 2018