Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1504.00941
Cited By
v1
v2 (latest)
A Simple Way to Initialize Recurrent Networks of Rectified Linear Units
3 April 2015
Quoc V. Le
Navdeep Jaitly
Geoffrey E. Hinton
ODL
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"A Simple Way to Initialize Recurrent Networks of Rectified Linear Units"
50 / 353 papers shown
STEP: A Unified Spiking Transformer Evaluation Platform for Fair and Reproducible Benchmarking
Sicheng Shen
Dongcheng Zhao
Linghao Feng
Zeyang Yue
Jindong Li
Tenglong Li
Guobin Shen
Yi Zeng
245
2
0
24 Dec 2025
Parallel Delayed Memory Units for Enhanced Temporal Modeling in Biomedical and Bioacoustic Signal Analysis
IEEE Transactions on Audio, Speech, and Language Processing (TASLP), 2025
Pengfei Sun
Wenyu Jiang
P. Devos
Dick Botteldooren
81
1
0
01 Dec 2025
EchoLSTM: A Self-Reflective Recurrent Network for Stabilizing Long-Range Memory
Prasanth K K
Shubham Sharma
KELM
141
0
0
03 Nov 2025
Hybrid Quantum-Classical Recurrent Neural Networks
Wenduan Xu
165
0
0
29 Oct 2025
Dale meets Langevin: A Multiplicative Denoising Diffusion Model
Nishanth Shetty
Madhava Prasath
C. Seelamantula
DiffM
193
0
0
03 Oct 2025
Dendritic Resonate-and-Fire Neuron for Effective and Efficient Long Sequence Modeling
Dehao Zhang
Malu Zhang
Shuai Wang
Jingya Wang
Wenjie Wei
Zeyu Ma
Guoqing Wang
Yang Yang
Haizhou Li
196
2
0
21 Sep 2025
Weight-Space Linear Recurrent Neural Networks
Roussel Desmond Nzoyem
Nawid Keshtmand
Enrique Crespo Fernandez
Idriss Tsayem
Raúl Santos-Rodríguez
David A.W. Barton
Tom Deakin
340
1
0
01 Jun 2025
Revisiting Glorot Initialization for Long-Range Linear Recurrences
Noga Bar
Mariia Seleznova
Yotam Alexander
Gitta Kutyniok
Raja Giryes
171
0
0
26 May 2025
Can Local Representation Alignment RNNs Solve Temporal Tasks?
Nikolay Manchev
Luis C. Garcia-Peraza-Herrera
AI4TS
340
0
0
18 Apr 2025
Bidirectional Linear Recurrent Models for Sequence-Level Multisource Fusion
Qisai Liu
Zhanhong Jiang
Joshua R. Waite
Chao Liu
Aditya Balu
Soumik Sarkar
AI4TS
240
0
0
11 Apr 2025
A Good Start Matters: Enhancing Continual Learning with Data-Driven Weight Initialization
Md Yousuf Harun
Christopher Kanan
AI4CE
306
2
0
09 Mar 2025
A Survey on Kolmogorov-Arnold Network
ACM Computing Surveys (ACM CSUR), 2024
Shriyank Somvanshi
Syed Aaqib Javed
Md Monzurul Islam
Diwas Pandit
Subasish Das
AI4TS
AI4CE
358
114
0
09 Nov 2024
Efficiently Training Time-to-First-Spike Spiking Neural Networks from Scratch
Kaiwei Che
Wei Fang
Zhengyu Ma
Li-xin Yuan
T. Masquelier
Yonghong Tian
Timothée Masquelier
Yonghong Tian
132
0
0
31 Oct 2024
Unitary convolutions for learning on graphs and groups
Neural Information Processing Systems (NeurIPS), 2024
B. Kiani
Lukas Fesser
Melanie Weber
GNN
298
4
0
07 Oct 2024
SPikE-SSM: A Sparse, Precise, and Efficient Spiking State Space Model for Long Sequences Learning
Yan Zhong
Ruoyu Zhao
Chao Wang
Qinghai Guo
Jianguo Zhang
Zhichao Lu
Luziwei Leng
236
7
0
07 Oct 2024
Unconditional stability of a recurrent neural circuit implementing divisive normalization
Neural Information Processing Systems (NeurIPS), 2024
Shivang Rawat
David J. Heeger
Stefano Martiniani
481
4
0
27 Sep 2024
SpikingSSMs: Learning Long Sequences with Sparse and Parallel Spiking State Space Models
AAAI Conference on Artificial Intelligence (AAAI), 2024
Shuaijie Shen
Chao Wang
Renzhuo Huang
Yan Zhong
Qinghai Guo
Zhichao Lu
Jianguo Zhang
Luziwei Leng
257
18
0
27 Aug 2024
Obtaining Optimal Spiking Neural Network in Sequence Learning via CRNN-SNN Conversion
International Conference on Artificial Neural Networks (ICANN), 2024
Jiahao Su
Kang You
Zekai Xu
Weizhi Xu
Zhezhi He
262
0
0
18 Aug 2024
Oja's plasticity rule overcomes several challenges of training neural networks under biological constraints
Navid Shervani-Tabar
Marzieh Alireza Mirhoseini
Robert Rosenbaum
AAML
AI4CE
322
1
0
15 Aug 2024
Mamba-Spike: Enhancing the Mamba Architecture with a Spiking Front-End for Efficient Temporal Data Processing
Computer Graphics International Conference (CGI), 2024
Jiahao Qin
Feng Liu
Mamba
183
12
0
04 Aug 2024
The Role of Temporal Hierarchy in Spiking Neural Networks
Filippo Moro
Pau Vilimelis Aceituno
Laura Kriener
Melika Payvand
AI4CE
299
11
0
26 Jul 2024
Deep State Space Recurrent Neural Networks for Time Series Forecasting
Hugo Inzirillo
AI4TS
185
8
0
21 Jul 2024
Geometric sparsification in recurrent neural networks
Wyatt Mackey
Ioannis Schizas
Jared Deighton
David L. Boothe, Jr.
Vasileios Maroulas
199
0
0
10 Jun 2024
Recurrent neural networks: vanishing and exploding gradients are not the end of the story
Nicolas Zucchet
Antonio Orvieto
ODL
AAML
295
42
0
31 May 2024
On the dynamics of convolutional recurrent neural networks near their critical point
Aditi Chandra
M. Magnasco
194
1
0
22 May 2024
TKAN: Temporal Kolmogorov-Arnold Networks
Remi Genet
Hugo Inzirillo
AI4TS
AI4CE
394
139
0
12 May 2024
The Ghanaian NLP Landscape: A First Look
Sheriff Issaka
Zhaoyi Zhang
Mihir Heda
Keyi Wang
Yinka Ajibola
Ryan DeMar
Xuefeng Du
172
7
0
10 May 2024
Graph Expansion in Pruned Recurrent Neural Network Layers Preserve Performance
Suryam Arnav Kalra
Arindam Biswas
Pabitra Mitra
Biswajit Basu
GNN
181
0
0
17 Mar 2024
Efficient Online Learning for Networks of Two-Compartment Spiking Neurons
Yujia Yin
Xinyi Chen
Chenxiang Ma
Jibin Wu
Kay Chen Tan
249
1
0
25 Feb 2024
Universal Neural Functionals
Allan Zhou
Chelsea Finn
James Harrison
250
21
0
07 Feb 2024
Liquid Resistance Liquid Capacitance Networks
Mónika Farsang
Sophie A. Neubauer
Radu Grosu
AI4TS
239
5
0
30 Jan 2024
LMUFormer: Low Complexity Yet Powerful Spiking Model With Legendre Memory Units
International Conference on Learning Representations (ICLR), 2024
Zeyu Liu
Gourav Datta
Anni Li
Peter A. Beerel
231
16
0
20 Jan 2024
E2HQV: High-Quality Video Generation from Event Camera via Theory-Inspired Model-Aided Deep Learning
AAAI Conference on Artificial Intelligence (AAAI), 2024
Qiang Qu
Yiran Shen
Xiaoming Chen
Yuk Ying Chung
Tongliang Liu
VGen
191
16
0
16 Jan 2024
Input Convex Lipschitz RNN: A Fast and Robust Approach for Engineering Tasks
Zihao Wang
Zhe Wu
395
4
0
15 Jan 2024
Face-GPS: A Comprehensive Technique for Quantifying Facial Muscle Dynamics in Videos
Juni Kim
Zhikang Dong
Paweł Polak
CVBM
121
6
0
11 Jan 2024
SutraNets: Sub-series Autoregressive Networks for Long-Sequence, Probabilistic Forecasting
Shane Bergsma
Timothy J. Zeyl
Lei Guo
AI4TS
276
10
0
22 Dec 2023
Learning Long Sequences in Spiking Neural Networks
Scientific Reports (Sci Rep), 2023
Matei Ioan Stan
Oliver Rhodes
196
26
0
14 Dec 2023
Stability-Informed Initialization of Neural Ordinary Differential Equations
International Conference on Machine Learning (ICML), 2023
Theodor Westny
Arman Mohammadi
Daniel Jung
Erik Frisk
420
3
0
27 Nov 2023
Convergence Analysis for Learning Orthonormal Deep Linear Neural Networks
IEEE Signal Processing Letters (IEEE SPL), 2023
Zhen Qin
Xuwei Tan
Zhihui Zhu
327
1
0
24 Nov 2023
Hierarchically Gated Recurrent Neural Network for Sequence Modeling
Zhen Qin
Aaron Courville
Yiran Zhong
196
117
0
08 Nov 2023
NeuroEvoBench: Benchmarking Evolutionary Optimizers for Deep Learning Applications
Neural Information Processing Systems (NeurIPS), 2023
Robert Tjarko Lange
Yujin Tang
Yingtao Tian
ELM
257
4
0
04 Nov 2023
Expanding memory in recurrent spiking networks
Ismael Balafrej
Fabien Alibart
Jean Rouat
194
0
0
29 Oct 2023
Delayed Memory Unit: Modelling Temporal Dependency Through Delay Gate
IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2023
Pengfei Sun
Jibin Wu
Malu Zhang
P. Devos
Dick Botteldooren
243
16
0
23 Oct 2023
Towards Training Without Depth Limits: Batch Normalization Without Gradient Explosion
International Conference on Learning Representations (ICLR), 2023
Alexandru Meterez
Amir Joudaki
Francesco Orabona
Alexander Immer
Gunnar Rätsch
Hadi Daneshmand
201
9
0
03 Oct 2023
Contraction Properties of the Global Workspace Primitive
Michaela Ennis
L. Kozachkov
Jean-Jacques E. Slotine
207
0
0
02 Oct 2023
Federated Learning in Temporal Heterogeneity
Junghwan Lee
FedML
157
0
0
17 Sep 2023
Traveling Waves Encode the Recent Past and Enhance Sequence Learning
International Conference on Learning Representations (ICLR), 2023
Thomas Anderson Keller
L. Muller
T. Sejnowski
Max Welling
AI4TS
365
19
0
03 Sep 2023
Unleashing the Potential of Spiking Neural Networks for Sequential Modeling with Contextual Embedding
Xinyi Chen
Jibin Wu
Huajin Tang
Qinyuan Ren
Kay Chen Tan
222
5
0
29 Aug 2023
Abdominal Multi-Organ Segmentation Based on Feature Pyramid Network and Spatial Recurrent Neural Network
IFAC-PapersOnLine (IFAC-PapersOnLine), 2023
Yu Song
A. Elibol
N. Chong
104
2
0
29 Aug 2023
TC-LIF: A Two-Compartment Spiking Neuron Model for Long-Term Sequential Modelling
AAAI Conference on Artificial Intelligence (AAAI), 2023
Shimin Zhang
Qu Yang
Chenxiang Ma
Jibin Wu
Haizhou Li
Kay Chen Tan
357
40
0
25 Aug 2023
1
2
3
4
5
6
7
8
Next
