Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1504.00941
Cited By
v1
v2 (latest)
A Simple Way to Initialize Recurrent Networks of Rectified Linear Units
3 April 2015
Quoc V. Le
Navdeep Jaitly
Geoffrey E. Hinton
ODL
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"A Simple Way to Initialize Recurrent Networks of Rectified Linear Units"
50 / 353 papers shown
Recognizing Video Events with Varying Rhythms
Yikang Li
Tianshu Yu
Baoxin Li
88
4
0
14 Jan 2020
On the Initialization of Long Short-Term Memory Networks
International Conference on Neural Information Processing (ICONIP), 2019
Mostafa Mehdipour-Ghazi
Mads Nielsen
A. Pai
Marc Modat
M. Jorge Cardoso
Sebastien Ourselin
Lauge Sørensen
ODL
85
15
0
22 Dec 2019
Contracting Implicit Recurrent Neural Networks: Stable Models with Improved Trainability
Conference on Learning for Dynamics & Control (L4DC), 2019
Max Revay
I. Manchester
192
46
0
22 Dec 2019
Gating Revisited: Deep Multi-layer RNNs That Can Be Trained
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2019
Mehmet Özgür Türkoglu
Stefano Dáronco
Jan Dirk Wegner
Konrad Schindler
447
60
0
25 Nov 2019
Thick-Net: Parallel Network Structure for Sequential Modeling
Yu-Xuan Li
Jin-Yuan Liu
Liang Li
Xiang Guan
131
0
0
19 Nov 2019
Eigenvalue Normalized Recurrent Neural Networks for Short Term Memory
AAAI Conference on Artificial Intelligence (AAAI), 2019
Kyle E. Helfrich
Qiang Ye
199
7
0
18 Nov 2019
Constructing Gradient Controllable Recurrent Neural Networks Using Hamiltonian Dynamics
Konstantin Rusch
J. Pearson
K. Zygalakis
209
0
0
11 Nov 2019
On Architectures for Including Visual Information in Neural Language Models for Image Description
Marc Tanti
Albert Gatt
K. Camilleri
VLM
138
2
0
09 Nov 2019
On Generalization Bounds of a Family of Recurrent Neural Networks
International Conference on Artificial Intelligence and Statistics (AISTATS), 2018
Minshuo Chen
Xingguo Li
T. Zhao
251
78
0
28 Oct 2019
HUBERT Untangles BERT to Improve Transfer across NLP Tasks
M. Moradshahi
Hamid Palangi
M. Lam
P. Smolensky
Jianfeng Gao
332
18
0
25 Oct 2019
Improving the Gating Mechanism of Recurrent Neural Networks
International Conference on Machine Learning (ICML), 2019
Albert Gu
Çağlar Gülçehre
T. Paine
Matthew W. Hoffman
Razvan Pascanu
AI4CE
183
2
0
22 Oct 2019
Facial Emotion Recognition using Convolutional Neural Networks
Akash Saravanan
Gurudutt Perichetla
K. Gayathri
CVBM
64
101
0
12 Oct 2019
Deep Independently Recurrent Neural Network (IndRNN)
Shuai Li
Wanqing Li
Chris Cook
Yanbo Gao
203
53
0
11 Oct 2019
Identifying nonlinear dynamical systems with multiple time scales and long-range dependencies
Dominik Schmidt
G. Koppe
Zahra Monfared
Max Beutelspacher
Daniel Durstewitz
AI4CE
298
7
0
08 Oct 2019
Trivializations for Gradient-Based Optimization on Manifolds
Neural Information Processing Systems (NeurIPS), 2019
Mario Lezcano Casado
250
144
0
20 Sep 2019
Generating Accurate Pseudo-labels in Semi-Supervised Learning and Avoiding Overconfident Predictions via Hermite Polynomial Activations
Computer Vision and Pattern Recognition (CVPR), 2019
Vishnu Suresh Lokhande
Songwong Tasneeyapant
Abhay Venkatesh
Sathya Ravi
Vikas Singh
150
30
0
12 Sep 2019
An Adaptive Stochastic Nesterov Accelerated Quasi Newton Method for Training RNNs
S. Indrapriyadarsini
Shahrzad Mahboubi
H. Ninomiya
H. Asai
ODL
52
3
0
09 Sep 2019
EleAtt-RNN: Adding Attentiveness to Neurons in Recurrent Neural Networks
IEEE Transactions on Image Processing (TIP), 2019
Pengfei Zhang
Jianru Xue
Cuiling Lan
Wenjun Zeng
Zhanning Gao
Nanning Zheng
142
93
0
03 Sep 2019
Self-Knowledge Distillation in Natural Language Processing
Recent Advances in Natural Language Processing (RANLP), 2019
Sangchul Hahn
Heeyoul Choi
251
125
0
02 Aug 2019
Universality and individuality in neural dynamics across large populations of recurrent networks
Neural Information Processing Systems (NeurIPS), 2019
Niru Maheswaranathan
Alex H. Williams
Matthew D. Golub
Surya Ganguli
David Sussillo
248
167
0
19 Jul 2019
R-Transformer: Recurrent Neural Network Enhanced Transformer
Z. Wang
Yao Ma
Zitao Liu
Shucheng Zhou
ViT
178
113
0
12 Jul 2019
Learning World Graphs to Accelerate Hierarchical Reinforcement Learning
Wenling Shang
Alexander R. Trott
Stephan Zheng
Caiming Xiong
R. Socher
194
21
0
01 Jul 2019
Calibration, Entropy Rates, and Memory in Language Models
International Conference on Machine Learning (ICML), 2019
M. Braverman
Xinyi Chen
Sham Kakade
Karthik Narasimhan
Cyril Zhang
Yi Zhang
228
44
0
11 Jun 2019
Exploring weight initialization, diversity of solutions, and degradation in recurrent neural networks trained for temporal and decision-making tasks
Journal of Computational Neuroscience (J Comput Neurosci), 2019
C. Jarne
R. Laje
118
3
0
03 Jun 2019
SHE: A Fast and Accurate Deep Neural Network for Encrypted Data
Neural Information Processing Systems (NeurIPS), 2019
Qian Lou
Lei Jiang
272
139
0
01 Jun 2019
Improved memory in recurrent neural networks with sequential non-normal dynamics
International Conference on Learning Representations (ICLR), 2019
A. Orhan
Xaq Pitkow
203
16
0
31 May 2019
Non-normal Recurrent Neural Network (nnRNN): learning long time dependencies while improving expressivity with transient dynamics
Neural Information Processing Systems (NeurIPS), 2019
Giancarlo Kerg
Kyle Goyette
M. P. Touzel
Gauthier Gidel
Eugene Vorontsov
Yoshua Bengio
Guillaume Lajoie
230
64
0
28 May 2019
Better Long-Range Dependency By Bootstrapping A Mutual Information Regularizer
International Conference on Artificial Intelligence and Statistics (AISTATS), 2019
Yanshuai Cao
Peng Xu
131
2
0
28 May 2019
Impact of facial landmark localization on facial expression recognition
IEEE Transactions on Affective Computing (TAC), 2019
Romain Belmonte
B. Allaert
Pierre Tirilly
Ioan Marius Bilasco
Chaabane Djéraba
Andrii Zadaianchuk
CVBM
125
16
0
26 May 2019
Mapping high-performance RNNs to in-memory neuromorphic chips
M. Nair
Giacomo Indiveri
175
4
0
25 May 2019
Bivariate Beta-LSTM
AAAI Conference on Artificial Intelligence (AAAI), 2019
Kyungwoo Song
Joonho Jang
Seung-Jae Shin
Il-Chul Moon
159
6
0
25 May 2019
The relationship between Biological and Artificial Intelligence
G. Cevora
52
2
0
01 May 2019
Learning Longer-term Dependencies via Grouped Distributor Unit
Wei Luo
Feng Yu
91
2
0
29 Apr 2019
Evaluating Recurrent Neural Network Explanations
L. Arras
Ahmed Osman
K. Müller
Wojciech Samek
XAI
FAtt
286
92
0
26 Apr 2019
Multi-Task Learning for Argumentation Mining
Tobias Kahse
100
4
0
23 Apr 2019
Spatial Attentive Single-Image Deraining with a High Quality Real Rain Dataset
Tianyu Wang
Xin Yang
Ke Xu
Shaozhe Chen
Qiang Zhang
Rynson W. H. Lau
303
619
0
02 Apr 2019
SAC-Net: Spatial Attenuation Context for Salient Object Detection
Xiaowei Hu
Chi-Wing Fu
Lei Zhu
Tianyu Wang
Pheng-Ann Heng
176
66
0
25 Mar 2019
How Large a Vocabulary Does Text Classification Need? A Variational Approach to Vocabulary Selection
North American Chapter of the Association for Computational Linguistics (NAACL), 2019
Wenhu Chen
Yu-Chuan Su
Yilin Shen
Zhiyu Zoey Chen
Xifeng Yan
Wenjie Wang
VLM
319
32
0
27 Feb 2019
AntisymmetricRNN: A Dynamical System View on Recurrent Neural Networks
B. Chang
Minmin Chen
E. Haber
Ed H. Chi
PINN
GNN
342
226
0
26 Feb 2019
Learning to Adaptively Scale Recurrent Neural Networks
Hao Hu
Liqiang Wang
Guo-Jun Qi
AI4CE
134
11
0
15 Feb 2019
On the Variance of Unbiased Online Recurrent Optimization
Tim Cooijmans
James Martens
204
14
0
06 Feb 2019
State-Regularized Recurrent Neural Networks
Cheng Wang
Mathias Niepert
171
42
0
25 Jan 2019
Cheap Orthogonal Constraints in Neural Networks: A Simple Parametrization of the Orthogonal and Unitary Group
Mario Lezcano Casado
David Martínez-Rubio
283
219
0
24 Jan 2019
Towards Non-saturating Recurrent Units for Modelling Long-term Dependencies
A. Chandar
Chinnadhurai Sankar
Eugene Vorontsov
Samira Ebrahimi Kahou
Yoshua Bengio
218
61
0
22 Jan 2019
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context
Zihang Dai
Zhilin Yang
Yiming Yang
J. Carbonell
Quoc V. Le
Ruslan Salakhutdinov
VLM
779
4,131
0
09 Jan 2019
FastGRNN: A Fast, Accurate, Stable and Tiny Kilobyte Sized Gated Recurrent Neural Network
Aditya Kusupati
Manish Singh
Kush S. Bhatia
A. Kumar
Prateek Jain
Manik Varma
208
198
0
08 Jan 2019
Learning to Remember More with Less Memorization
Hung Le
T. Tran
Svetha Venkatesh
143
39
0
05 Jan 2019
Bayesian Sparsification of Gated Recurrent Neural Networks
E. Lobacheva
Nadezhda Chirkova
Dmitry Vetrov
BDL
125
2
0
12 Dec 2018
Zero Initialization of modified Gated Recurrent Encoder-Decoder Network for Short Term Load Forecasting
Vedanshu
M. M. Tripathi
AI4TS
AI4CE
55
2
0
09 Dec 2018
The PyTorch-Kaldi Speech Recognition Toolkit
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2018
Mirco Ravanelli
Titouan Parcollet
Yoshua Bengio
VLM
OffRL
161
234
0
19 Nov 2018
Previous
1
2
3
4
5
6
7
8
Next
Page 4 of 8
