Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1504.00941
Cited By
v1
v2 (latest)
A Simple Way to Initialize Recurrent Networks of Rectified Linear Units
3 April 2015
Quoc V. Le
Navdeep Jaitly
Geoffrey E. Hinton
ODL
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"A Simple Way to Initialize Recurrent Networks of Rectified Linear Units"
50 / 353 papers shown
Adversarial Frontier Stitching for Remote Neural Network Watermarking
Erwan Le Merrer
P. Pérez
Gilles Trédan
MLAU
AAML
147
376
0
06 Nov 2017
Wider and Deeper, Cheaper and Faster: Tensorized LSTMs for Sequence Learning
Zhen He
Shaobing Gao
Liang Xiao
Daxue Liu
Hangen He
David Barber
AIMat
276
66
0
05 Nov 2017
Network of Recurrent Neural Networks
Chaoming Wang
GNN
86
3
0
10 Oct 2017
Forecasting Across Time Series Databases using Recurrent Neural Networks on Groups of Similar Series: A Clustering Approach
Kasun Bandara
Christoph Bergmeir
Slawek Smyl
AI4TS
122
31
0
09 Oct 2017
Dilated Recurrent Neural Networks
Shiyu Chang
Yang Zhang
Wei Han
Mo Yu
Xiaoxiao Guo
Wei Tan
Xiaodong Cui
Michael Witbrock
M. Hasegawa-Johnson
Thomas S. Huang
305
336
0
05 Oct 2017
Improving speech recognition by revising gated recurrent units
Mirco Ravanelli
Philemon Brakel
M. Omologo
Yoshua Bengio
135
55
0
29 Sep 2017
Shifting Mean Activation Towards Zero with Bipolar Activation Functions
L. Eidnes
Arild Nøkland
194
18
0
12 Sep 2017
RRA: Recurrent Residual Attention for Sequence Learning
Cheng Wang
110
13
0
12 Sep 2017
Simple Recurrent Units for Highly Parallelizable Recurrence
Tao Lei
Yu Zhang
Sida I. Wang
Huijing Dai
Yoav Artzi
LRM
541
295
0
08 Sep 2017
Implicit Regularization in Deep Learning
Behnam Neyshabur
384
159
0
06 Sep 2017
A Simple LSTM model for Transition-based Dependency Parsing
Mohab Elkaref
Bernd Bohnet
160
9
0
29 Aug 2017
Skip RNN: Learning to Skip State Updates in Recurrent Neural Networks
Victor Campos
Brendan Jou
Xavier Giró-i-Nieto
Jordi Torres
Shih-Fu Chang
290
227
0
22 Aug 2017
Revisiting Activation Regularization for Language RNNs
Stephen Merity
Bryan McCann
R. Socher
185
44
0
03 Aug 2017
Bayesian Sparsification of Recurrent Neural Networks
E. Lobacheva
Nadezhda Chirkova
Dmitry Vetrov
UQCV
BDL
195
16
0
31 Jul 2017
Orthogonal Recurrent Neural Networks with Scaled Cayley Transform
Kyle E. Helfrich
Devin Willmott
Qiang Ye
326
136
0
29 Jul 2017
Dual Rectified Linear Units (DReLUs): A Replacement for Tanh Activation Functions in Quasi-Recurrent Neural Networks
Fréderic Godin
Jonas Degrave
J. Dambre
W. D. Neve
MU
115
48
0
25 Jul 2017
Simplified Long Short-term Memory Recurrent Neural Networks: part III
Atra Akandeh
F. Salem
94
2
0
14 Jul 2017
Simplified Long Short-term Memory Recurrent Neural Networks: part II
Atra Akandeh
F. Salem
75
6
0
14 Jul 2017
Simplified Long Short-term Memory Recurrent Neural Networks: part I
Atra Akandeh
F. Salem
84
1
0
14 Jul 2017
A Fully Trainable Network with RNN-based Pooling
Shuai Li
W. Li
Chris Cook
Ce Zhu
Yanbo Gao
127
23
0
16 Jun 2017
Gated Orthogonal Recurrent Units: On Learning to Forget
Neural Computation (Neural Comput.), 2017
Li Jing
Çağlar Gülçehre
J. Peurifoy
Yichen Shen
Max Tegmark
Marin Soljacic
Yoshua Bengio
252
133
0
08 Jun 2017
Real-valued (Medical) Time Series Generation with Recurrent Conditional GANs
Cristóbal Esteban
Stephanie L. Hyland
Gunnar Rätsch
GAN
SyDa
MedIm
333
893
0
08 Jun 2017
Kronecker Recurrent Units
C. Jose
Moustapha Cissé
François Fleuret
ODL
860
49
0
29 May 2017
Compressing Recurrent Neural Network with Tensor Train
Andros Tjandra
S. Sakti
Satoshi Nakamura
164
115
0
23 May 2017
Dependency Parsing with Dilated Iterated Graph CNNs
Emma Strubell
Andrew McCallum
GNN
133
7
0
01 May 2017
One-Shot Neural Cross-Lingual Transfer for Paradigm Completion
Katharina Kann
Robert Bamler
Hinrich Schütze
202
40
0
31 Mar 2017
Learning Simpler Language Models with the Differential State Framework
Alexander Ororbia
Tomas Mikolov
David Reitter
AI4TS
237
65
0
26 Mar 2017
Data Noising as Smoothing in Neural Network Language Models
Ziang Xie
Sida I. Wang
Jiwei Li
Daniel Levy
Allen Nie
Dan Jurafsky
A. Ng
165
252
0
07 Mar 2017
Machine Learning on Sequential Data Using a Recurrent Weighted Average
Jared Ostmeyer
L. Cowell
101
33
0
03 Mar 2017
The Statistical Recurrent Unit
Junier B. Oliva
Barnabás Póczós
J. Schneider
126
50
0
01 Mar 2017
Analyzing and Exploiting NARX Recurrent Neural Networks for Long-Term Dependencies
International Conference on Learning Representations (ICLR), 2017
R. DiPietro
Christian Rupprecht
Nassir Navab
Gregory Hager
331
26
0
24 Feb 2017
Character-level Deep Conflation for Business Data Analytics
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2017
Zhe Gan
P. D. Singh
A. Joshi
Xiaodong He
Jianshu Chen
Jianfeng Gao
Li Deng
156
14
0
08 Feb 2017
Fast and Accurate Entity Recognition with Iterated Dilated Convolutions
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2017
Emma Strubell
Pat Verga
David Belanger
Andrew McCallum
383
420
0
07 Feb 2017
On orthogonality and learning recurrent networks with long term dependencies
International Conference on Machine Learning (ICML), 2017
Eugene Vorontsov
C. Trabelsi
Samuel Kadoury
C. Pal
ODL
341
254
0
31 Jan 2017
Gate-Variants of Gated Recurrent Unit (GRU) Neural Networks
Midwest Symposium on Circuits and Systems (MWSCAS), 2017
Rahul Dey
F. Salem
268
1,814
0
20 Jan 2017
Simplified Gating in Long Short-term Memory (LSTM) Recurrent Neural Networks
Midwest Symposium on Circuits and Systems (MWSCAS), 2017
Yuzhen Lu
F. Salem
88
46
0
12 Jan 2017
Towards End-to-End Speech Recognition with Deep Convolutional Neural Networks
Interspeech (Interspeech), 2016
Yanzhe Zhang
Mohammad Pezeshki
Philemon Brakel
Saizheng Zhang
Yoshua Bengio
Aaron Courville
157
383
0
10 Jan 2017
A Basic Recurrent Neural Network Model
F. Salem
61
17
0
29 Dec 2016
An Empirical Study of Language CNN for Image Captioning
IEEE International Conference on Computer Vision (ICCV), 2016
Jiuxiang Gu
G. Wang
Jianfei Cai
Tsuhan Chen
257
148
0
21 Dec 2016
Neural Multi-Source Morphological Reinflection
Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2016
Katharina Kann
Robert Bamler
Hinrich Schütze
291
31
0
19 Dec 2016
Tunable Efficient Unitary Neural Networks (EUNN) and their application to RNNs
International Conference on Machine Learning (ICML), 2016
Li Jing
Yichen Shen
T. Dubček
J. Peurifoy
S. Skirlo
Yann LeCun
Max Tegmark
Marin Soljacic
353
185
0
15 Dec 2016
Graphical RNN Models
Ashish Bora
Sugato Basu
Joydeep Ghosh
AI4TS
AI4CE
77
0
0
15 Dec 2016
Finding Tiny Faces
Peiyun Hu
Deva Ramanan
CVBM
ObjD
222
765
0
13 Dec 2016
DizzyRNN: Reparameterizing Recurrent Neural Networks for Norm-Preserving Backpropagation
Victor D. Dorobantu
Per Andre Stromhaug
Jess Renteria
147
25
0
13 Dec 2016
Empirical Evaluation of A New Approach to Simplifying Long Short-term Memory (LSTM)
Yuzhen Lu
63
2
0
12 Dec 2016
Deep Symbolic Representation Learning for Heterogeneous Time-series Classification
S. Zhang
S. Bahrampour
Naveen Ramakrishnan
Mohak Shah
AI4TS
218
1
0
05 Dec 2016
Predicting Patient State-of-Health using Sliding Window and Recurrent Classifiers
Adam McCarthy
Christopher K. I. Williams
160
6
0
02 Dec 2016
Efficient Orthogonal Parametrisation of Recurrent Neural Networks Using Householder Reflections
Zakaria Mhammedi
Andrew D. Hellicar
Ashfaqur Rahman
James Bailey
580
137
0
01 Dec 2016
Capacity and Trainability in Recurrent Neural Networks
Jasmine Collins
Jascha Narain Sohl-Dickstein
David Sussillo
377
213
0
29 Nov 2016
Input Switched Affine Networks: An RNN Architecture Designed for Interpretability
Jakob N. Foerster
Justin Gilmer
J. Chorowski
Jascha Narain Sohl-Dickstein
David Sussillo
276
7
0
28 Nov 2016
Previous
1
2
3
4
5
6
7
8
Next
