v1v2v3v4 (latest)

Unitary Evolution Recurrent Neural Networks

20 November 2015

Papers citing "Unitary Evolution Recurrent Neural Networks"

50 / 403 papers shown

Title
Learning Longer-term Dependencies in RNNs with Auxiliary Losses Trieu H. Trinh Andrew M. Dai Thang Luong Quoc V. Le 94 181 0 01 Mar 2018
Complex-valued Neural Networks with Non-parametric Activation Functions Simone Scardapane S. Van Vaerenbergh Amir Hussain A. Uncini 78 83 0 22 Feb 2018
A Generalization Method of Partitioned Activation Function for Complex Number HyeonSeok Lee Hyo Seon Park 13 4 0 08 Feb 2018
Which Neural Net Architectures Give Rise To Exploding and Vanishing Gradients? Boris Hanin 107 256 0 11 Jan 2018
Recent Advances in Recurrent Neural Networks Hojjat Salehinejad Sharan Sankar Joseph Barfett E. Colak S. Valaee AI4TS 130 584 0 29 Dec 2017
The exploding gradient problem demystified - definition, prevalence, impact, origin, tradeoffs, and solutions George Philipp Basel Alomair J. Carbonell ODL 92 46 0 15 Dec 2017
Deep Quaternion Networks Chase J. Gaudet Anthony Maida 62 165 0 13 Dec 2017
Wider and Deeper, Cheaper and Faster: Tensorized LSTMs for Sequence Learning Zhen He Shaobing Gao Liang Xiao Daxue Liu Hangen He David Barber AIMat 90 65 0 05 Nov 2017
Rotational Unit of Memory Rumen Dangovski L. Jing Marin Soljacic 61 7 0 26 Oct 2017
Projection Based Weight Normalization for Deep Neural Networks Lei Huang Xianglong Liu B. Lang Yue Liu 65 18 0 06 Oct 2017
Dilated Recurrent Neural Networks Shiyu Chang Yang Zhang Wei Han Mo Yu Xiaoxiao Guo Wei Tan Xiaodong Cui Michael Witbrock M. Hasegawa-Johnson Thomas S. Huang 100 304 0 05 Oct 2017
Training Feedforward Neural Networks with Standard Logistic Activations is Feasible Emanuele Sansone F. D. De Natale 29 4 0 03 Oct 2017
Orthogonal Weight Normalization: Solution to Optimization over Multiple Dependent Stiefel Manifolds in Deep Neural Networks Lei Huang Xianglong Liu B. Lang Adams Wei Yu Yongliang Wang Bo Li ODL 90 230 0 16 Sep 2017
RRA: Recurrent Residual Attention for Sequence Learning Cheng Wang 16 13 0 12 Sep 2017
Implicit Regularization in Deep Learning Behnam Neyshabur 66 148 0 06 Sep 2017
Skip RNN: Learning to Skip State Updates in Recurrent Neural Networks Victor Campos Brendan Jou Xavier Giró-i-Nieto Jordi Torres Shih-Fu Chang 81 219 0 22 Aug 2017
Neural Networks Compression for Language Modeling Artem M. Grachev D. Ignatov Andrey V. Savchenko 67 30 0 20 Aug 2017
Regularizing and Optimizing LSTM Language Models Stephen Merity N. Keskar R. Socher 178 1,097 0 07 Aug 2017
Revisiting Activation Regularization for Language RNNs Stephen Merity Bryan McCann R. Socher 75 44 0 03 Aug 2017
Orthogonal Recurrent Neural Networks with Scaled Cayley Transform Kyle E. Helfrich Devin Willmott Qiang Ye 105 131 0 29 Jul 2017
Gated Orthogonal Recurrent Units: On Learning to Forget Li Jing Çağlar Gülçehre J. Peurifoy Yichen Shen Max Tegmark Marin Soljacic Yoshua Bengio 91 126 0 08 Jun 2017
Real-valued (Medical) Time Series Generation with Recurrent Conditional GANs Cristóbal Esteban Stephanie L. Hyland Gunnar Rätsch GAN SyDa MedIm 125 794 0 08 Jun 2017
Dynamic Steerable Blocks in Deep Residual Networks J. Jacobsen Bert de Brabandere A. Smeulders 85 28 0 02 Jun 2017
Spectral Norm Regularization for Improving the Generalizability of Deep Learning Yuichi Yoshida Takeru Miyato 91 335 0 31 May 2017
Kronecker Recurrent Units C. Jose Moustapha Cissé François Fleuret ODL 130 46 0 29 May 2017
Deep Complex Networks C. Trabelsi O. Bilaniuk Ying Zhang Dmitriy Serdyuk Sandeep Subramanian J. F. Santos Soroush Mehri Negar Rostamzadeh Yoshua Bengio C. Pal 241 837 0 27 May 2017
The power of deeper networks for expressing natural functions David Rolnick Max Tegmark 164 174 0 16 May 2017
Diagonal RNNs in Symbolic Music Modeling Y. C. Subakan Paris Smaragdis 42 20 0 18 Apr 2017
Data Noising as Smoothing in Neural Network Language Models Ziang Xie Sida I. Wang Jiwei Li Daniel Levy Allen Nie Dan Jurafsky A. Ng 70 239 0 07 Mar 2017
Analyzing and Exploiting NARX Recurrent Neural Networks for Long-Term Dependencies R. DiPietro Christian Rupprecht Nassir Navab Gregory Hager 44 26 0 24 Feb 2017
On orthogonality and learning recurrent networks with long term dependencies Eugene Vorontsov C. Trabelsi Samuel Kadoury C. Pal ODL 125 242 0 31 Jan 2017
Optimization on Product Submanifolds of Convolution Kernels Mete Ozay Takayuki Okatani AAML 33 0 0 22 Jan 2017
Tunable Efficient Unitary Neural Networks (EUNN) and their application to RNNs Li Jing Yichen Shen T. Dubček J. Peurifoy S. Skirlo Yann LeCun Max Tegmark Marin Soljacic 95 178 0 15 Dec 2016
DizzyRNN: Reparameterizing Recurrent Neural Networks for Norm-Preserving Backpropagation Victor D. Dorobantu Per Andre Stromhaug Jess Renteria 84 25 0 13 Dec 2016
Efficient Orthogonal Parametrisation of Recurrent Neural Networks Using Householder Reflections Zakaria Mhammedi Andrew D. Hellicar Ashfaqur Rahman James Bailey 101 129 0 01 Dec 2016
Improving Variational Auto-Encoders using Householder Flow Jakub M. Tomczak Max Welling BDL DRL 115 175 0 29 Nov 2016
Interpretable Recurrent Neural Networks Using Sequential Sparse Recovery Scott Wisdom Thomas Powers J. Pitton L. Atlas 87 36 0 22 Nov 2016
Improving training of deep neural networks via Singular Value Bounding Kui Jia AAML 100 91 0 18 Nov 2016
Bayesian optimization of hyper-parameters in reservoir computing J. Yperman Thijs Becker TPM 58 32 0 16 Nov 2016
Full-Capacity Unitary Recurrent Neural Networks Scott Wisdom Thomas Powers J. Hershey Jonathan Le Roux L. Atlas 93 294 0 31 Oct 2016
Optimization on Submanifolds of Convolution Kernels in CNNs Mete Ozay Takayuki Okatani 96 46 0 22 Oct 2016
Multiplicative LSTM for sequence modelling Ben Krause Liang Lu Iain Murray Steve Renals 97 208 0 26 Sep 2016
Learning Unitary Operators with Help From u(n) Stephanie L. Hyland Gunnar Rätsch 162 42 0 17 Jul 2016
Path-Normalized Optimization of Recurrent Neural Networks with ReLU Activations Behnam Neyshabur Yuhuai Wu Ruslan Salakhutdinov Nathan Srebro AI4CE ODL 76 30 0 23 May 2016
Review of state-of-the-arts in artificial intelligence with application to AI safety problem V. Shakirov 56 10 0 11 May 2016
LSTM with Working Memory Andrew Pulver Siwei Lyu RALM KELM 27 68 0 06 May 2016
Norm-preserving Orthogonal Permutation Linear Unit Activation Functions (OPLU) Artem Chernodub D. Nowicki 66 28 0 08 Apr 2016
Recurrent Batch Normalization Tim Cooijmans Nicolas Ballas César Laurent Çağlar Gülçehre Aaron Courville ODL 101 411 0 30 Mar 2016
Low-rank passthrough neural networks Antonio Valerio Miceli Barone 73 14 0 10 Mar 2016
Architectural Complexity Measures of Recurrent Neural Networks Saizheng Zhang Yuhuai Wu Tong Che Zhouhan Lin Roland Memisevic Ruslan Salakhutdinov Yoshua Bengio GNN 96 155 0 26 Feb 2016