Full-Capacity Unitary Recurrent Neural Networks

31 October 2016

Papers citing "Full-Capacity Unitary Recurrent Neural Networks"

50 / 105 papers shown

Title
R-Transformer: Recurrent Neural Network Enhanced Transformer Z. Wang Yao Ma Zitao Liu Jiliang Tang ViT 79 106 0 12 Jul 2019
Parameterized quantum circuits as machine learning models Marcello Benedetti Erika Lloyd Stefan H. Sack Mattia Fiorentini 119 904 0 18 Jun 2019
Compressing RNNs for IoT devices by 15-38x using Kronecker Products Urmish Thakker Jesse G. Beu Dibakar Gope Chu Zhou Igor Fedorov Ganesh S. Dasika Matthew Mattina 104 36 0 07 Jun 2019
Complex Evolution Recurrent Neural Networks (ceRNNs) Izhak Shafran Tom Bagby RJ Skerry-Ryan 56 8 0 05 Jun 2019
Improved memory in recurrent neural networks with sequential non-normal dynamics A. Orhan Xaq Pitkow 68 14 0 31 May 2019
Non-normal Recurrent Neural Network (nnRNN): learning long time dependencies while improving expressivity with transient dynamics Giancarlo Kerg Kyle Goyette M. P. Touzel Gauthier Gidel Eugene Vorontsov Yoshua Bengio Guillaume Lajoie 96 58 0 28 May 2019
Robust Wireless Fingerprinting via Complex-Valued Neural Networks S. Gopalakrishnan Metehan Cekic Upamanyu Madhow 61 41 0 19 May 2019
Orthogonal Deep Neural Networks Kui Jia Shuai Li Yuxin Wen Tongliang Liu Dacheng Tao 93 134 0 15 May 2019
Phase-aware Speech Enhancement with Deep Complex U-Net Hyeong-Seok Choi Jang-Hyun Kim Jaesung Huh A. Kim Jung-Woo Ha Kyogu Lee 78 334 0 07 Mar 2019
AntisymmetricRNN: A Dynamical System View on Recurrent Neural Networks B. Chang Minmin Chen E. Haber Ed H. Chi PINN GNN 117 207 0 26 Feb 2019
Learning to Adaptively Scale Recurrent Neural Networks Hao Hu Liqiang Wang Guo-Jun Qi AI4CE 42 9 0 15 Feb 2019
Dynamical Isometry and a Mean Field Theory of LSTMs and GRUs D. Gilboa B. Chang Minmin Chen Greg Yang S. Schoenholz Ed H. Chi Jeffrey Pennington 86 42 0 25 Jan 2019
State-Regularized Recurrent Neural Networks Cheng Wang Mathias Niepert 65 40 0 25 Jan 2019
Cheap Orthogonal Constraints in Neural Networks: A Simple Parametrization of the Orthogonal and Unitary Group Mario Lezcano Casado David Martínez-Rubio 50 200 0 24 Jan 2019
Enhancing Explainability of Neural Networks through Architecture Constraints Zebin Yang Aijun Zhang Agus Sudjianto AAML 42 87 0 12 Jan 2019
FastGRNN: A Fast, Accurate, Stable and Tiny Kilobyte Sized Gated Recurrent Neural Network Aditya Kusupati Manish Singh Kush S. Bhatia A. Kumar Prateek Jain Manik Varma 80 190 0 08 Jan 2019
Evaluation of Complex-Valued Neural Networks on Real-Valued Classification Tasks Nils Mönning S. Manandhar 78 26 0 29 Nov 2018
Speech recognition with quaternion neural networks Titouan Parcollet Mirco Ravanelli Mohamed Morchid G. Linarès R. Mori 23 14 0 21 Nov 2018
Sorting out Lipschitz function approximation Cem Anil James Lucas Roger C. Grosse 94 325 0 13 Nov 2018
Complex Unitary Recurrent Neural Networks using Scaled Cayley Transform K. D. G. Maduranga Kyle E. Helfrich Qiang Ye 71 32 0 09 Nov 2018
Can We Gain More from Orthogonality Regularizations in Training Deep CNNs? Nitin Bansal Xiaohan Chen Zhangyang Wang OOD 96 188 0 22 Oct 2018
The loss surface of deep linear networks viewed through the algebraic geometry lens D. Mehta Tianran Chen Tingting Tang J. Hauenstein ODL 92 32 0 17 Oct 2018
Information Geometry of Orthogonal Initializations and Training Piotr A. Sokól Il-Su Park AI4CE 125 17 0 09 Oct 2018
h-detach: Modifying the LSTM Gradient Towards Better Optimization Devansh Arpit Bhargav Kanuparthi Giancarlo Kerg Nan Rosemary Ke Ioannis Mitliagkas Yoshua Bengio 103 32 0 06 Oct 2018
Complex Gated Recurrent Neural Networks Moritz Wolter Angela Yao AI4CE 90 65 0 21 Jun 2018
Detecting Cyberattacks in Industrial Control Systems Using Convolutional Neural Networks Moshe Kravchik A. Shabtai 85 275 0 21 Jun 2018
Dynamical Isometry and a Mean Field Theory of RNNs: Gating Enables Signal Propagation in Recurrent Neural Networks Minmin Chen Jeffrey Pennington S. Schoenholz SyDa AI4CE 67 117 0 14 Jun 2018
Quaternion Recurrent Neural Networks Titouan Parcollet Mirco Ravanelli Mohamed Morchid G. Linarès C. Trabelsi R. Mori Yoshua Bengio 60 132 0 12 Jun 2018
Stable Recurrent Models John Miller Moritz Hardt 72 119 0 25 May 2018
How Robust are Deep Neural Networks? B. Sengupta Karl J. Friston OOD 77 34 0 30 Apr 2018
Stabilizing Gradients for Deep Neural Networks via Efficient SVD Parameterization Jiong Zhang Qi Lei Inderjit S. Dhillon 55 112 0 25 Mar 2018
Can recurrent neural networks warp time? Corentin Tallec Yann Ollivier CLL AI4CE 144 136 0 23 Mar 2018
Independently Recurrent Neural Network (IndRNN): Building A Longer and Deeper RNN Shuai Li W. Li Chris Cook Ce Zhu Yanbo Gao 98 731 0 13 Mar 2018
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling Shaojie Bai J. Zico Kolter V. Koltun DRL 103 4,860 0 04 Mar 2018
Deep Quaternion Networks Chase J. Gaudet Anthony Maida 62 165 0 13 Dec 2017
Wider and Deeper, Cheaper and Faster: Tensorized LSTMs for Sequence Learning Zhen He Shaobing Gao Liang Xiao Daxue Liu Hangen He David Barber AIMat 90 65 0 05 Nov 2017
Unsupervised and Semi-supervised Anomaly Detection with LSTM Neural Networks Tolga Ergen Ali Hassan Mirza Suleyman S. Kozat AI4TS 118 254 0 25 Oct 2017
Projection Based Weight Normalization for Deep Neural Networks Lei Huang Xianglong Liu B. Lang Yue Liu 65 18 0 06 Oct 2017
Solving differential equations with unknown constitutive relations as recurrent neural networks Tobias J. Hagge P. Stinis Enoch Yeung A. Tartakovsky 77 23 0 06 Oct 2017
Dilated Recurrent Neural Networks Shiyu Chang Yang Zhang Wei Han Mo Yu Xiaoxiao Guo Wei Tan Xiaodong Cui Michael Witbrock M. Hasegawa-Johnson Thomas S. Huang 100 304 0 05 Oct 2017
Orthogonal Weight Normalization: Solution to Optimization over Multiple Dependent Stiefel Manifolds in Deep Neural Networks Lei Huang Xianglong Liu B. Lang Adams Wei Yu Yongliang Wang Bo Li ODL 95 231 0 16 Sep 2017
Regularizing and Optimizing LSTM Language Models Stephen Merity N. Keskar R. Socher 178 1,097 0 07 Aug 2017
Revisiting Activation Regularization for Language RNNs Stephen Merity Bryan McCann R. Socher 75 44 0 03 Aug 2017
Orthogonal Recurrent Neural Networks with Scaled Cayley Transform Kyle E. Helfrich Devin Willmott Qiang Ye 105 131 0 29 Jul 2017
An Alternative to EM for Gaussian Mixture Models: Batch and Stochastic Riemannian Optimization Reshad Hosseini S. Sra 76 61 0 10 Jun 2017
Gated Orthogonal Recurrent Units: On Learning to Forget Li Jing Çağlar Gülçehre J. Peurifoy Yichen Shen Max Tegmark Marin Soljacic Yoshua Bengio 91 126 0 08 Jun 2017
Spectral Norm Regularization for Improving the Generalizability of Deep Learning Yuichi Yoshida Takeru Miyato 97 335 0 31 May 2017
Kronecker Recurrent Units C. Jose Moustapha Cissé François Fleuret ODL 132 46 0 29 May 2017
Deep Complex Networks C. Trabelsi O. Bilaniuk Ying Zhang Dmitriy Serdyuk Sandeep Subramanian J. F. Santos Soroush Mehri Negar Rostamzadeh Yoshua Bengio C. Pal 241 837 0 27 May 2017
On orthogonality and learning recurrent networks with long term dependencies Eugene Vorontsov C. Trabelsi Samuel Kadoury C. Pal ODL 125 243 0 31 Jan 2017