Full-Capacity Unitary Recurrent Neural Networks

31 October 2016

Papers citing "Full-Capacity Unitary Recurrent Neural Networks"

50 / 105 papers shown

Title
Quantum-PEFT: Ultra parameter-efficient fine-tuning Toshiaki Koike-Akino F. Tonin Yongtao Wu Frank Zhengqing Wu Leyla Naz Candogan Volkan Cevher MQ 217 5 0 07 Mar 2025
HadamRNN: Binary and Sparse Ternary Orthogonal RNNs Armand Foucault Franck Mamalet François Malgouyres MQ 284 0 0 28 Jan 2025
Metric Learning for Clifford Group Equivariant Neural Networks Riccardo Ali Paulina Kulyt.e Haitz Sáez de Ocáriz Borde Pietro Lio 66 0 0 13 Jul 2024
Density Matrix Emulation of Quantum Recurrent Neural Networks for Multivariate Time Series Prediction José Daniel Viqueira Daniel Faílde M. M. Juane Andrés Gómez David Mera 93 6 0 31 Oct 2023
The Deep Arbitrary Polynomial Chaos Neural Network or how Deep Artificial Neural Networks could benefit from Data-Driven Homogeneous Chaos Theory S. Oladyshkin T. Praditia Ilja Kroker F. Mohammadi Wolfgang Nowak S. Otte AI4CE 43 5 0 26 Jun 2023
State-Regularized Recurrent Neural Networks to Extract Automata and Explain Predictions Cheng Wang Carolin (Haas) Lawrence Mathias Niepert 64 3 0 10 Dec 2022
Gated Recurrent Neural Networks with Weighted Time-Delay Feedback N. Benjamin Erichson Soon Hoe Lim Michael W. Mahoney 84 6 0 01 Dec 2022
Liquid Structural State-Space Models Ramin Hasani Mathias Lechner Tsun-Hsuan Wang Makram Chahine Alexander Amini Daniela Rus AI4TS 155 106 0 26 Sep 2022
Assessing the Unitary RNN as an End-to-End Compositional Model of Syntax Jean-Philippe Bernardy Shalom Lappin 83 1 0 11 Aug 2022
RF-Next: Efficient Receptive Field Search for Convolutional Neural Networks Shanghua Gao Zhong-Yu Li Qi Han Ming-Ming Cheng Liang Wang 102 35 0 14 Jun 2022
Entangled Residual Mappings Mathias Lechner Ramin Hasani Z. Babaiee Radu Grosu Daniela Rus T. Henzinger Sepp Hochreiter 73 5 0 02 Jun 2022
Momentum Stiefel Optimizer, with Applications to Suitably-Orthogonal Attention, and Optimal Transport Lingkai Kong Yuqing Wang Molei Tao ODL 58 9 0 27 May 2022
projUNN: efficient method for training deep networks with unitary matrices B. Kiani Randall Balestriero Yann LeCun S. Lloyd 102 32 0 10 Mar 2022
Recency Dropout for Recurrent Recommender Systems Bo-Yu Chang Can Xu Matt Le Jingchen Feng Ya Le Sriraj Badam Ed H. Chi Minmin Chen 46 3 0 26 Jan 2022
Stable Long-Term Recurrent Video Super-Resolution Benjamin Naoto Chiche Arnaud Woiselle J. Frontera-Pons Jean-Luc Starck SupR 59 6 0 16 Dec 2021
Learning Connectivity with Graph Convolutional Networks for Skeleton-based Action Recognition H. Sahbi GNN 73 28 0 06 Dec 2021
Heavy Ball Neural Ordinary Differential Equations Hedi Xia Vai Suliafu H. Ji T. Nguyen Andrea L. Bertozzi Stanley J. Osher Bao Wang 87 61 0 10 Oct 2021
Long Expressive Memory for Sequence Modeling T. Konstantin Rusch Siddhartha Mishra N. Benjamin Erichson Michael W. Mahoney AI4TS 244 46 0 10 Oct 2021
Acceleration Method for Learning Fine-Layered Optical Neural Networks K. Aoyama H. Sawada 52 1 0 01 Sep 2021
Coordinate descent on the orthogonal group for recurrent neural network training E. Massart V. Abrol 66 11 0 30 Jul 2021
Recurrent Neural Network from Adder's Perspective: Carry-lookahead RNN Haowei Jiang Fei-wei Qin Jin Cao Yong Peng Yanli Shao LRM ODL 64 43 0 22 Jun 2021
A Survey of Complex-Valued Neural Networks J. Bassey Lijun Qian Xianfang Li 85 124 0 28 Jan 2021
Kaleidoscope: An Efficient, Learnable Representation For All Structured Linear Maps Tri Dao N. Sohoni Albert Gu Matthew Eichhorn Amit Blonder Megan Leszczynski Atri Rudra Christopher Ré 90 49 0 29 Dec 2020
Short-Term Memory Optimization in Recurrent Neural Networks by Autoencoder-based Initialization Antonio Carta A. Sperduti D. Bacciu ODL 52 0 0 05 Nov 2020
Classification of Periodic Variable Stars with Novel Cyclic-Permutation Invariant Neural Networks Keming 名 Zhang 张可 J. Bloom 26 10 0 02 Nov 2020
Continual Learning in Low-rank Orthogonal Subspaces Arslan Chaudhry Naeemullah Khan P. Dokania Philip Torr CLL 65 123 0 22 Oct 2020
Coupled Oscillatory Recurrent Neural Network (coRNN): An accurate and (gradient) stable architecture for learning long time dependencies T. Konstantin Rusch Siddhartha Mishra 119 94 0 02 Oct 2020
Normalization Techniques in Training DNNs: Methodology, Analysis and Application Lei Huang Jie Qin Yi Zhou Fan Zhu Li Liu Ling Shao AI4CE 165 272 0 27 Sep 2020
Neural Rough Differential Equations for Long Time Series James Morrill C. Salvi Patrick Kidger James Foster Terry Lyons AI4TS 73 133 0 17 Sep 2020
Shuffling Recurrent Neural Networks Michael Rotman Lior Wolf BDL 85 35 0 14 Jul 2020
Recurrent Quantum Neural Networks Johannes Bausch 76 155 0 25 Jun 2020
Lipschitz Recurrent Neural Networks N. Benjamin Erichson Omri Azencot A. Queiruga Liam Hodgkinson Michael W. Mahoney 90 112 0 22 Jun 2020
Passive Batch Injection Training Technique: Boosting Network Performance by Injecting Mini-Batches from a different Data Distribution Pravendra Singh Pratik Mazumder Vinay P. Namboodiri 21 0 0 08 Jun 2020
Controllable Orthogonalization in Training DNNs Lei Huang Li Liu Fan Zhu Diwen Wan Zehuan Yuan Bo Li Ling Shao 78 44 0 02 Apr 2020
R-FORCE: Robust Learning for Random Recurrent Neural Networks Yang Zheng Eli Shlizerman OOD 36 5 0 25 Mar 2020
Depth Enables Long-Term Memory for Recurrent Neural Networks A. Ziv 31 0 0 23 Mar 2020
Differentiate Everything with a Reversible Embeded Domain-Specific Language Jin-Guo Liu Tai-Lian Zhao 21 1 0 10 Mar 2020
Wireless Fingerprinting via Deep Learning: The Impact of Confounding Factors Metehan Cekic S. Gopalakrishnan Upamanyu Madhow 39 11 0 25 Feb 2020
Real-time speech enhancement using equilibriated RNN Daiki Takeuchi Kohei Yatabe Yuma Koizumi Yasuhiro Oikawa Noboru Harada 41 36 0 14 Feb 2020
Concept Whitening for Interpretable Image Recognition Zhi Chen Yijie Bei Cynthia Rudin FAtt 105 322 0 05 Feb 2020
Efficient Riemannian Optimization on the Stiefel Manifold via the Cayley Transform Jun Li Fuxin Li S. Todorovic 83 107 0 04 Feb 2020
Provable Benefit of Orthogonal Initialization in Optimizing Deep Linear Networks Wei Hu Lechao Xiao Jeffrey Pennington 77 115 0 16 Jan 2020
Orthogonal Wasserstein GANs J. Müller Reinhard Klein Michael Weinmann 113 9 0 29 Nov 2019
Orthogonal Convolutional Neural Networks Jiayun Wang Yubei Chen Rudrasis Chakraborty Stella X. Yu 89 190 0 27 Nov 2019
Gating Revisited: Deep Multi-layer RNNs That Can Be Trained Mehmet Özgür Türkoglu Stefano Dáronco Jan Dirk Wegner Konrad Schindler 87 48 0 25 Nov 2019
Eigenvalue Normalized Recurrent Neural Networks for Short Term Memory Kyle E. Helfrich Qiang Ye 44 6 0 18 Nov 2019
Input-Output Equivalence of Unitary and Contractive RNNs M. Emami Mojtaba Sahraee-Ardakan S. Rangan A. Fletcher 26 1 0 30 Oct 2019
Deep Independently Recurrent Neural Network (IndRNN) Shuai Li Wanqing Li Chris Cook Yanbo Gao 66 51 0 11 Oct 2019
Trivializations for Gradient-Based Optimization on Manifolds Mario Lezcano Casado 125 128 0 20 Sep 2019
Universality and individuality in neural dynamics across large populations of recurrent networks Niru Maheswaranathan Alex H. Williams Matthew D. Golub Surya Ganguli David Sussillo 93 145 0 19 Jul 2019