Recurrent Dropout without Memory Loss

16 March 2016

Papers citing "Recurrent Dropout without Memory Loss"

34 / 34 papers shown

Title
Neuroplasticity in Artificial Intelligence -- An Overview and Inspirations on Drop In & Out Learning Yupei Li M. Milling Björn Schuller AI4CE 107 0 0 27 Mar 2025
LoRA Dropout as a Sparsity Regularizer for Overfitting Control Yang Lin Xinyu Ma Xu Chu Yujie Jin Zhibang Yang Yasha Wang Hong-yan Mei 49 19 0 15 Apr 2024
Acoustic characterization of speech rhythm: going beyond metrics with recurrent neural networks Franccois Deloche Laurent Bonnasse-Gahot Judit Gervain 21 0 0 22 Jan 2024
Gating Dropout: Communication-efficient Regularization for Sparsely Activated Transformers R. Liu Young Jin Kim Alexandre Muzio Hany Awadalla MoE 42 22 0 28 May 2022
A Survey on Dropout Methods and Experimental Verification in Recommendation Y. Li Weizhi Ma C. L. Philip Chen M. Zhang Yiqun Liu Shaoping Ma Yue Yang 33 9 0 05 Apr 2022
Recency Dropout for Recurrent Recommender Systems Bo-Yu Chang Can Xu Matt Le Jingchen Feng Ya Le Sriraj Badam Ed H. Chi Minmin Chen 17 3 0 26 Jan 2022
How Do Neural Sequence Models Generalize? Local and Global Context Cues for Out-of-Distribution Prediction Anthony Bau Jacob Andreas 12 3 0 04 Nov 2021
Spiking Neural Networks with Improved Inherent Recurrence Dynamics for Sequential Learning Wachirawit Ponghiran Kaushik Roy 30 48 0 04 Sep 2021
R-Drop: Regularized Dropout for Neural Networks Xiaobo Liang Lijun Wu Juntao Li Yue Wang Qi Meng Tao Qin Wei Chen M. Zhang Tie-Yan Liu 44 424 0 28 Jun 2021
Delving Deeper into the Decoder for Video Captioning Haoran Chen Jianmin Li Xiaolin Hu 40 34 0 16 Jan 2020
Medi-Care AI: Predicting Medications From Billing Codes via Robust Recurrent Neural Networks Deyin Liu Lin Wu Xue Li 34 17 0 14 Nov 2019
KerCNNs: biologically inspired lateral connections for classification of corrupted images Noemi Montobbio L. Bonnasse-Gahot G. Citti A. Sarti 16 10 0 18 Oct 2019
DropAttention: A Regularization Method for Fully-Connected Self-Attention Networks Zehui Lin Pengfei Liu Luyao Huang Junkun Chen Xipeng Qiu Xuanjing Huang 3DPC 16 44 0 25 Jul 2019
Survey of Dropout Methods for Deep Neural Networks Alex Labach Hojjat Salehinejad S. Valaee 18 149 0 25 Apr 2019
Divide and Conquer: A Deep CASA Approach to Talker-independent Monaural Speaker Separation Yuzhou Liu DeLiang Wang 27 157 0 25 Apr 2019
A Learned Representation for Scalable Vector Graphics Raphael Gontijo-Lopes David R Ha Douglas Eck Jonathon Shlens GAN OCL 30 113 0 04 Apr 2019
Few-Shot Generalization Across Dialogue Tasks Vladimir Vlasov Akela Drissner-Schmid Alan Nichol 11 33 0 28 Nov 2018
Removing the Feature Correlation Effect of Multiplicative Noise Zijun Zhang Yining Zhang Zongpeng Li 13 8 0 19 Sep 2018
Learning to Compose over Tree Structures via POS Tags Gehui Shen Zhihong Deng Ting Huang Xi Chen 24 15 0 18 Aug 2018
Scheduling Computation Graphs of Deep Learning Models on Manycore CPUs Linpeng Tang Yida Wang Theodore L. Willke Kai Li GNN 13 22 0 16 Jul 2018
Noisin: Unbiased Regularization for Recurrent Neural Networks Adji Bousso Dieng Rajesh Ranganath Jaan Altosaar David M. Blei 19 22 0 03 May 2018
Flipout: Efficient Pseudo-Independent Weight Perturbations on Mini-Batches Yeming Wen Paul Vicol Jimmy Ba Dustin Tran Roger C. Grosse BDL 9 307 0 12 Mar 2018
Learning to recognize touch gestures: recurrent vs. convolutional features and dynamic sampling Quentin Debard Christian Wolf S. Canu Julien Arné SLR 27 13 0 19 Feb 2018
Predicting Future Lane Changes of Other Highway Vehicles using RNN-based Deep Models Sajan Patel Brent A. Griffin Kristofer D. Kusano Jason J. Corso 19 30 0 12 Jan 2018
Dilated Recurrent Neural Networks Shiyu Chang Yang Zhang Wei Han Mo Yu Xiaoxiao Guo Wei Tan Xiaodong Cui Michael Witbrock M. Hasegawa-Johnson Thomas S. Huang 21 296 0 05 Oct 2017
Regularizing and Optimizing LSTM Language Models Stephen Merity N. Keskar R. Socher 54 1,091 0 07 Aug 2017
Revisiting Activation Regularization for Language RNNs Stephen Merity Bryan McCann R. Socher 30 44 0 03 Aug 2017
Leveraging Large Amounts of Weakly Supervised Data for Multi-Language Sentiment Classification Jan Deriu Aurélien Lucchi V. D. Luca Aliaksei Severyn Simon Müller Mark Cieliebak Thomas Hofmann Martin Jaggi 9 133 0 07 Mar 2017
Improving the Neural GPU Architecture for Algorithm Learning Kārlis Freivalds Renars Liepins 18 43 0 28 Feb 2017
Deep Learning with Dynamic Computation Graphs Moshe Looks Marcello Herreshoff DeLesley S. Hutchins Peter Norvig GNN AI4CE 34 131 0 07 Feb 2017
Scalable Bayesian Learning of Recurrent Neural Networks for Language Modeling Zhe Gan Chunyuan Li Changyou Chen Yunchen Pu Qinliang Su Lawrence Carin BDL UQCV 50 41 0 23 Nov 2016
HyperNetworks David R Ha Andrew M. Dai Quoc V. Le 64 1,580 0 27 Sep 2016
Dynamic Neural Turing Machine with Soft and Hard Addressing Schemes Çağlar Gülçehre A. Chandar Kyunghyun Cho Yoshua Bengio 12 64 0 30 Jun 2016
Improving neural networks by preventing co-adaptation of feature detectors Geoffrey E. Hinton Nitish Srivastava A. Krizhevsky Ilya Sutskever Ruslan Salakhutdinov VLM 266 7,634 0 03 Jul 2012