Recurrent Batch Normalization

30 March 2016

Aaron Courville

Papers citing "Recurrent Batch Normalization"

45 / 45 papers shown

Title
Attention Normalization Impacts Cardinality Generalization in Slot Attention Markus Krimmel Jan Achterhold Joerg Stueckler OCL 42 0 0 04 Jul 2024
KL Regularized Normalization Framework for Low Resource Tasks Neeraj Kumar Ankur Narang Brejesh Lall 21 1 0 21 Dec 2022
Batch Layer Normalization, A new normalization layer for CNNs and RNN A. Ziaee Erion cCano 6 12 0 19 Sep 2022
RF-Next: Efficient Receptive Field Search for Convolutional Neural Networks Shanghua Gao Zhong-Yu Li Qi Han Ming-Ming Cheng Liang Wang 28 34 0 14 Jun 2022
Can deep neural networks learn process model structure? An assessment framework and analysis Jari Peeperkorn S. vanden Broucke Jochen De Weerdt 24 7 0 24 Feb 2022
Polyphonic pitch detection with convolutional recurrent neural networks Carl Thomé Sven Ahlback 14 8 0 04 Feb 2022
Low-Pass Filtering SGD for Recovering Flat Optima in the Deep Learning Optimization Landscape Devansh Bisla Jing Wang A. Choromańska 25 34 0 20 Jan 2022
maskGRU: Tracking Small Objects in the Presence of Large Background Motions Constantine J. Roros A. Kak 31 2 0 03 Jan 2022
Batch Normalization Preconditioning for Neural Network Training Susanna Lange Kyle E. Helfrich Qiang Ye 24 9 0 02 Aug 2021
SeqMobile: A Sequence Based Efficient Android Malware Detection System Using RNN on Mobile Devices Ruitao Feng Jing Qiang Lim Sen Chen Shang-Wei Lin Yang Liu 30 16 0 10 Nov 2020
Coupled Oscillatory Recurrent Neural Network (coRNN): An accurate and (gradient) stable architecture for learning long time dependencies T. Konstantin Rusch Siddhartha Mishra 19 88 0 02 Oct 2020
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 26 79 0 17 Sep 2020
Training Deep Spiking Neural Networks Eimantas Ledinauskas J. Ruseckas Alfonsas Jursenas Giedrius Burachas 8 54 0 08 Jun 2020
Encoding word order in complex embeddings Benyou Wang Donghao Zhao Christina Lioma Qiuchi Li Peng Zhang J. Simonsen 11 111 0 27 Dec 2019
Towards More Accurate Automatic Sleep Staging via Deep Transfer Learning Huy P Phan Oliver Y. Chén P. Koch Zongqing Lu Ian Mcloughlin Alfred Mertins M. D. Vos 26 116 0 30 Jul 2019
Disentangling neural mechanisms for perceptual grouping Junkyung Kim Drew Linsley Kalpit C. Thakkar Thomas Serre OCL 23 54 0 04 Jun 2019
DDLSTM: Dual-Domain LSTM for Cross-Dataset Action Recognition Toby Perrett Dima Damen 22 24 0 18 Apr 2019
Towards Non-saturating Recurrent Units for Modelling Long-term Dependencies A. Chandar Chinnadhurai Sankar Eugene Vorontsov Samira Ebrahimi Kahou Yoshua Bengio 21 56 0 22 Jan 2019
Robust neural circuit reconstruction from serial electron microscopy with convolutional recurrent networks Drew Linsley Junkyung Kim D. Berson Thomas Serre 3DV 14 17 0 28 Nov 2018
SeqSleepNet: End-to-End Hierarchical Recurrent Neural Network for Sequence-to-Sequence Automatic Sleep Staging Huy P Phan Fernando Andreotti Navin Cooray Oliver Y. Chén M. D. Vos 15 414 0 28 Sep 2018
Machine Learning for semi linear PDEs Quentin Chan-Wai-Nam Joseph Mikael X. Warin ODL 11 111 0 20 Sep 2018
Understanding Batch Normalization Johan Bjorck Carla P. Gomes B. Selman Kilian Q. Weinberger 13 592 0 01 Jun 2018
Noisin: Unbiased Regularization for Recurrent Neural Networks Adji Bousso Dieng Rajesh Ranganath Jaan Altosaar David M. Blei 17 22 0 03 May 2018
Flipout: Efficient Pseudo-Independent Weight Perturbations on Mini-Batches Yeming Wen Paul Vicol Jimmy Ba Dustin Tran Roger C. Grosse BDL 9 307 0 12 Mar 2018
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling Shaojie Bai J. Zico Kolter V. Koltun DRL 33 4,708 0 04 Mar 2018
CNN+LSTM Architecture for Speech Emotion Recognition with Data Augmentation Caroline Etienne Guillaume Fidanza Andrei Petrovskii Laurence Devillers B. Schmauch 19 99 0 15 Feb 2018
Predicting Hurricane Trajectories using a Recurrent Neural Network Sheila Alemany J. Beltran Adrián Pérez Sam Ganzfried 14 133 0 01 Feb 2018
Dilated Recurrent Neural Networks Shiyu Chang Yang Zhang Wei Han Mo Yu Xiaoxiao Guo Wei Tan Xiaodong Cui Michael Witbrock M. Hasegawa-Johnson Thomas S. Huang 18 296 0 05 Oct 2017
Improving speech recognition by revising gated recurrent units Mirco Ravanelli Philemon Brakel M. Omologo Yoshua Bengio 14 52 0 29 Sep 2017
Skip RNN: Learning to Skip State Updates in Recurrent Neural Networks Victor Campos Brendan Jou Xavier Giró-i-Nieto Jordi Torres Shih-Fu Chang 14 217 0 22 Aug 2017
Regularizing and Optimizing LSTM Language Models Stephen Merity N. Keskar R. Socher 45 1,090 0 07 Aug 2017
Revisiting Activation Regularization for Language RNNs Stephen Merity Bryan McCann R. Socher 27 44 0 03 Aug 2017
Gated Orthogonal Recurrent Units: On Learning to Forget Li Jing Çağlar Gülçehre J. Peurifoy Yichen Shen Max Tegmark Marin Soljacic Yoshua Bengio 33 125 0 08 Jun 2017
Reducing Bias in Production Speech Models Eric Battenberg R. Child Adam Coates Christopher Fougner Yashesh Gaur ... Vinay Rao S. Satheesh David Seetapun Anuroop Sriram Zhenyao Zhu 25 10 0 11 May 2017
Batch-normalized joint training for DNN-based distant speech recognition Mirco Ravanelli Philemon Brakel M. Omologo Yoshua Bengio 13 35 0 24 Mar 2017
DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processing Shuochao Yao Shaohan Hu Yiran Zhao Aston Zhang Tarek F. Abdelzaher HAI AI4TS 20 616 0 07 Nov 2016
HyperNetworks David R Ha Andrew M. Dai Quoc V. Le 46 1,580 0 27 Sep 2016
Hierarchical Multiscale Recurrent Neural Networks Junyoung Chung Sungjin Ahn Yoshua Bengio BDL 29 534 0 06 Sep 2016
Recurrent Highway Networks J. Zilly R. Srivastava Jan Koutník Jürgen Schmidhuber 11 413 0 12 Jul 2016
Dynamic Neural Turing Machine with Soft and Hard Addressing Schemes Çağlar Gülçehre A. Chandar Kyunghyun Cho Yoshua Bengio 12 64 0 30 Jun 2016
On Multiplicative Integration with Recurrent Neural Networks Yuhuai Wu Saizheng Zhang Y. Zhang Yoshua Bengio Ruslan Salakhutdinov 23 154 0 21 Jun 2016
Bridging the Gaps Between Residual Learning, Recurrent Neural Networks and Visual Cortex Q. Liao T. Poggio 213 255 0 13 Apr 2016
Deep Gate Recurrent Neural Network Yuan Gao D. Głowacka 19 61 0 11 Apr 2016
Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks Tim Salimans Diederik P. Kingma ODL 45 1,924 0 25 Feb 2016
Adding Gradient Noise Improves Learning for Very Deep Networks Arvind Neelakantan Luke Vilnis Quoc V. Le Ilya Sutskever Lukasz Kaiser Karol Kurach James Martens AI4CE ODL 27 540 0 21 Nov 2015