Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation

15 August 2013

Aaron Courville

Papers citing "Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation"

50 / 1,869 papers shown

Title
Neural Discrete Representation Learning Aaron van den Oord Oriol Vinyals Koray Kavukcuoglu BDL SSL OCL 43 4,822 0 02 Nov 2017
Attacking Binarized Neural Networks A. Galloway Graham W. Taylor M. Moussa MQ AAML 14 104 0 01 Nov 2017
Minimum Energy Quantized Neural Networks Bert Moons Koen Goetschalckx Nick Van Berckelaer Marian Verhelst MQ 28 123 0 01 Nov 2017
Towards Effective Low-bitwidth Convolutional Neural Networks Bohan Zhuang Chunhua Shen Mingkui Tan Lingqiao Liu Ian Reid MQ 31 231 0 01 Nov 2017
Deep Learning as a Mixed Convex-Combinatorial Optimization Problem A. Friesen Pedro M. Domingos 26 20 0 31 Oct 2017
A Connection between Feed-Forward Neural Networks and Probabilistic Graphical Models D. Schlesinger 27 0 0 30 Oct 2017
Dual Skipping Networks Changmao Cheng Yanwei Fu Yu-Gang Jiang Wei Liu Wenlian Lu Jianfeng Feng Xiangyang Xue 22 1 0 28 Oct 2017
Algorithm and Hardware Design of Discrete-Time Spiking Neural Networks Based on Back Propagation with Binary Activations Shihui Yin S. Venkataramanaiah Gregory K. Chen R. Krishnamurthy Yu Cao C. Chakrabarti Jae-sun Seo 12 59 0 19 Sep 2017
WRPN: Wide Reduced-Precision Networks Asit K. Mishra Eriko Nurvitadhi Jeffrey J. Cook Debbie Marr MQ 39 266 0 04 Sep 2017
Hierarchical Multi-scale Attention Networks for Action Recognition Shiyang Yan Jeremy S. Smith Wenjin Lu Bailing Zhang 26 37 0 25 Aug 2017
Skip RNN: Learning to Skip State Updates in Recurrent Neural Networks Victor Campos Brendan Jou Xavier Giró-i-Nieto Jordi Torres Shih-Fu Chang 21 217 0 22 Aug 2017
BitNet: Bit-Regularized Deep Neural Networks Aswin Raghavan Mohamed R. Amer S. Chai Graham Taylor MQ 38 10 0 16 Aug 2017
Scalable Full Flow with Learned Binary Descriptors Gottfried Munda Alexander Shekhovtsov Patrick Knöbelreiter Thomas Pock 17 4 0 20 Jul 2017
Kafnets: kernel-based non-parametric activation functions for neural networks Simone Scardapane S. Van Vaerenbergh Simone Totaro A. Uncini 16 12 0 13 Jul 2017
Learning to Compose Task-Specific Tree Structures Jihun Choi Kang Min Yoo Sang-goo Lee 15 189 0 10 Jul 2017
Neural Machine Translation with Gumbel-Greedy Decoding Jiatao Gu Daniel Jiwoong Im V. Li 19 35 0 22 Jun 2017
Balanced Quantization: An Effective and Efficient Approach to Quantized Neural Networks Shuchang Zhou Yuzhi Wang He Wen Qinyao He Yuheng Zou MQ 27 110 0 22 Jun 2017
Hardware-efficient on-line learning through pipelined truncated-error backpropagation in binary-state networks H. Elsayed Bruno U. Pedroni Sadique Sheik Gert Cauwenberghs 21 8 0 15 Jun 2017
Plan, Attend, Generate: Character-level Neural Machine Translation with Planning in the Decoder Çağlar Gülçehre Francis Dutil Adam Trischler Yoshua Bengio 11 7 0 13 Jun 2017
Best of Both Worlds: Transferring Knowledge from Discriminative Learning to a Generative Visual Dialog Model Jiasen Lu A. Kannan Jianwei Yang Devi Parikh Dhruv Batra BDL 29 136 0 05 Jun 2017
Emergence of Language with Multi-agent Games: Learning to Communicate with Sequences of Symbols Serhii Havrylov Ivan Titov LLMAG 41 286 0 31 May 2017
SuperSpike: Supervised learning in multi-layer spiking neural networks Friedemann Zenke Surya Ganguli 30 558 0 31 May 2017
Adversarial Generation of Natural Language Sai Rajeswar Sandeep Subramanian Francis Dutil C. Pal Aaron Courville GAN 24 204 0 31 May 2017
Jointly Learning Sentence Embeddings and Syntax with Unsupervised Tree-LSTMs Jean Maillard S. Clark Dani Yogatama 26 87 0 25 May 2017
A Regularized Framework for Sparse and Structured Neural Attention Vlad Niculae Mathieu Blondel 20 99 0 22 May 2017
The High-Dimensional Geometry of Binary Neural Networks Alexander G. Anderson C. P. Berg MQ 35 75 0 19 May 2017
Espresso: Efficient Forward Propagation for BCNNs Fabrizio Pedersoli George Tzanetakis Andrea Tagliasacchi MQ 13 13 0 19 May 2017
Simplified Stochastic Feedforward Neural Networks Kimin Lee Jaehyung Kim S. Chong Jinwoo Shin 18 3 0 11 Apr 2017
Online and Linear-Time Attention by Enforcing Monotonic Alignments Colin Raffel Minh-Thang Luong Peter J. Liu Ron J. Weiss Douglas Eck 27 255 0 03 Apr 2017
Boundary-Seeking Generative Adversarial Networks R. Devon Hjelm Athul Paul Jacob Tong Che Adam Trischler Kyunghyun Cho Yoshua Bengio GAN 23 170 0 27 Feb 2017
Memory Augmented Neural Networks with Wormhole Connections Çağlar Gülçehre A. Chandar Yoshua Bengio 18 63 0 30 Jan 2017
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer Noam M. Shazeer Azalia Mirhoseini Krzysztof Maziarz Andy Davis Quoc V. Le Geoffrey E. Hinton J. Dean MoE 55 2,513 0 23 Jan 2017
Stochastic Generative Hashing Bo Dai Ruiqi Guo Sanjiv Kumar Niao He Le Song TPM 35 106 0 11 Jan 2017
Dynamic Deep Neural Networks: Optimizing Accuracy-Efficiency Trade-offs by Selective Execution Lanlan Liu Jia Deng 24 200 0 02 Jan 2017
Effective Quantization Methods for Recurrent Neural Networks Qinyao He He Wen Shuchang Zhou Yuxin Wu Cong Yao Xinyu Zhou Yuheng Zou MQ 24 75 0 30 Nov 2016
Hierarchical Boundary-Aware Neural Encoder for Video Captioning Lorenzo Baraldi C. Grana Rita Cucchiara 26 191 0 28 Nov 2016
Inducing Interpretable Representations with Variational Autoencoders N. Siddharth Brooks Paige Alban Desmaison Jan-Willem van de Meent Frank Wood Noah D. Goodman Pushmeet Kohli Philip Torr BDL DRL 8 6 0 22 Nov 2016
Generalized Dropout Suraj Srinivas R. Venkatesh Babu BDL 20 47 0 21 Nov 2016
Training Sparse Neural Networks Suraj Srinivas Akshayvarun Subramanya R. Venkatesh Babu 11 204 0 21 Nov 2016
Reparameterization trick for discrete variables Seiya Tokui Issei Sato 19 11 0 04 Nov 2016
Categorical Reparameterization with Gumbel-Softmax Eric Jang S. Gu Ben Poole BDL 98 5,286 0 03 Nov 2016
Binary Paragraph Vectors Karol Grzegorczyk Marcin Kurdziel 16 8 0 03 Nov 2016
The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables Chris J. Maddison A. Mnih Yee Whye Teh BDL 24 2,505 0 02 Nov 2016
Professor Forcing: A New Algorithm for Training Recurrent Networks Alex Lamb Anirudh Goyal Ying Zhang Saizheng Zhang Aaron Courville Yoshua Bengio GAN 66 588 0 27 Oct 2016
Discrete Variational Autoencoders J. Rolfe BDL DRL 35 254 0 07 Sep 2016
Hierarchical Multiscale Recurrent Neural Networks Junyoung Chung Sungjin Ahn Yoshua Bengio BDL 31 534 0 06 Sep 2016
Minimalist Regression Network with Reinforced Gradients and Weighted Estimates: a Case Study on Parameters Estimation in Automated Welding Soheil Keshmiri 19 0 0 05 Jul 2016
DoReFa-Net: Training Low Bitwidth Convolutional Neural Networks with Low Bitwidth Gradients Shuchang Zhou Yuxin Wu Zekun Ni Xinyu Zhou He Wen Yuheng Zou MQ 44 2,071 0 20 Jun 2016
Strategic Attentive Writer for Learning Macro-Actions Alexander A. Vezhnevets Volodymyr Mnih J. Agapiou Simon Osindero Alex Graves Oriol Vinyals Koray Kavukcuoglu 16 172 0 15 Jun 2016
Zoneout: Regularizing RNNs by Randomly Preserving Hidden Activations David M. Krueger Tegan Maharaj János Kramár Mohammad Pezeshki Nicolas Ballas Nan Rosemary Ke Anirudh Goyal Yoshua Bengio Aaron Courville C. Pal 10 317 0 03 Jun 2016