Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation

15 August 2013

Aaron Courville

Papers citing "Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation"

50 / 1,869 papers shown

Title
Conditional Information Gain Networks Ufuk Can Biçici Cem Keskin L. Akarun 11 9 0 25 Jul 2018
Backprop-Q: Generalized Backpropagation for Stochastic Computation Graphs Xiaoran Xu Songpeng Zu Yuan Zhang Hanning Zhou Wei Feng BDL 6 4 0 25 Jul 2018
NullaNet: Training Deep Neural Networks for Reduced-Memory-Access Inference M. Nazemi Ghasem Pasandi Massoud Pedram 20 20 0 23 Jul 2018
Optimize Deep Convolutional Neural Network with Ternarized Weights and High Accuracy Zhezhi He Boqing Gong Deliang Fan 13 22 0 20 Jul 2018
Understanding and Improving Interpolation in Autoencoders via an Adversarial Regularizer David Berthelot Colin Raffel Aurko Roy Ian Goodfellow 15 260 0 19 Jul 2018
Adaptive Neural Trees Ryutaro Tanno Kai Arulkumaran Daniel C. Alexander A. Criminisi A. Nori 27 165 0 17 Jul 2018
Bridging the Accuracy Gap for 2-bit Quantized Neural Networks (QNN) Jungwook Choi P. Chuang Zhuo Wang Swagath Venkataramani Vijayalakshmi Srinivasan K. Gopalakrishnan MQ 13 75 0 17 Jul 2018
Revisiting the Hierarchical Multiscale LSTM Ákos Kádár Marc-Alexandre Côté Grzegorz Chrupała A. Alishahi 14 13 0 10 Jul 2018
SYQ: Learning Symmetric Quantization For Efficient Deep Neural Networks Julian Faraone Nicholas J. Fraser Michaela Blott Philip H. W. Leong MQ 30 133 0 01 Jul 2018
Guided evolutionary strategies: Augmenting random search with surrogate gradients Niru Maheswaranathan Luke Metz George Tucker Dami Choi Jascha Narain Sohl-Dickstein 22 20 0 26 Jun 2018
The challenge of realistic music generation: modelling raw audio at scale Sander Dieleman Aaron van den Oord Karen Simonyan 21 184 0 26 Jun 2018
Learning K-way D-dimensional Discrete Codes for Compact Embedding Representations Ting-Li Chen Martin Renqiang Min Yizhou Sun 26 70 0 21 Jun 2018
Binary Ensemble Neural Network: More Bits per Network or More Networks per Bit? Shilin Zhu Xin Dong Hao Su MQ 30 135 0 20 Jun 2018
On Accurate Evaluation of GANs for Language Generation Stanislau Semeniuta Aliaksei Severyn Sylvain Gelly EGVM 39 81 0 13 Jun 2018
Latent Tree Learning with Differentiable Parsers: Shift-Reduce Parsing and Chart Parsing Jean Maillard S. Clark 21 18 0 03 Jun 2018
Adding New Tasks to a Single Network with Weight Transformations using Binary Masks Massimiliano Mancini Elisa Ricci Barbara Caputo Samuel Rota Buló 25 51 0 28 May 2018
Inducing Grammars with and for Neural Machine Translation Ke M. Tran Yonatan Bisk 20 22 0 28 May 2018
Towards the first adversarially robust neural network model on MNIST Lukas Schott Jonas Rauber Matthias Bethge Wieland Brendel AAML OOD 14 369 0 23 May 2018
AxTrain: Hardware-Oriented Neural Network Training for Approximate Inference Xin He Liu Ke Wenyan Lu Guihai Yan Xuan Zhang 19 33 0 21 May 2018
DVAE#: Discrete Variational Autoencoders with Relaxed Boltzmann Priors Arash Vahdat Evgeny Andriyash W. Macready 13 49 0 18 May 2018
GumBolt: Extending Gumbel trick to Boltzmann priors Amir Khoshaman Mohammad H. Amin 19 14 0 18 May 2018
Learning Permutations with Sinkhorn Policy Gradient Patrick Emami Sanjay Ranka 6 54 0 18 May 2018
PACT: Parameterized Clipping Activation for Quantized Neural Networks Jungwook Choi Zhuo Wang Swagath Venkataramani P. Chuang Vijayalakshmi Srinivasan K. Gopalakrishnan MQ 13 936 0 16 May 2018
NASH: Toward End-to-End Neural Architecture for Generative Semantic Hashing Dinghan Shen Qinliang Su Paidamoyo Chapfuwa Wenlin Wang Guoyin Wang Lawrence Carin Ricardo Henao 6 58 0 14 May 2018
Backpropagating through Structured Argmax using a SPIGOT Hao Peng Sam Thomson Noah A. Smith 20 42 0 12 May 2018
Convolutional Generative Adversarial Networks with Binary Neurons for Polyphonic Music Generation Hao-Wen Dong Yi-Hsuan Yang GAN MGen 21 94 0 25 Apr 2018
Convolutional Neural Networks Regularized by Correlated Noise Shamak Dutta B. Tripp Graham W. Taylor 19 6 0 03 Apr 2018
Feed-forward Uncertainty Propagation in Belief and Neural Networks Alexander Shekhovtsov B. Flach M. Busta 22 4 0 28 Mar 2018
Conducting Credit Assignment by Aligning Local Representations Alexander Ororbia A. Mali Daniel Kifer C. Lee Giles ODL 18 29 0 05 Mar 2018
Recurrent Binary Embedding for GPU-Enabled Exhaustive Retrieval from Billion-Scale Semantic Vectors Ying Shan Jian Jiao Jiehan Zhu J. C. Mao 14 11 0 18 Feb 2018
Model compression via distillation and quantization A. Polino Razvan Pascanu Dan Alistarh MQ 31 718 0 15 Feb 2018
DVAE++: Discrete Variational Autoencoders with Overlapping Transformations Arash Vahdat W. Macready Zhengbing Bian Amir Khoshaman Evgeny Andriyash 37 75 0 14 Feb 2018
Predicting Adversarial Examples with High Confidence A. Galloway Graham W. Taylor M. Moussa AAML 21 9 0 13 Feb 2018
Learning and Querying Fast Generative Models for Reinforcement Learning Lars Buesing T. Weber S. Racanière S. M. Ali Eslami Danilo Jimenez Rezende ... Fabio Viola F. Besse Karol Gregor Demis Hassabis Daan Wierstra OffRL 19 134 0 08 Feb 2018
Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examples Anish Athalye Nicholas Carlini D. Wagner AAML 60 3,157 0 01 Feb 2018
Fast Power system security analysis with Guided Dropout Benjamin Donnot Isabelle M Guyon Marc Schoenauer Antoine Marot P. Panciatici 20 28 0 30 Jan 2018
Empirical Explorations in Training Networks with Discrete Activations S. Baluja MQ 26 1 0 16 Jan 2018
Audio Adversarial Examples: Targeted Attacks on Speech-to-Text Nicholas Carlini D. Wagner AAML 21 1,073 0 05 Jan 2018
Learning Sparse Neural Networks through $L_0$ Regularization Christos Louizos Max Welling Diederik P. Kingma 31 1,129 0 04 Dec 2017
Layer-wise Learning of Stochastic Neural Networks with Information Bottleneck Thanh T. Nguyen Jaesik Choi 20 13 0 04 Dec 2017
Probabilistic Adaptive Computation Time Michael Figurnov Artem Sobolev Dmitry Vetrov BDL 22 8 0 01 Dec 2017
Convolutional Networks with Adaptive Inference Graphs Andreas Veit Serge J. Belongie OOD GNN 38 382 0 30 Nov 2017
Towards Accurate Binary Convolutional Neural Network Xiaofan Lin Cong Zhao Wei Pan MQ 19 635 0 30 Nov 2017
Plan, Attend, Generate: Planning for Sequence-to-Sequence Models Francis Dutil Çağlar Gülçehre Adam Trischler Yoshua Bengio 20 12 0 28 Nov 2017
On the Robustness of Semantic Segmentation Models to Adversarial Attacks Anurag Arnab O. Mikšík Philip Torr AAML 31 304 0 27 Nov 2017
End-to-End Supervised Product Quantization for Image Search and Retrieval Benjamin Klein Lior Wolf MQ 19 65 0 23 Nov 2017
ACtuAL: Actor-Critic Under Adversarial Learning Anirudh Goyal Nan Rosemary Ke Alex Lamb R. Devon Hjelm C. Pal Joelle Pineau Yoshua Bengio GAN 20 9 0 13 Nov 2017
Learning K-way D-dimensional Discrete Code For Compact Embedding Representations Ting Chen Martin Renqiang Min Yizhou Sun 11 10 0 08 Nov 2017
Tangent: Automatic Differentiation Using Source Code Transformation in Python B. V. Merrienboer Alexander B. Wiltschko D. Moldovan 25 29 0 07 Nov 2017
Neural Speed Reading via Skim-RNN Minjoon Seo Sewon Min Ali Farhadi Hannaneh Hajishirzi 37 79 0 06 Nov 2017