Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation

15 August 2013

Aaron Courville

Papers citing "Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation"

50 / 1,869 papers shown

Title
Low-Power Computer Vision: Status, Challenges, Opportunities S. Alyamkin M. Ardi Alexander C. Berg Achille Brighton Bo Chen ... George K. Thiruvathukal Baiwu Zhang Jingchi Zhang Xiaopeng Zhang Shaojie Zhuo 26 10 0 15 Apr 2019
CondConv: Conditionally Parameterized Convolutions for Efficient Inference Brandon Yang Gabriel Bender Quoc V. Le Jiquan Ngiam MedIm 3DV 31 622 0 10 Apr 2019
$L_0$ -ARM: Network Sparsification via Stochastic Binary Optimization Yang Li Shihao Ji MQ 14 15 0 09 Apr 2019
SEQ^3: Differentiable Sequence-to-Sequence-to-Sequence Autoencoder for Unsupervised Abstractive Sentence Compression Christos Baziotis Ion Androutsopoulos Ioannis Konstas Alexandros Potamianos 25 83 0 07 Apr 2019
Modeling Point Clouds with Self-Attention and Gumbel Subset Sampling Jiancheng Yang Qiang Zhang Bingbing Ni Linguo Li Jinxian Liu Mengdie Zhou Qi Tian 3DPC 38 379 0 06 Apr 2019
FLightNNs: Lightweight Quantized Deep Neural Networks for Fast and Accurate Inference Ruizhou Ding Z. Liu Ting-Wu Chin Diana Marculescu R. D. R. D. Blanton MQ 14 25 0 05 Apr 2019
Regularizing Activation Distribution for Training Binarized Deep Networks Ruizhou Ding Ting-Wu Chin Z. Liu Diana Marculescu MQ 19 145 0 04 Apr 2019
Differentiable Sampling with Flexible Reference Word Order for Neural Machine Translation Weijia Xu Xing Niu Marine Carpuat 21 10 0 04 Apr 2019
Progressive Stochastic Binarization of Deep Networks David Hartmann Michael Wand MQ 17 1 0 03 Apr 2019
Bit-Flip Attack: Crushing Neural Network with Progressive Bit Search Adnan Siraj Rakin Zhezhi He Deliang Fan AAML 21 219 0 28 Mar 2019
Learning Discrete Structures for Graph Neural Networks Luca Franceschi Mathias Niepert Massimiliano Pontil X. He GNN 30 410 0 28 Mar 2019
Training Quantized Neural Networks with a Full-precision Auxiliary Module Bohan Zhuang Lingqiao Liu Mingkui Tan Chunhua Shen Ian Reid MQ 32 62 0 27 Mar 2019
BitSplit-Net: Multi-bit Deep Neural Network with Bitwise Activation Function Hyungjun Kim Yulhwa Kim Sungju Ryu Jae-Joon Kim MQ 19 0 0 23 Mar 2019
Disentangled Representation Learning in Cardiac Image Analysis A. Chartsias T. Joyce G. Papanastasiou M. Williams D. Newby R. Dharmakumar Sotirios A. Tsaftaris DRL 25 126 0 22 Mar 2019
Stochastic Optimization of Sorting Networks via Continuous Relaxations Aditya Grover Eric Wang Aaron Zweig Stefano Ermon 9 167 0 21 Mar 2019
Trained Quantization Thresholds for Accurate and Efficient Fixed-Point Inference of Deep Neural Networks Sambhav R. Jain Albert Gural Michael Wu Chris Dick MQ 16 147 0 19 Mar 2019
A RAD approach to deep mixture models Laurent Dinh Jascha Narain Sohl-Dickstein Hugo Larochelle Razvan Pascanu 14 45 0 18 Mar 2019
Enabling Spike-based Backpropagation for Training Deep Neural Network Architectures Chankyu Lee Syed Shakib Sarwar Priyadarshini Panda G. Srinivasan Kaushik Roy 22 385 0 15 Mar 2019
Consistent Dialogue Generation with Self-supervised Feature Learning Yizhe Zhang Xiang Gao Sungjin Lee Chris Brockett Michel Galley Jianfeng Gao W. Dolan 22 28 0 13 Mar 2019
Understanding Straight-Through Estimator in Training Activation Quantized Neural Nets Penghang Yin J. Lyu Shuai Zhang Stanley Osher Y. Qi Jack Xin MQ LLMSV 21 306 0 13 Mar 2019
Progressive Generative Adversarial Binary Networks for Music Generation Manan Oza H. Vaghela Kriti Srivastava AI4CE GAN 16 6 0 12 Mar 2019
Hierarchical Autoregressive Image Models with Auxiliary Decoders J. Fauw Sander Dieleman Karen Simonyan GAN 30 37 0 06 Mar 2019
Learning low-precision neural networks without Straight-Through Estimator(STE) Z. G. Liu Matthew Mattina MQ 24 34 0 04 Mar 2019
Learning To Follow Directions in Street View Karl Moritz Hermann Mateusz Malinowski Piotr Wojciech Mirowski Andras Banki-Horvath Keith Anderson R. Hadsell SSL 24 66 0 01 Mar 2019
Learned Step Size Quantization S. K. Esser J. McKinstry Deepika Bablani R. Appuswamy D. Modha MQ 20 778 0 21 Feb 2019
advertorch v0.1: An Adversarial Robustness Toolbox based on PyTorch G. Ding Luyu Wang Xiaomeng Jin 24 182 0 20 Feb 2019
Low-bit Quantization of Neural Networks for Efficient Inference Yoni Choukroun Eli Kravchik Fan Yang P. Kisilev MQ 33 355 0 18 Feb 2019
Binary Stochastic Filtering: a Method for Neural Network Size Minimization and Supervised Feature Selection Andrii Trelin A. Procházka MQ 8 1 0 12 Feb 2019
Multitask Learning for Polyphonic Piano Transcription, a Case Study Rainer Kelz Sebastian Böck Gerhard Widmer 13 9 0 12 Feb 2019
GAN- vs. JPEG2000 Image Compression for Distributed Automotive Perception: Higher Peak SNR Does Not Mean Better Semantic Segmentation Jonas Löhdefink Andreas Bär Nico M. Schmidt Fabian Hüger Peter Schlicht Tim Fingscheidt 29 15 0 12 Feb 2019
Deep Hashing using Entropy Regularised Product Quantisation Network Jo Schlemper Jose Caballero Andrew P. Aitken Joost R. van Amersfoort 11 1 0 11 Feb 2019
Binarized Knowledge Graph Embeddings Koki Kishimoto Katsuhiko Hayashi Genki Akai Masashi Shimbo Kazunori Komatani MQ 14 11 0 08 Feb 2019
Self-Binarizing Networks Fayez Lahoud R. Achanta Pablo Márquez-Neila Sabine Süsstrunk MQ 19 23 0 02 Feb 2019
Hierarchical Photo-Scene Encoder for Album Storytelling Bairui Wang Lin Ma Wei Zhang Wenhao Jiang Feng-Li Zhang 11 28 0 02 Feb 2019
Critical initialisation in continuous approximations of binary neural networks G. Stamatescu Federica Gerace C. Lucibello I. Fuss L. White 25 0 0 01 Feb 2019
Surrogate Gradient Learning in Spiking Neural Networks Emre Neftci Hesham Mostafa Friedemann Zenke 21 1,207 0 28 Jan 2019
Unsupervised speech representation learning using WaveNet autoencoders J. Chorowski Ron J. Weiss Samy Bengio Aaron van den Oord SSL 14 318 0 25 Jan 2019
Energy Confused Adversarial Metric Learning for Zero-Shot Image Retrieval and Clustering Binghui Chen Weihong Deng 31 29 0 22 Jan 2019
Deep Neural Network Approximation for Custom Hardware: Where We've Been, Where We're Going Erwei Wang James J. Davis Ruizhe Zhao Ho-Cheung Ng Xinyu Niu Wayne Luk P. Cheung George A. Constantinides 24 59 0 21 Jan 2019
DSConv: Efficient Convolution Operator Marcelo Gennari Roger Fawcett V. Prisacariu MQ 32 62 0 07 Jan 2019
Credit Assignment Techniques in Stochastic Computation Graphs T. Weber N. Heess Lars Buesing David Silver 15 45 0 07 Jan 2019
Vector representations of text data in deep learning Karol Grzegorczyk 19 12 0 07 Jan 2019
Per-Tensor Fixed-Point Quantization of the Back-Propagation Algorithm Charbel Sakr Naresh R Shanbhag MQ 14 43 0 31 Dec 2018
SQuantizer: Simultaneous Learning for Both Sparse and Low-precision Neural Networks M. Park Xiaofang Xu C. Brick MQ 27 8 0 20 Dec 2018
Generating Diverse and Meaningful Captions Annika Lindh R. Ross Abhijit Mahalunkar Giancarlo D. Salton John D. Kelleher VLM 13 10 0 19 Dec 2018
Fast Adjustable Threshold For Uniform Neural Network Quantization (Winning solution of LPIRC-II) A. Goncharenko Andrey Denisov S. Alyamkin Evgeny Terentev MQ 17 20 0 19 Dec 2018
Mask-aware networks for crowd counting Shengqin Jiang Xiaobo Lu Yinjie Lei Lingqiao Liu 20 41 0 18 Dec 2018
Deep learning incorporating biologically-inspired neural dynamics Stanisław Woźniak A. Pantazi Thomas Bohnstingl E. Eleftheriou 9 9 0 17 Dec 2018
Recent Advances in Autoencoder-Based Representation Learning Michael Tschannen Olivier Bachem Mario Lucic OOD SSL DRL 12 440 0 12 Dec 2018
A Main/Subsidiary Network Framework for Simplifying Binary Neural Network Yinghao Xu Xin Dong Yudian Li Hao Su 27 27 0 11 Dec 2018