Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation

15 August 2013

Aaron Courville

Papers citing "Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation"

50 / 1,869 papers shown

Title
Channel selection using Gumbel Softmax Charles Herrmann Richard Strong Bowen Ramin Zabih 23 3 0 11 Dec 2018
Efficient and Robust Machine Learning for Real-World Systems Franz Pernkopf Wolfgang Roth Matthias Zöhrer Lukas Pfeifenberger Günther Schindler Holger Froening Sebastian Tschiatschek Robert Peharz Matthew Mattina Zoubin Ghahramani OOD 27 1 0 05 Dec 2018
Learning Multimodal Graph-to-Graph Translation for Molecular Optimization Wengong Jin Kevin Kaichuang Yang Regina Barzilay Tommi Jaakkola 33 224 0 03 Dec 2018
Mixed Precision Quantization of ConvNets via Differentiable Neural Architecture Search Bichen Wu Yanghan Wang Peizhao Zhang Yuandong Tian Peter Vajda Kurt Keutzer MQ 22 272 0 30 Nov 2018
Learning Finite State Representations of Recurrent Policy Networks Anurag Koul S. Greydanus Alan Fern 19 88 0 29 Nov 2018
You Look Twice: GaterNet for Dynamic Filter Selection in CNNs Zhourong Chen Yang Li Samy Bengio Si Si 27 97 0 27 Nov 2018
Eliminating Exposure Bias and Loss-Evaluation Mismatch in Multiple Object Tracking Andrii Maksai Pascal Fua VOT 16 17 0 27 Nov 2018
Efficient non-uniform quantizer for quantized neural network targeting reconfigurable hardware Natan Liss Chaim Baskin A. Mendelson A. Bronstein Raja Giryes MQ 21 5 0 27 Nov 2018
Structured Binary Neural Networks for Accurate Image Classification and Semantic Segmentation Bohan Zhuang Chunhua Shen Mingkui Tan Lingqiao Liu Ian Reid MQ 27 152 0 22 Nov 2018
SpotTune: Transfer Learning through Adaptive Fine-tuning Yunhui Guo Humphrey Shi Abhishek Kumar Kristen Grauman Tajana Simunic Rogerio Feris 36 445 0 21 Nov 2018
Modular Networks: Learning to Decompose Neural Computation Louis Kirsch Julius Kunze David Barber 11 109 0 13 Nov 2018
Generalized Ternary Connect: End-to-End Learning and Compression of Multiplication-Free Deep Neural Networks Samyak Parajuli Aswin Raghavan S. Chai 21 7 0 12 Nov 2018
Bi-Directional Differentiable Input Reconstruction for Low-Resource Neural Machine Translation Xing Niu Weijia Xu Marine Carpuat 19 17 0 02 Nov 2018
Towards the AlexNet Moment for Homomorphic Encryption: HCNN, theFirst Homomorphic CNN on Encrypted Data with GPUs Ahmad Al Badawi Jin Chao Jie Lin Chan Fook Mun Sim Jun Jie B. Tan Xiao Nan Khin Mi Mi Aung V. Chandrasekhar 21 64 0 02 Nov 2018
Online Embedding Compression for Text Classification using Low Rank Matrix Factorization Anish Acharya Rahul Goel A. Metallinou Inderjit Dhillon 11 58 0 01 Nov 2018
End-to-End Feedback Loss in Speech Chain Framework via Straight-Through Estimator Andros Tjandra S. Sakti Satoshi Nakamura 11 44 0 31 Oct 2018
Improved Network Robustness with Adversary Critic Alexander Matyasko Lap-Pui Chau AAML 19 14 0 30 Oct 2018
Whetstone: A Method for Training Deep Artificial Neural Networks for Binary Communication William M. Severa C. Vineyard Ryan Dellana Stephen J Verzi J. Aimone 13 95 0 26 Oct 2018
Reversible Recurrent Neural Networks M. Mackay Paul Vicol Jimmy Ba Roger C. Grosse 6 52 0 25 Oct 2018
Piano Genie Chris Donahue Ian Simon Sander Dieleman 14 43 0 11 Oct 2018
Rao-Blackwellized Stochastic Gradients for Discrete Distributions Runjing Liu Jeffrey Regier Nilesh Tripuraneni Michael I. Jordan Jon D. McAuliffe 15 31 0 10 Oct 2018
Training Generative Adversarial Networks with Binary Neurons by End-to-end Backpropagation Hao-Wen Dong Yi-Hsuan Yang SyDa GAN MQ 11 11 0 10 Oct 2018
Feature Selection using Stochastic Gates Yutaro Yamada Ofir Lindenbaum S. Negahban Y. Kluger 22 43 0 09 Oct 2018
Relaxed Quantization for Discretized Neural Networks Christos Louizos M. Reisser Tijmen Blankevoort E. Gavves Max Welling MQ 36 131 0 03 Oct 2018
2018 Low-Power Image Recognition Challenge S. Alyamkin M. Ardi Achille Brighton Alexander C. Berg Yiran Chen ... George K. Thiruvathukal Baiwu Zhang Jingchi Zhang Xiaopeng Zhang Shaojie Zhuo BDL 15 13 0 03 Oct 2018
Learning to Segment Inputs for NMT Favors Character-Level Processing Julia Kreutzer Artem Sokolov 16 31 0 02 Oct 2018
Simultaneously Optimizing Weight and Quantizer of Ternary Neural Network using Truncated Gaussian Approximation Zhezhi He Deliang Fan MQ 16 66 0 02 Oct 2018
NICE: Noise Injection and Clamping Estimation for Neural Network Quantization Chaim Baskin Natan Liss Yoav Chai Evgenii Zheltonozhskii Eli Schwartz Raja Giryes A. Mendelson A. Bronstein MQ 11 60 0 29 Sep 2018
Improved Gradient-Based Optimization Over Discrete Distributions Evgeny Andriyash Arash Vahdat W. Macready 16 9 0 29 Sep 2018
Tangent: Automatic differentiation using source-code transformation for dynamically typed array programming B. V. Merrienboer D. Moldovan Alexander B. Wiltschko 15 31 0 25 Sep 2018
No Multiplication? No Floating Point? No Problem! Training Networks for Efficient Inference S. Baluja David Marwood Michele Covell Nick Johnston MQ 21 8 0 24 Sep 2018
Adversarial Defense via Data Dependent Activation Function and Total Variation Minimization Bao Wang A. Lin Weizhi Zhu Penghang Yin Andrea L. Bertozzi Stanley J. Osher AAML 31 21 0 23 Sep 2018
Discovering Low-Precision Networks Close to Full-Precision Networks for Efficient Embedded Inference J. McKinstry S. K. Esser R. Appuswamy Deepika Bablani John V. Arthur Izzet B. Yildiz D. Modha MQ 18 94 0 11 Sep 2018
Are You Sure You Want To Do That? Classification with Verification Harris Chan Atef Chaudhury Kevin Shen 6 0 0 07 Sep 2018
Learning Sparse Low-Precision Neural Networks With Learnable Regularization Yoojin Choi Mostafa El-Khamy Jungwon Lee MQ 30 31 0 01 Sep 2018
Revisiting Character-Based Neural Machine Translation with Capacity and Compression Colin Cherry George F. Foster Ankur Bapna Orhan Firat Wolfgang Macherey 23 94 0 29 Aug 2018
Learning to Quantize Deep Networks by Optimizing Quantization Intervals with Task Loss S. Jung Changyong Son Seohyung Lee JinWoo Son Youngjun Kwak Jae-Joon Han Sung Ju Hwang Changkyu Choi MQ 25 372 0 17 Aug 2018
DNN Feature Map Compression using Learned Representation over GF(2) Denis A. Gudovskiy Alec Hodgkinson Luca Rigazio 6 17 0 15 Aug 2018
Blended Coarse Gradient Descent for Full Quantization of Deep Neural Networks Penghang Yin Shuai Zhang J. Lyu Stanley Osher Y. Qi Jack Xin MQ 44 61 0 15 Aug 2018
Learning ReLU Networks on Linearly Separable Data: Algorithm, Optimality, and Generalization G. Wang G. Giannakis Jie Chen MLT 24 131 0 14 Aug 2018
A Survey on Methods and Theories of Quantized Neural Networks Yunhui Guo MQ 29 231 0 13 Aug 2018
A Fourier View of REINFORCE Adeel Pervez 22 0 0 12 Aug 2018
Training Compact Neural Networks with Binary Weights and Low Precision Activations Bohan Zhuang Chunhua Shen Ian Reid MQ 13 14 0 08 Aug 2018
Segmental Audio Word2Vec: Representing Utterances as Sequences of Vectors with Applications in Spoken Term Detection Yu-Hsuan Wang Hung-yi Lee Lin-Shan Lee 25 54 0 07 Aug 2018
A Review of Learning with Deep Generative Models from Perspective of Graphical Modeling Zhijian Ou 31 16 0 05 Aug 2018
Learning Visual Question Answering by Bootstrapping Hard Attention Mateusz Malinowski Carl Doersch Adam Santoro Peter W. Battaglia OOD 24 96 0 01 Aug 2018
Deep Encoder-Decoder Models for Unsupervised Learning of Controllable Speech Synthesis G. Henter Jaime Lorenzo-Trueba Xin Wang Junichi Yamagishi DRL SSL 13 61 0 30 Jul 2018
ARM: Augment-REINFORCE-Merge Gradient for Stochastic Binary Networks Mingzhang Yin Mingyuan Zhou MQ 26 11 0 30 Jul 2018
MaskConnect: Connectivity Learning by Gradient Descent Karim Ahmed Lorenzo Torresani 22 48 0 28 Jul 2018
LQ-Nets: Learned Quantization for Highly Accurate and Compact Deep Neural Networks Dongqing Zhang Jiaolong Yang Dongqiangzi Ye G. Hua MQ 23 696 0 26 Jul 2018