Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation

15 August 2013

Aaron Courville

Papers citing "Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation"

50 / 1,874 papers shown

Title
Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Models Sam Bond-Taylor Adam Leach Yang Long Chris G. Willcocks VLM TPM 48 485 0 08 Mar 2021
Contextual Dropout: An Efficient Sample-Dependent Dropout Module Xinjie Fan Shujian Zhang Korawat Tanwisuth Xiaoning Qian Mingyuan Zhou OOD BDL UQCV 30 27 0 06 Mar 2021
crank: An Open-Source Software for Nonparallel Voice Conversion Based on Vector-Quantized Variational Autoencoder Kazuhiro Kobayashi Wen-Chin Huang Yi-Chiao Wu Patrick Lumban Tobing Tomoki Hayashi Tomoki Toda BDL DRL 14 19 0 04 Mar 2021
Learning Accurate and Interpretable Decision Rule Sets from Neural Networks Litao Qiao Weijia Wang Bill Lin FaML 19 39 0 04 Mar 2021
Self-Distribution Binary Neural Networks Ping Xue Yang Lu Jingfei Chang Xing Wei Zhen Wei MQ 21 10 0 03 Mar 2021
Predicting Video with VQVAE Jacob Walker Ali Razavi Aaron van den Oord DRL 24 67 0 02 Mar 2021
Improved Techniques for Quantizing Deep Networks with Adaptive Bit-Widths Ximeng Sun Yikang Shen Chun-Fu Chen Naigang Wang Bowen Pan Bowen Pan Kailash Gopalakrishnan A. Oliva Rogerio Feris Kate Saenko MQ 27 4 0 02 Mar 2021
E $^2$ CM: Early Exit via Class Means for Efficient Supervised and Unsupervised Learning Alperen Görmez Venkateswara Dasari Erdem Koyuncu 22 7 0 01 Mar 2021
Learning Frequency Domain Approximation for Binary Neural Networks Yixing Xu Kai Han Chang Xu Yehui Tang Chunjing Xu Yunhe Wang MQ 22 54 0 01 Mar 2021
A Brief Introduction to Generative Models Alex Lamb GAN VLM 22 16 0 27 Feb 2021
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 257 4,816 0 24 Feb 2021
Anytime Sampling for Autoregressive Models via Ordered Autoencoding Yilun Xu Yang Song Sahaj Garg Linyuan Gong Rui Shu Aditya Grover Stefano Ermon DiffM 40 11 0 23 Feb 2021
On the Effects of Quantisation on Model Uncertainty in Bayesian Neural Networks Martin Ferianc Partha P. Maji Matthew Mattina Miguel R. D. Rodrigues UQCV BDL 30 9 0 22 Feb 2021
Neural Sampling Machine with Stochastic Synapse allows Brain-like Learning and Inference S. Dutta Georgios Detorakis A. Khanna B. Grisafe Emre Neftci S. Datta BDL 27 44 0 20 Feb 2021
BSQ: Exploring Bit-Level Sparsity for Mixed-Precision Neural Network Quantization Huanrui Yang Lin Duan Yiran Chen Hai Helen Li MQ 21 64 0 20 Feb 2021
GradFreeBits: Gradient Free Bit Allocation for Dynamic Low Precision Neural Networks Ben Bodner G. B. Shalom Eran Treister MQ 27 2 0 18 Feb 2021
Accelerated Sparse Neural Training: A Provable and Efficient Method to Find N:M Transposable Masks Itay Hubara Brian Chmiel Moshe Island Ron Banner S. Naor Daniel Soudry 59 111 0 16 Feb 2021
SiMaN: Sign-to-Magnitude Network Binarization Mingbao Lin Rongrong Ji Zi-Han Xu Baochang Zhang Rongrong Ji Chia-Wen Lin Ling Shao AAML MQ 29 25 0 16 Feb 2021
VA-RED $^2$ : Video Adaptive Redundancy Reduction Bowen Pan Yikang Shen Camilo Luciano Fosco Chung-Ching Lin A. Andonian Yue Meng Kate Saenko A. Oliva Rogerio Feris 20 19 0 15 Feb 2021
Learning Accurate Decision Trees with Bandit Feedback via Quantized Gradient Descent Ajaykrishna Karthikeyan Naman Jain Nagarajan Natarajan Prateek Jain MQ 24 13 0 15 Feb 2021
FAT: Learning Low-Bitwidth Parametric Representation via Frequency-Aware Transformation Chaofan Tao Rui Lin Quan Chen Zhaoyang Zhang Ping Luo Ngai Wong MQ 34 7 0 15 Feb 2021
Confounding Tradeoffs for Neural Network Quantization Sahaj Garg Anirudh Jain Joe Lou Mitchell Nahmias MQ 29 17 0 12 Feb 2021
Dynamic Precision Analog Computing for Neural Networks Sahaj Garg Joe Lou Anirudh Jain Mitchell Nahmias 45 33 0 12 Feb 2021
AdaFuse: Adaptive Temporal Fusion Network for Efficient Action Recognition Yue Meng Yikang Shen Chung-Ching Lin P. Sattigeri Leonid Karlinsky Kate Saenko A. Oliva Rogerio Feris 73 62 0 10 Feb 2021
Dynamic Neural Networks: A Survey Yizeng Han Gao Huang Shiji Song Le Yang Honghui Wang Yulin Wang 3DH AI4TS AI4CE 23 629 0 09 Feb 2021
Unlocking Pixels for Reinforcement Learning via Implicit Attention K. Choromanski Deepali Jain Wenhao Yu Xingyou Song Jack Parker-Holder ... Aldo Pacchiano Anirban Santara Yunhao Tang Jie Tan Adrian Weller OffRL 33 3 0 08 Feb 2021
Efficient Certified Defenses Against Patch Attacks on Image Classifiers J. H. Metzen Maksym Yatsura AAML 23 40 0 08 Feb 2021
Learning N:M Fine-grained Structured Sparse Neural Networks From Scratch Aojun Zhou Yukun Ma Junnan Zhu Jianbo Liu Zhijie Zhang Kun Yuan Wenxiu Sun Hongsheng Li 69 241 0 08 Feb 2021
BinaryCoP: Binary Neural Network-based COVID-19 Face-Mask Wear and Positioning Predictor on Edge Devices Nael Fasfous M. Vemparala Alexander Frickenstein Lukas Frickenstein W. Stechele CVBM 31 35 0 06 Feb 2021
RpBERT: A Text-image Relation Propagation-based BERT Model for Multimodal NER Lin Sun Jiquan Wang Kai Zhang Yindu Su Fangsheng Weng 22 133 0 05 Feb 2021
Adversarial Contrastive Pre-training for Protein Sequences Matthew B. A. McDermott Brendan Yap Harry Hsu Di Jin Peter Szolovits AAML 28 9 0 31 Jan 2021
VX2TEXT: End-to-End Learning of Video-Based Text Generation From Multimodal Inputs Xudong Lin Gedas Bertasius Jue Wang Shih-Fu Chang Devi Parikh Lorenzo Torresani VGen 33 66 0 28 Jan 2021
Information contraction in noisy binary neural networks and its implications Chuteng Zhou Quntao Zhuang Matthew Mattina P. Whatmough 19 2 0 28 Jan 2021
Overfitting for Fun and Profit: Instance-Adaptive Data Compression T. V. Rozendaal Iris A. M. Huijben Taco S. Cohen 25 47 0 21 Jan 2021
Slot Machines: Discovering Winning Combinations of Random Weights in Neural Networks Maxwell Mbabilla Aladago Lorenzo Torresani 33 10 0 16 Jan 2021
KDLSQ-BERT: A Quantized Bert Combining Knowledge Distillation with Learned Step Size Quantization Jing Jin Cai Liang Tiancheng Wu Li Zou Zhiliang Gan MQ 19 26 0 15 Jan 2021
Single-path Bit Sharing for Automatic Loss-aware Model Compression Jing Liu Bohan Zhuang Peng Chen Chunhua Shen Jianfei Cai Mingkui Tan MQ 15 7 0 13 Jan 2021
Binary Graph Neural Networks Mehdi Bahri Gaétan Bahl S. Zafeiriou GNN AI4CE 11 49 0 31 Dec 2020
Learned Multi-Resolution Variable-Rate Image Compression with Octave-based Residual Blocks Mohammad Akbari Jie Liang Jingning Han Chengjie Tu 17 20 0 31 Dec 2020
Differentiable Programming à la Moreau Vincent Roulet Zaïd Harchaoui 25 5 0 31 Dec 2020
Improving Adversarial Robustness in Weight-quantized Neural Networks Chang Song Elias Fallon Hai Helen Li AAML 27 19 0 29 Dec 2020
Interpretable NLG for Task-oriented Dialogue Systems with Heterogeneous Rendering Machines Yangming Li Kaisheng Yao 14 5 0 29 Dec 2020
Adversarial Multi-scale Feature Learning for Person Re-identification Xinglu Wang BDL 11 1 0 28 Dec 2020
Deep Unsupervised Image Hashing by Maximizing Bit Entropy Yun-qiang Li Jan van Gemert 8 91 0 22 Dec 2020
Neural Methods for Effective, Efficient, and Exposure-Aware Information Retrieval Bhaskar Mitra 20 5 0 21 Dec 2020
Learning to Localize Through Compressed Binary Maps Xinkai Wei Ioan Andrei Bârsan Shenlong Wang Julieta Martinez R. Urtasun SSL 34 31 0 20 Dec 2020
On (Emergent) Systematic Generalisation and Compositionality in Visual Referential Games with Straight-Through Gumbel-Softmax Estimator Kevin Denamganai James Alfred Walker 21 10 0 19 Dec 2020
Resource-efficient DNNs for Keyword Spotting using Neural Architecture Search and Quantization David Peter Wolfgang Roth Franz Pernkopf 21 6 0 18 Dec 2020
FantastIC4: A Hardware-Software Co-Design Approach for Efficiently Running 4bit-Compact Multilayer Perceptrons Simon Wiedemann Suhas Shivapakash P. Wiedemann Daniel Becking Wojciech Samek F. Gerfers Thomas Wiegand MQ 28 7 0 17 Dec 2020
Taming Transformers for High-Resolution Image Synthesis Patrick Esser Robin Rombach Bjorn Ommer ViT 64 2,837 0 17 Dec 2020