Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation

15 August 2013

Aaron Courville

Papers citing "Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation"

50 / 1,874 papers shown

Title
DBQ: A Differentiable Branch Quantizer for Lightweight Deep Neural Networks Hassan Dbouk Hetul Sanghvi M. Mehendale Naresh R Shanbhag MQ 25 9 0 19 Jul 2020
TopoAL: An Adversarial Learning Approach for Topology-Aware Road Segmentation Subeesh Vasu Mateusz Koziñski Leonardo Citraro Pascal Fua GAN 11 7 0 17 Jul 2020
AQD: Towards Accurate Fully-Quantized Object Detection Peng Chen Jing Liu Bohan Zhuang Mingkui Tan Chunhua Shen MQ 34 10 0 14 Jul 2020
Binary Stochastic Filtering: feature selection and beyond Andrii Trelin A. Procházka 26 4 0 08 Jul 2020
An Integer Programming Approach to Deep Neural Networks with Binary Activation Functions B. Bah Jannis Kurtz 13 8 0 07 Jul 2020
FracBits: Mixed Precision Quantization via Fractional Bit-Widths Linjie Yang Qing Jin MQ 22 74 0 04 Jul 2020
Efficient Marginalization of Discrete and Structured Latent Variables via Sparsity Gonçalo M. Correia Vlad Niculae Wilker Aziz André F. T. Martins BDL 30 22 0 03 Jul 2020
Unsupervised Semantic Hashing with Pairwise Reconstruction Casper Hansen Christian B. Hansen J. Simonsen Stephen Alstrup Christina Lioma 19 18 0 01 Jul 2020
GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding Dmitry Lepikhin HyoukJoong Lee Yuanzhong Xu Dehao Chen Orhan Firat Yanping Huang M. Krikun Noam M. Shazeer Zhehuai Chen MoE 43 1,118 0 30 Jun 2020
Composed Fine-Tuning: Freezing Pre-Trained Denoising Autoencoders for Improved Generalization Sang Michael Xie Tengyu Ma Percy Liang 37 13 0 29 Jun 2020
Reliable Categorical Variational Inference with Mixture of Discrete Normalizing Flows Tomasz Kuśmierczyk Arto Klami BDL DRL 16 0 0 28 Jun 2020
Lattice Representation Learning Luis A. Lastras 22 1 0 24 Jun 2020
The Depth-to-Width Interplay in Self-Attention Yoav Levine Noam Wies Or Sharir Hofit Bata Amnon Shashua 30 45 0 22 Jun 2020
IDF++: Analyzing and Improving Integer Discrete Flows for Lossless Compression Rianne van den Berg A. Gritsenko Mostafa Dehghani C. Sønderby Tim Salimans 27 60 0 22 Jun 2020
Generating Annotated High-Fidelity Images Containing Multiple Coherent Objects Bryan G. Cardenas Devanshu Arya D. K. Gupta DiffM 31 6 0 22 Jun 2020
Modeling Lost Information in Lossy Image Compression Yaolong Wang Mingqing Xiao Chang-Shu Liu Shuxin Zheng Tie-Yan Liu 32 23 0 22 Jun 2020
DisARM: An Antithetic Gradient Estimator for Binary Latent Variables Zhe Dong A. Mnih George Tucker DRL 16 32 0 18 Jun 2020
Universally Quantized Neural Compression E. Agustsson Lucas Theis MQ 19 89 0 17 Jun 2020
FrostNet: Towards Quantization-Aware Network Architecture Search Taehoon Kim Y. Yoo Jihoon Yang MQ 22 2 0 17 Jun 2020
Generative Semantic Hashing Enhanced via Boltzmann Machines Lin Zheng Qinliang Su Dinghan Shen Changyou Chen 20 6 0 16 Jun 2020
Towards Understanding the Effect of Leak in Spiking Neural Networks Sayeed Shafayet Chowdhury Chankyu Lee Kaushik Roy 27 56 0 15 Jun 2020
Self-supervised Learning: Generative or Contrastive Xiao Liu Fanjin Zhang Zhenyu Hou Zhaoyu Wang Li Mian Jing Zhang Jie Tang SSL 54 1,588 0 15 Jun 2020
Binary DAD-Net: Binarized Driveable Area Detection Network for Autonomous Driving Alexander Frickenstein M. Vemparala J. Mayr N. S. Nagaraja C. Unger Federico Tombari W. Stechele 9 17 0 15 Jun 2020
Evidence-Aware Inferential Text Generation with Vector Quantised Variational AutoEncoder Daya Guo Duyu Tang Nan Duan Jian Yin Daxin Jiang Ming Zhou DRL 13 10 0 15 Jun 2020
Meta Approach to Data Augmentation Optimization Ryuichiro Hataya Jan Zdenek Kazuki Yoshizoe Hideki Nakayama 32 34 0 14 Jun 2020
CoDeNet: Efficient Deployment of Input-Adaptive Object Detection on Embedded FPGAs Zhen Dong Dequan Wang Qijing Huang Yizhao Gao Yaohui Cai Tian Li Bichen Wu Kurt Keutzer J. Wawrzynek ObjD 36 1 0 12 Jun 2020
Dynamic Model Pruning with Feedback Tao R. Lin Sebastian U. Stich Luis Barba Daniil Dmitriev Martin Jaggi 40 199 0 12 Jun 2020
Ensemble Distillation for Robust Model Fusion in Federated Learning Tao R. Lin Lingjing Kong Sebastian U. Stich Martin Jaggi FedML 19 1,017 0 12 Jun 2020
Surrogate gradients for analog neuromorphic computing Benjamin Cramer Sebastian Billaudelle Simeon Kanya Aron Leibfried Andreas Grubl ... Korbinian Schreiber Yannik Stradmann Johannes Weis Johannes Schemmel Friedemann Zenke 26 107 0 12 Jun 2020
Reintroducing Straight-Through Estimators as Principled Methods for Stochastic Binary Networks Alexander Shekhovtsov Dmitry Molchanov MQ 17 15 0 11 Jun 2020
Data Augmentation for Graph Neural Networks Tong Zhao Yozen Liu Leonardo Neves Oliver J. Woodford Meng Jiang Neil Shah GNN 32 407 0 11 Jun 2020
DNF-Net: A Neural Architecture for Tabular Data A. Abutbul G. Elidan L. Katzir Ran El-Yaniv LMTD AI4CE 29 29 0 11 Jun 2020
Latent Transformations for Discrete-Data Normalising Flows Rob D. Hesselink Wilker Aziz DRL 21 1 0 11 Jun 2020
Discrete Latent Variable Representations for Low-Resource Text Classification Shuning Jin Sam Wiseman K. Stratos Karen Livescu BDL 14 15 0 11 Jun 2020
Improving Inference for Neural Image Compression Yibo Yang Robert Bamler Stephan Mandt 19 122 0 07 Jun 2020
An Overview of Neural Network Compression James OÑeill AI4CE 47 98 0 05 Jun 2020
Real-time Human Activity Recognition Using Conditionally Parametrized Convolutions on Mobile and Wearable Devices Xin-Hua Cheng Lefei Zhang Yin Tang Yue Liu Hao Wu Jun He CVBM 3DH HAI 24 55 0 05 Jun 2020
Path Sample-Analytic Gradient Estimators for Stochastic Binary Networks Alexander Shekhovtsov V. Yanush B. Flach MQ 37 11 0 04 Jun 2020
Weight Pruning via Adaptive Sparsity Loss George Retsinas Athena Elafrou G. Goumas Petros Maragos 45 10 0 04 Jun 2020
Surprisal-Triggered Conditional Computation with Neural Networks Loren Lugosch Derek Nowrouzezahrai B. Meyer 27 6 0 02 Jun 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 130 40,394 0 28 May 2020
In search of isoglosses: continuous and discrete language embeddings in Slavic historical phonology C. Cathcart Florian Wandl 14 6 0 27 May 2020
Generating Semantically Valid Adversarial Questions for TableQA Yi Zhu Yiwei Zhou Menglin Xia AAML 18 5 0 26 May 2020
Fast differentiable DNA and protein sequence optimization for molecular design Johannes Linder Georg Seelig 41 54 0 22 May 2020
Pairwise Supervised Hashing with Bernoulli Variational Auto-Encoder and Self-Control Gradient Estimator Siamak Zamani Dadaneh Shahin Boluki Mingzhang Yin Mingyuan Zhou Xiaoning Qian BDL DRL 6 22 0 21 May 2020
Contrastive Learning for Debiased Candidate Generation in Large-Scale Recommender Systems Chang Zhou Jianxin Ma Jianwei Zhang Jingren Zhou Hongxia Yang 31 142 0 20 May 2020
Vector-quantized neural networks for acoustic unit discovery in the ZeroSpeech 2020 challenge Benjamin van Niekerk Leanne Nortje Herman Kamper 33 115 0 19 May 2020
COVI White Paper H. Alsdurf Edmond Belliveau Yoshua Bengio T. Deleu Prateek Gupta ... Abhinav Sharma B. Struck Jian Tang Martin Weiss Y. Yu 29 29 0 18 May 2020
Semi-supervised Learning for Multi-speaker Text-to-speech Synthesis Using Discrete Speech Representation Tao Tu Yuan-Jui Chen Alexander H. Liu Hung-yi Lee 33 7 0 16 May 2020
Movement Pruning: Adaptive Sparsity by Fine-Tuning Victor Sanh Thomas Wolf Alexander M. Rush 32 472 0 15 May 2020