Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation

15 August 2013

Aaron Courville

Papers citing "Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation"

50 / 1,874 papers shown

Title
Bayesian Bits: Unifying Quantization and Pruning M. V. Baalen Christos Louizos Markus Nagel Rana Ali Amjad Ying Wang Tijmen Blankevoort Max Welling MQ 18 114 0 14 May 2020
Dynamic Sparse Training: Find Efficient Sparse Network From Scratch With Trainable Masked Layers Junjie Liu Zhe Xu Runbin Shi R. Cheung Hayden Kwok-Hay So 17 119 0 14 May 2020
Invertible Image Rescaling Mingqing Xiao Shuxin Zheng Chang-Shu Liu Yaolong Wang Di He Guolin Ke Jiang Bian Zhouchen Lin Tie-Yan Liu SupR 33 234 0 12 May 2020
Lossy Compression with Distortion Constrained Optimization T. V. Rozendaal Guillaume Sautière Taco S. Cohen 31 13 0 08 May 2020
Efficient Exact Verification of Binarized Neural Networks Kai Jia Martin Rinard AAML MQ 17 58 0 07 May 2020
ENGINE: Energy-Based Inference Networks for Non-Autoregressive Machine Translation Lifu Tu Richard Yuanzhe Pang Sam Wiseman Kevin Gimpel 26 51 0 02 May 2020
Hide-and-Seek: A Template for Explainable AI Thanos Tagaris A. Stafylopatis 14 6 0 30 Apr 2020
On the Spontaneous Emergence of Discrete and Compositional Signals Nur Lan Emmanuel Chemla Shane Steinert-Threlkeld LRM 16 8 0 30 Apr 2020
Generative Adversarial Networks (GANs Survey): Challenges, Solutions, and Future Directions Divya Saxena Jiannong Cao AAML AI4CE 26 287 0 30 Apr 2020
How do Decisions Emerge across Layers in Neural Models? Interpretation with Differentiable Masking Nicola De Cao M. Schlichtkrull Wilker Aziz Ivan Titov 25 90 0 30 Apr 2020
Memristors -- from In-memory computing, Deep Learning Acceleration, Spiking Neural Networks, to the Future of Neuromorphic and Bio-inspired Computing A. Mehonic Abu Sebastian Bipin Rajendran Osvaldo Simeone Eleni Vasilaki A. Kenyon 24 200 0 30 Apr 2020
Polygonal Building Segmentation by Frame Field Learning N. Girard Dmitriy Smirnov Justin Solomon Y. Tarabalka 11 26 0 30 Apr 2020
Towards Unsupervised Language Understanding and Generation by Joint Dual Learning Shang-Yu Su Chao-Wei Huang Yun-Nung Chen 22 26 0 30 Apr 2020
Faster Depth-Adaptive Transformers Yijin Liu Fandong Meng Jie Zhou Jinan Xu Jinan Xu 22 2 0 27 Apr 2020
Learning Neural-Symbolic Descriptive Planning Models via Cube-Space Priors: The Voyage Home (to STRIPS) Masataro Asai Christian Muise 9 6 0 27 Apr 2020
Masking as an Efficient Alternative to Finetuning for Pretrained Language Models Mengjie Zhao Tao R. Lin Fei Mi Martin Jaggi Hinrich Schütze 33 120 0 26 Apr 2020
The Variational Bandwidth Bottleneck: Stochastic Evaluation on an Information Budget Anirudh Goyal Yoshua Bengio M. Botvinick Sergey Levine 22 24 0 24 Apr 2020
Automatic low-bit hybrid quantization of neural networks through meta learning Tao Wang Junsong Wang Chang Xu Chao Xue MQ 16 2 0 24 Apr 2020
Up or Down? Adaptive Rounding for Post-Training Quantization Markus Nagel Rana Ali Amjad M. V. Baalen Christos Louizos Tijmen Blankevoort MQ 10 557 0 22 Apr 2020
Discrete Variational Attention Models for Language Generation Xianghong Fang Haoli Bai Zenglin Xu Michael Lyu Irwin King DRL 15 0 0 21 Apr 2020
Integer Quantization for Deep Learning Inference: Principles and Empirical Evaluation Hao Wu Patrick Judd Xiaojie Zhang Mikhail Isaev Paulius Micikevicius MQ 34 340 0 20 Apr 2020
LSQ+: Improving low-bit quantization through learnable offsets and better initialization Yash Bhalgat Jinwon Lee Markus Nagel Tijmen Blankevoort Nojun Kwak MQ 20 213 0 20 Apr 2020
Role-Wise Data Augmentation for Knowledge Distillation Jie Fu Xue Geng Zhijian Duan Bohan Zhuang Xingdi Yuan Adam Trischler Jie Lin C. Pal Hao Dong 27 15 0 19 Apr 2020
Training with Quantization Noise for Extreme Model Compression Angela Fan Pierre Stock Benjamin Graham Edouard Grave Remi Gribonval Hervé Jégou Armand Joulin MQ 24 243 0 15 Apr 2020
Speech Translation and the End-to-End Promise: Taking Stock of Where We Are Matthias Sperber Matthias Paulik 30 106 0 14 Apr 2020
Explaining Question Answering Models through Text Generation Veronica Latcinnik Jonathan Berant LRM 16 51 0 12 Apr 2020
Depthwise Discrete Representation Learning Iordanis Fostiropoulos BDL 22 0 0 11 Apr 2020
Learning Discrete Structured Representations by Adversarially Maximizing Mutual Information K. Stratos Sam Wiseman SSL DRL 11 7 0 08 Apr 2020
LogicNets: Co-Designed Neural Networks and Circuits for Extreme-Throughput Applications Yaman Umuroglu Yash Akhauri Nicholas J. Fraser Michaela Blott MQ 20 88 0 06 Apr 2020
Conditional Channel Gated Networks for Task-Aware Continual Learning Davide Abati Jakub M. Tomczak Tijmen Blankevoort Simone Calderara Rita Cucchiara B. Bejnordi CLL 42 184 0 31 Mar 2020
Binary Neural Networks: A Survey Haotong Qin Ruihao Gong Xianglong Liu Xiao Bai Jingkuan Song N. Sebe MQ 55 459 0 31 Mar 2020
Architecture Disentanglement for Deep Neural Networks Jie Hu Liujuan Cao QiXiang Ye Tong Tong Shengchuan Zhang Ke Li Feiyue Huang Rongrong Ji Ling Shao AAML 31 16 0 30 Mar 2020
Dynamic Narrowing of VAE Bottlenecks Using GECO and L0 Regularization Cedric De Boom Samuel T. Wauthier Tim Verbelen Bart Dhoedt DRL 13 6 0 24 Mar 2020
Learning End-to-End Codes for the BPSK-constrained Gaussian Wiretap Channel Alireza Nooraiepour Sina Rezaei Aghdam 21 2 0 23 Mar 2020
Invariant Rationalization Shiyu Chang Yang Zhang Mo Yu Tommi Jaakkola 205 202 0 22 Mar 2020
Solving Inverse Problems with a Flow-based Noise Model Jay Whang Qi Lei A. Dimakis 64 36 0 18 Mar 2020
Efficient Bitwidth Search for Practical Mixed Precision Neural Network Yuhang Li Wei Wang Haoli Bai Ruihao Gong Xin Dong F. Yu MQ 21 20 0 17 Mar 2020
Efficient Content-Based Sparse Attention with Routing Transformers Aurko Roy M. Saffar Ashish Vaswani David Grangier MoE 255 580 0 12 Mar 2020
DADA: Differentiable Automatic Data Augmentation Yonggang Li Guosheng Hu Yongtao Wang Timothy M. Hospedales N. Robertson Yongxin Yang 35 107 0 08 Mar 2020
Scalable Approximate Inference and Some Applications Jun Han BDL 22 1 0 07 Mar 2020
AutoML-Zero: Evolving Machine Learning Algorithms From Scratch Esteban Real Chen Liang David R. So Quoc V. Le 44 220 0 06 Mar 2020
A Survey on Deep Hashing Methods Xiao Luo Haixin Wang Huasong Zhong C. L. Philip Chen Minghua Deng Jianqiang Huang Xiansheng Hua 41 170 0 04 Mar 2020
Learning to Hash with Graph Neural Networks for Recommender Systems Qiaoyu Tan Ninghao Liu Xing Zhao Hongxia Yang Jingren Zhou Xia Hu 26 94 0 04 Mar 2020
Propagating Asymptotic-Estimated Gradients for Low Bitwidth Quantized Neural Networks Jun Chen Yong Liu Hao Zhang Shengnan Hou Jian Yang MQ 25 7 0 04 Mar 2020
Generalized Gumbel-Softmax Gradient Estimator for Generic Discrete Random Variables Weonyoung Joo Dongjun Kim Seung-Jae Shin Il-Chul Moon 21 1 0 04 Mar 2020
Depth-Adaptive Graph Recurrent Network for Text Classification Yijin Liu Fandong Meng Jinan Xu Jinan Xu Jie Zhou 39 3 0 29 Feb 2020
WaveQ: Gradient-Based Deep Quantization of Neural Networks through Sinusoidal Adaptive Regularization Ahmed T. Elthakeb Prannoy Pilligundla Fatemehsadat Mireshghallah T. Elgindi Charles-Alban Deledalle H. Esmaeilzadeh MQ 25 10 0 29 Feb 2020
Auto-Encoding Twin-Bottleneck Hashing Yuming Shen Jie Qin Jiaxin Chen Mengyang Yu Li Liu Fan Zhu Fumin Shen Ling Shao 12 121 0 27 Feb 2020
Training Binary Neural Networks using the Bayesian Learning Rule Xiangming Meng Roman Bachmann Mohammad Emtiyaz Khan BDL MQ 35 40 0 25 Feb 2020
Robust Quantization: One Model to Rule Them All Moran Shkolnik Brian Chmiel Ron Banner Gil Shomron Yury Nahshan A. Bronstein U. Weiser OOD MQ 22 75 0 18 Feb 2020