Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation

15 August 2013

Aaron Courville

Papers citing "Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation"

50 / 1,874 papers shown

Title
Memory and Computation-Efficient Kernel SVM via Binary Embedding and Ternary Model Coefficients Zijian Lei Liang Lan MQ 14 1 0 06 Oct 2020
Understanding the Mechanics of SPIGOT: Surrogate Gradients for Latent Structure Learning Tsvetomila Mihaylova Vlad Niculae André F. T. Martins SyDa 31 7 0 05 Oct 2020
Mastering Atari with Discrete World Models Danijar Hafner Timothy Lillicrap Mohammad Norouzi Jimmy Ba DRL 53 823 0 05 Oct 2020
Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks Róbert Csordás Sjoerd van Steenkiste Jürgen Schmidhuber 53 88 0 05 Oct 2020
Binary Neural Networks for Memory-Efficient and Effective Visual Place Recognition in Changing Environments Bruno Ferrarini Michael Milford Klaus D. McDonald-Maier Shoaib Ehsan MQ 25 23 0 01 Oct 2020
Stochastic Precision Ensemble: Self-Knowledge Distillation for Quantized Deep Neural Networks Yoonho Boo Sungho Shin Jungwook Choi Wonyong Sung MQ 30 29 0 30 Sep 2020
BAMSProd: A Step towards Generalizing the Adaptive Optimization Methods to Deep Binary Model Junjie Liu Dongchao Wen Deyu Wang Wei Tao Tse-Wei Chen Kinya Osa Masami Kato MQ 29 1 0 29 Sep 2020
Rotated Binary Neural Network Mingbao Lin Rongrong Ji Zi-Han Xu Baochang Zhang Yan Wang Yongjian Wu Feiyue Huang Chia-Wen Lin MQ 24 129 0 28 Sep 2020
Neurocoder: Learning General-Purpose Computation Using Stored Neural Programs Hung Le Svetha Venkatesh NAI 17 5 0 24 Sep 2020
A Probabilistic End-To-End Task-Oriented Dialog Model with Latent Belief States towards Semi-Supervised Learning Yichi Zhang Zhijian Ou Huixin Wang Junlan Feng RALM 29 67 0 17 Sep 2020
MSP: An FPGA-Specific Mixed-Scheme, Multi-Precision Deep Neural Network Quantization Framework Sung-En Chang Yanyu Li Mengshu Sun Weiwen Jiang Runbin Shi Xue Lin Yanzhi Wang MQ 27 7 0 16 Sep 2020
SoFAr: Shortcut-based Fractal Architectures for Binary Convolutional Neural Networks Baozhou Zhu P. Hofstee Jinho Lee Zaid Al-Ars MQ 17 2 0 11 Sep 2020
Multi-Task Learning with Deep Neural Networks: A Survey M. Crawshaw CVBM 55 610 0 10 Sep 2020
QuantNet: Learning to Quantize by Learning within Fully Differentiable Framework Junjie Liu Dongchao Wen Deyu Wang Wei Tao Tse-Wei Chen Kinya Osa Masami Kato MQ 28 3 0 10 Sep 2020
Unsupervised Part Discovery by Unsupervised Disentanglement Sandro Braun Patrick Esser Bjorn Ommer OCL 19 4 0 09 Sep 2020
FleXOR: Trainable Fractional Quantization Dongsoo Lee S. Kwon Byeongwook Kim Yongkweon Jeon Baeseong Park Jeongin Yun MQ 21 13 0 09 Sep 2020
Low-Rank Training of Deep Neural Networks for Emerging Memory Technology Albert Gural P. Nadeau M. Tikekar B. Murmann 26 5 0 08 Sep 2020
Alternating Direction Method of Multipliers for Quantization Tianjian Huang Prajwal Singhania Maziar Sanjabi Pabitra Mitra Meisam Razaviyayn MQ 30 10 0 08 Sep 2020
Understanding the wiring evolution in differentiable neural architecture search Sirui Xie Shou-Yong Hu Xinjiang Wang Chunxiao Liu Jianping Shi Xunying Liu Dahua Lin 12 9 0 02 Sep 2020
Reinforcement Learning with Feedback-modulated TD-STDP Stephen Chung R. Kozma 11 3 0 29 Aug 2020
Learning to Balance Specificity and Invariance for In and Out of Domain Generalization Prithvijit Chattopadhyay Yogesh Balaji Judy Hoffman OOD 34 204 0 28 Aug 2020
Measuring the Biases and Effectiveness of Content-Style Disentanglement Xiao Liu Spyridon Thermos Gabriele Valvano A. Chartsias Alison Q. OÑeil Sotirios A. Tsaftaris CoGe DRL 37 18 0 27 Aug 2020
Lossy Image Compression with Normalizing Flows Leonhard Helminger Abdelaziz Djelouah Markus Gross Christopher Schroers 19 47 0 24 Aug 2020
One Weight Bitwidth to Rule Them All Ting-Wu Chin P. Chuang Vikas Chandra Diana Marculescu MQ 28 25 0 22 Aug 2020
Biased Mixtures Of Experts: Enabling Computer Vision Inference Under Data Transfer Limitations Alhabib Abbas Y. Andreopoulos MoE 19 18 0 21 Aug 2020
Differentiable TAN Structure Learning for Bayesian Network Classifiers Wolfgang Roth Franz Pernkopf BDL 21 2 0 21 Aug 2020
Training of mixed-signal optical convolutional neural network with reduced quantization level Joseph Ulseth Zheyuan Zhu Guifang Li Shuo Pang 10 0 0 20 Aug 2020
Conditional Wasserstein GAN-based Oversampling of Tabular Data for Imbalanced Learning Justin Engelmann Stefan Lessmann 19 227 0 20 Aug 2020
Intelligence plays dice: Stochasticity is essential for machine learning M. Sabuncu 34 6 0 17 Aug 2020
WSRNet: Joint Spotting and Recognition of Handwritten Words George Retsinas Giorgos Sfikas Petros Maragos 11 2 0 17 Aug 2020
Unsupervised Acoustic Unit Representation Learning for Voice Conversion using WaveNet Auto-encoders Mingjie Chen Thomas Hain SSL DRL 19 15 0 16 Aug 2020
Cascaded channel pruning using hierarchical self-distillation Roy Miles K. Mikolajczyk 24 7 0 16 Aug 2020
Towards Modality Transferable Visual Information Representation with Optimal Model Compression Rongqun Lin Linwei Zhu Shiqi Wang Sam Kwong 42 2 0 13 Aug 2020
Compression of Deep Learning Models for Text: A Survey Manish Gupta Puneet Agrawal VLM MedIm AI4CE 22 115 0 12 Aug 2020
FATNN: Fast and Accurate Ternary Neural Networks Peng Chen Bohan Zhuang Chunhua Shen MQ 6 15 0 12 Aug 2020
Degree-Quant: Quantization-Aware Training for Graph Neural Networks Shyam A. Tailor Javier Fernandez-Marques Nicholas D. Lane GNN MQ 29 140 0 11 Aug 2020
Towards Lossless Binary Convolutional Neural Networks Using Piecewise Approximation Baozhou Zhu Zaid Al-Ars Wei Pan MQ 22 8 0 08 Aug 2020
NASB: Neural Architecture Search for Binary Convolutional Neural Networks Baozhou Zhu Zaid Al-Ars P. Hofstee MQ 24 23 0 08 Aug 2020
Learning Sampling in Financial Statement Audits using Vector Quantised Autoencoder Neural Networks Marco Schreyer Timur Sattarov Anita Gierbl Bernd Reimer Damian Borth DRL 30 3 0 06 Aug 2020
Optimal Variance Control of the Score Function Gradient Estimator for Importance Weighted Bounds Valentin Liévin Andrea Dittadi Anders Christensen Ole Winther DRL 30 6 0 05 Aug 2020
AR-Net: Adaptive Frame Resolution for Efficient Action Recognition Yue Meng Chung-Ching Lin Yikang Shen P. Sattigeri Leonid Karlinsky A. Oliva Kate Saenko Rogerio Feris 23 141 0 31 Jul 2020
Neural Language Generation: Formulation, Methods, and Evaluation Cristina Garbacea Qiaozhu Mei 45 30 0 31 Jul 2020
Foveation for Segmentation of Ultra-High Resolution Images Chen Jin Ryutaro Tanno Moucheng Xu T. Mertzanidou Daniel C. Alexander AI4TS 24 4 0 29 Jul 2020
Privacy-preserving Voice Analysis via Disentangled Representations Ranya Aloufi Hamed Haddadi David E. Boyle DRL 31 58 0 29 Jul 2020
FIVES: Feature Interaction Via Edge Search for Large-Scale Tabular Data Yuexiang Xie Zhen Wang Yaliang Li Bolin Ding Nezihe Merve Gürel Ce Zhang Minlie Huang Wei Lin Jingren Zhou 62 28 0 29 Jul 2020
Extending LOUPE for K-space Under-sampling Pattern Optimization in Multi-coil MRI Jinwei Zhang Hang Zhang Alan Q. Wang Qihao Zhang M. Sabuncu P. Spincemaille Thanh D. Nguyen Yi Wang 25 34 0 28 Jul 2020
T-BFA: Targeted Bit-Flip Adversarial Weight Attack Adnan Siraj Rakin Zhezhi He Jingtao Li Fan Yao C. Chakrabarti Deliang Fan AAML 22 13 0 24 Jul 2020
Wasserstein Routed Capsule Networks Alexander Fuchs Franz Pernkopf 40 7 0 22 Jul 2020
Differentiable Joint Pruning and Quantization for Hardware Efficiency Ying Wang Yadong Lu Tijmen Blankevoort MQ 30 72 0 20 Jul 2020
HMQ: Hardware Friendly Mixed Precision Quantization Block for CNNs H. Habi Roy H. Jennings Arnon Netzer MQ 29 65 0 20 Jul 2020