Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation

15 August 2013

Aaron Courville

Papers citing "Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation"

50 / 1,874 papers shown

Title
Abstract Reasoning via Logic-guided Generation Sihyun Yu Sangwoo Mo SungSoo Ahn Jinwoo Shin 21 6 0 22 Jul 2021
Differentiable Feature Selection, a Reparameterization Approach Jérémie Donà Patrick Gallinari OOD 30 9 0 21 Jul 2021
An overview of mixing augmentation methods and augmentation strategies Dominik Lewy Jacek Mańdziuk 33 61 0 21 Jul 2021
GenRadar: Self-supervised Probabilistic Camera Synthesis based on Radar Frequencies Carsten Ditzel Klaus C. J. Dietmayer 14 3 0 19 Jul 2021
A High-Performance Adaptive Quantization Approach for Edge CNN Applications Hsu-Hsun Chin R. Tsay Hsin-I Wu MQ 24 5 0 18 Jul 2021
Learning De-identified Representations of Prosody from Raw Audio J. Weston R. Lenain U. Meepegama E. Fristed SSL 37 15 0 17 Jul 2021
CCVS: Context-aware Controllable Video Synthesis G. L. Moing Jean Ponce Cordelia Schmid 27 78 0 16 Jul 2021
Scalable Optimal Transport in High Dimensions for Graph Distances, Embedding Alignment, and More Johannes Klicpera Marten Lienen Stephan Günnemann OT 23 13 0 14 Jul 2021
ROBIN: A Robust Optical Binary Neural Network Accelerator Febin P. Sunny Asif Mirza Mahdi Nikdast S. Pasricha MQ 33 35 0 12 Jul 2021
The Bayesian Learning Rule Mohammad Emtiyaz Khan Håvard Rue BDL 68 73 0 09 Jul 2021
$S^3$ : Sign-Sparse-Shift Reparametrization for Effective Training of Low-bit Shift Networks Xinlin Li Bang Liu Yaoliang Yu Wulong Liu Chunjing Xu V. Nia MQ 38 5 0 07 Jul 2021
Differentiable Architecture Pruning for Transfer Learning Nicolo Colombo Yang Gao 36 2 0 07 Jul 2021
Universal Approximation of Functions on Sets E. Wagstaff F. Fuchs Martin Engelcke Michael A. Osborne Ingmar Posner PINN 38 54 0 05 Jul 2021
Quantum Annealing Formulation for Binary Neural Networks Michele Sasdelli Tat-Jun Chin MQ 32 16 0 05 Jul 2021
Exact Backpropagation in Binary Weighted Networks with Group Weight Transformations Yaniv Shulman MQ 16 1 0 03 Jul 2021
CHISEL: Compression-Aware High-Accuracy Embedded Indoor Localization with Deep Learning Liping Wang Saideep Tiku S. Pasricha 27 32 0 02 Jul 2021
Learned Token Pruning for Transformers Sehoon Kim Sheng Shen D. Thorsley A. Gholami Woosuk Kwon Joseph Hassoun Kurt Keutzer 17 146 0 02 Jul 2021
Classical Planning in Deep Latent Space Masataro Asai Hiroshi Kajino A. Fukunaga Christian Muise VLM 25 20 0 30 Jun 2021
LNS-Madam: Low-Precision Training in Logarithmic Number System using Multiplicative Weight Update Jiawei Zhao Steve Dai Rangharajan Venkatesan Brian Zimmer Mustafa Ali Xuan Li Brucek Khailany B. Dally Anima Anandkumar MQ 39 13 0 26 Jun 2021
CADDA: Class-wise Automatic Differentiable Data Augmentation for EEG Signals Cédric Rommel Thomas Moreau Joseph Paillard Alexandre Gramfort 19 37 0 25 Jun 2021
PQK: Model Compression via Pruning, Quantization, and Knowledge Distillation Jang-Hyun Kim Simyung Chang Nojun Kwak 30 44 0 25 Jun 2021
IA-RED $^2$ : Interpretability-Aware Redundancy Reduction for Vision Transformers Bowen Pan Yikang Shen Yi Ding Zhangyang Wang Rogerio Feris A. Oliva VLM ViT 44 156 0 23 Jun 2021
Fitting summary statistics of neural data with a differentiable spiking network simulator G. Bellec Shuqi Wang Alireza Modirshanechi Johanni Brea W. Gerstner 46 11 0 18 Jun 2021
Quantized Neural Networks via {-1, +1} Encoding Decomposition and Acceleration Qigong Sun Xiufang Li Fanhua Shang Hongying Liu Kan Yang L. Jiao Zhouchen Lin MQ 31 0 0 18 Jun 2021
On Anytime Learning at Macroscale Lucas Caccia Jing Xu Myle Ott MarcÁurelio Ranzato Ludovic Denoyer 29 25 0 17 Jun 2021
Efficient Deep Learning: A Survey on Making Deep Learning Models Smaller, Faster, and Better Gaurav Menghani VLM MedIm 23 367 0 16 Jun 2021
Discrete Auto-regressive Variational Attention Models for Text Modeling Xianghong Fang Haoli Bai Jian Li Zenglin Xu Michael Lyu Irwin King 40 3 0 16 Jun 2021
Minimizing Communication while Maximizing Performance in Multi-Agent Reinforcement Learning V. Vijay Hassam Sheikh Somdeb Majumdar Mariano Phielipp 30 5 0 15 Jun 2021
A White Paper on Neural Network Quantization Markus Nagel Marios Fournarakis Rana Ali Amjad Yelysei Bondarenko M. V. Baalen Tijmen Blankevoort MQ 41 512 0 15 Jun 2021
Coupled Gradient Estimators for Discrete Latent Variables Zhe Dong A. Mnih George Tucker BDL 38 13 0 15 Jun 2021
Neuroevolution-Enhanced Multi-Objective Optimization for Mixed-Precision Quantization Santiago Miret Vui Seng Chua Mattias Marder Mariano Phielipp Nilesh Jain Somdeb Majumdar 23 8 0 14 Jun 2021
The Backpropagation Algorithm Implemented on Spiking Neuromorphic Hardware Alpha Renner F. Sheldon Anatoly Zlotnik L. Tao A. Sornborger 23 38 0 13 Jun 2021
A Free Lunch From ANN: Towards Efficient, Accurate Spiking Neural Networks Calibration Yuhang Li Shi-Wee Deng Xin Dong Ruihao Gong Shi Gu 30 185 0 13 Jun 2021
Scaling Vision with Sparse Mixture of Experts C. Riquelme J. Puigcerver Basil Mustafa Maxim Neumann Rodolphe Jenatton André Susano Pinto Daniel Keysers N. Houlsby MoE 29 580 0 10 Jun 2021
Cross-Modal Discrete Representation Learning Alexander H. Liu SouYoung Jin Cheng-I Jeff Lai Andrew Rouditchenko A. Oliva James R. Glass SSL 30 40 0 10 Jun 2021
Zero Time Waste: Recycling Predictions in Early Exit Neural Networks Maciej Wołczyk Bartosz Wójcik Klaudia Bałazy Igor T. Podolak Jacek Tabor Marek Śmieja Tomasz Trzciñski AI4CE 28 49 0 09 Jun 2021
Vector Quantized Models for Planning Sherjil Ozair Yazhe Li Ali Razavi Ioannis Antonoglou Aaron van den Oord Oriol Vinyals OffRL 32 49 0 08 Jun 2021
Unsupervised Word Segmentation from Discrete Speech Units in Low-Resource Settings Marcely Zanon Boito Bolaji Yusuf Lucas Ondel Aline Villavicencio Laurent Besacier 31 3 0 08 Jun 2021
NWT: Towards natural audio-to-video generation with representation learning Rayhane Mama Marc S. Tyndel Hashiam Kadhim Cole Clifford Ragavan Thurairatnam VGen 34 12 0 08 Jun 2021
Neural Hybrid Automata: Learning Dynamics with Multiple Modes and Stochastic Transitions Michael Poli Stefano Massaroli Luca Scimeca Seong Joon Oh Sanghyuk Chun Atsushi Yamashita Hajime Asama Jinkyoo Park Animesh Garg AI4TS AI4CE 287 6 0 08 Jun 2021
DSelect-k: Differentiable Selection in the Mixture of Experts with Applications to Multi-Task Learning Hussein Hazimeh Zhe Zhao Aakanksha Chowdhery M. Sathiamoorthy Yihua Chen Rahul Mazumder Lichan Hong Ed H. Chi MoE 26 139 0 07 Jun 2021
Combinatorial Optimization for Panoptic Segmentation: A Fully Differentiable Approach Ahmed Abbas Paul Swoboda 32 14 0 06 Jun 2021
The Image Local Autoregressive Transformer Chenjie Cao Yue Hong Xiang Li Chengrong Wang C. Xu Xiangyang Xue Yanwei Fu 30 13 0 04 Jun 2021
Segmental Contrastive Predictive Coding for Unsupervised Word Segmentation Saurabhchand Bhati Jesús Villalba Piotr Żelasko Laureano Moro-Velazquez Najim Dehak SSL 27 37 0 03 Jun 2021
Implicit MLE: Backpropagating Through Discrete Exponential Family Distributions Mathias Niepert Pasquale Minervini Luca Franceschi 37 81 0 03 Jun 2021
LLC: Accurate, Multi-purpose Learnt Low-dimensional Binary Codes Aditya Kusupati Matthew Wallingford Vivek Ramanujan Raghav Somani J. S. Park Krishna Pillutla Prateek Jain Sham Kakade Ali Farhadi MQ OffRL 31 9 0 02 Jun 2021
Bottom-up and top-down approaches for the design of neuromorphic processing systems: Tradeoffs and synergies between natural and artificial intelligence Charlotte Frenkel D. Bol Giacomo Indiveri 41 34 0 02 Jun 2021
Distribution Matching for Rationalization Yongfeng Huang Yujun Chen Yulun Du Zhilin Yang OOD 34 16 0 01 Jun 2021
Factorising Meaning and Form for Intent-Preserving Paraphrasing Tom Hosking Mirella Lapata OOD 20 40 0 31 May 2021
Transferable Sparse Adversarial Attack Ziwen He Wei Wang Jing Dong Tieniu Tan AAML 19 20 0 31 May 2021