Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation

15 August 2013

Aaron Courville

Papers citing "Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation"

50 / 1,874 papers shown

Title
Continual Task Allocation in Meta-Policy Network via Sparse Prompting Yijun Yang Tianyi Zhou Jing Jiang Guodong Long Yuhui Shi CLL OffRL 46 9 0 29 May 2023
One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning Guangtao Zeng Peiyuan Zhang Wei Lu 23 21 0 28 May 2023
Evolving Connectivity for Recurrent Spiking Neural Networks Guan-Bo Wang Yuhao Sun Sijie Cheng Sen Song 22 5 0 28 May 2023
Disentanglement via Latent Quantization Kyle Hsu W. Dorrell James C. R. Whittington Jiajun Wu Chelsea Finn DRL 31 25 0 28 May 2023
Differentiable Random Partition Models Thomas M. Sutter Alain Ryser Joram Liebeskind Julia E. Vogt 55 3 0 26 May 2023
Learning to Quantize Vulnerability Patterns and Match to Locate Statement-Level Vulnerabilities Michael Fu Trung Le Van Nguyen Chakkrit Tantithamthavorn Dinh Q. Phung 41 3 0 26 May 2023
A Hybrid Neural Coding Approach for Pattern Recognition with Spiking Neural Networks Xinyi Chen Qu Yang Jibin Wu Haizhou Li Kay Chen Tan 30 16 0 26 May 2023
Exploiting Noise as a Resource for Computation and Learning in Spiking Neural Networks Gehua (Marcus) Ma Rui Yan Huajin Tang 39 21 0 25 May 2023
RAND: Robustness Aware Norm Decay For Quantized Seq2seq Models David Qiu David Rim Shaojin Ding Oleg Rybakov Yanzhang He MQ 35 4 0 24 May 2023
BinaryViT: Towards Efficient and Accurate Binary Vision Transformers Junrui Xiao Zhikai Li Lianwei Yang Qingyi Gu MQ ViT 38 2 0 24 May 2023
Bi-ViT: Pushing the Limit of Vision Transformer Quantization Yanjing Li Sheng Xu Mingbao Lin Xianbin Cao Chuanjian Liu Xiao Sun Baochang Zhang ViT MQ 55 11 0 21 May 2023
BOLT: Fast Energy-based Controlled Text Generation with Tunable Biases Xin Liu Muhammad Khalifa Lu Wang 38 18 0 19 May 2023
Inventing art styles with no artistic training data Nilin Abrahamsen Jiahao Yao GAN 36 3 0 19 May 2023
PDP: Parameter-free Differentiable Pruning is All You Need Minsik Cho Saurabh N. Adya Devang Naik VLM 24 11 0 18 May 2023
DinoSR: Self-Distillation and Online Clustering for Self-supervised Speech Representation Learning Alexander H. Liu Heng-Jui Chang Michael Auli Wei-Ning Hsu James R. Glass 29 25 0 17 May 2023
Efficient Equivariant Transfer Learning from Pretrained Models Sourya Basu Pulkit Katdare P. Sattigeri Vijil Chenthamarakshan Katherine Driggs Campbell Payel Das Lav Varshney 48 7 0 17 May 2023
Straightening Out the Straight-Through Estimator: Overcoming Optimization Challenges in Vector Quantized Networks Minyoung Huh Brian Cheung Pulkit Agrawal Phillip Isola MQ 36 48 0 15 May 2023
GSB: Group Superposition Binarization for Vision Transformer with Limited Training Samples T. Gao Chengzhong Xu Le Zhang Hui Kong 43 4 0 13 May 2023
Accelerator-Aware Training for Transducer-Based Speech Recognition Suhaila M. Shakiah Rupak Vignesh Swaminathan Hieu Duy Nguyen Raviteja Chinta Tariq Afzal Nathan Susanj Athanasios Mouchtaris Grant P. Strimel Ariya Rastrow 24 1 0 12 May 2023
$$\partial\mathbb{B}$ nets: learning discrete functions by gradient descent$ $\partial\mathbb{B}$ nets: learning discrete functions by gradient descent Ian Wright 76 0 0 12 May 2023
Quantization Aware Attack: Enhancing Transferable Adversarial Attacks by Model Quantization Yulong Yang Chenhao Lin Qian Li Zhengyu Zhao Haoran Fan Dawei Zhou Nannan Wang Tongliang Liu Chao Shen AAML MQ 45 12 0 10 May 2023
Domain Agnostic Image-to-image Translation using Low-Resolution Conditioning M. Abid Arman Afrasiyabi Ihsen Hedhli Jean-François Lalonde Christian Gagné VLM 33 0 0 08 May 2023
GradTree: Learning Axis-Aligned Decision Trees with Gradient Descent Sascha Marton Stefan Lüdtke Christian Bartelt Heiner Stuckenschmidt 24 12 0 05 May 2023
General Neural Gauge Fields Fangneng Zhan Lingjie Liu Adam Kortylewski Christian Theobalt AI4CE 33 12 0 05 May 2023
Input Layer Binarization with Bit-Plane Encoding Lorenzo Vorabbi Davide Maltoni Stefano Santi MQ 16 6 0 04 May 2023
Dynamic Sparse Training with Structured Sparsity Mike Lasby A. Golubeva Utku Evci Mihai Nica Yani Andrew Ioannou 41 19 0 03 May 2023
Joint A-SNN: Joint Training of Artificial and Spiking Neural Networks via Self-Distillation and Weight Factorization Yu-Zhu Guo Weihang Peng Y. Chen Liwen Zhang Xiaode Liu Xuhui Huang Zhe Ma 110 35 0 03 May 2023
Diverse and Vivid Sound Generation from Text Descriptions Guangwei Li Xuenan Xu Lingfeng Dai Mengyue Wu K. Yu 53 4 0 03 May 2023
JaxPruner: A concise library for sparsity research Jooyoung Lee Wonpyo Park Nicole Mitchell Jonathan Pilault J. Obando-Ceron ... Hong-Seok Kim Yann N. Dauphin Karolina Dziugaite Pablo Samuel Castro Utku Evci 48 14 0 27 Apr 2023
Guaranteed Quantization Error Computation for Neural Network Model Compression Wesley Cooke Zihao Mo Weiming Xiang 6 5 0 26 Apr 2023
Uncovering the Representation of Spiking Neural Networks Trained with Surrogate Gradient Yuhang Li Youngeun Kim Hyoungseob Park Priyadarshini Panda 34 16 0 25 Apr 2023
Binary stochasticity enabled highly efficient neuromorphic deep learning achieves better-than-software accuracy Yang Li Wei Wang Ming Wang C. Dou Zhengyu Ma ... Guanhua Yang Feng Zhang Ling Li Daniele Ielmini Ming Liu 23 5 0 25 Apr 2023
Learning Task-Specific Strategies for Accelerated MRI Zihui Wu Tianwei Yin Yu Sun R. Frost A. Kouwe Adrian Dalca Katherine Bouman 45 4 0 25 Apr 2023
Efficient Halftoning via Deep Reinforcement Learning Haitian Jiang Dongliang Xiong Xiaowen Jiang Li Ding Liang Chen Kai Huang 21 3 0 24 Apr 2023
Approximate Shielding of Atari Agents for Safe Exploration Alexander W. Goodall Francesco Belardinelli 29 2 0 21 Apr 2023
Improving Post-Training Quantization on Object Detection with Task Loss-Guided Lp Metric Lin Niu Jia-Wen Liu Zhihang Yuan Dawei Yang Xinggang Wang Wenyu Liu MQ 38 2 0 19 Apr 2023
Bridging Discrete and Backpropagation: Straight-Through and Beyond Liyuan Liu Chengyu Dong Xiaodong Liu Bin-Xia Yu Jianfeng Gao BDL 26 20 0 17 Apr 2023
AUTOSPARSE: Towards Automated Sparse Training of Deep Neural Networks Abhisek Kundu Naveen Mellempudi Dharma Teja Vooturi Bharat Kaul Pradeep Dubey 42 1 0 14 Apr 2023
Boosting Convolutional Neural Networks with Middle Spectrum Grouped Convolution Z. Su Jiehua Zhang Tianpeng Liu Zhen Liu Shuanghui Zhang M. Pietikäinen Li Liu 32 2 0 13 Apr 2023
Revisiting Single-gated Mixtures of Experts Amelie Royer I. Karmanov Andrii Skliar B. Bejnordi Tijmen Blankevoort MoE MoMe 49 6 0 11 Apr 2023
PixelRNN: In-pixel Recurrent Neural Networks for End-to-end-optimized Perception with Neural Sensors Haley M. So Laurie Bose Piotr Dudek Gordon Wetzstein 28 4 0 11 Apr 2023
Binary Latent Diffusion Ze Wang Jiang Wang Zicheng Liu Qiang Qiu 37 13 0 10 Apr 2023
RIDCP: Revitalizing Real Image Dehazing via High-Quality Codebook Priors Ruixia Wu Zheng-Peng Duan Chunle Guo Zhi Chai Chongyi Li 31 85 0 08 Apr 2023
HarsanyiNet: Computing Accurate Shapley Values in a Single Forward Propagation Lu Chen Siyu Lou Keyan Zhang Jin Huang Quanshi Zhang TDI FAtt 29 9 0 04 Apr 2023
Optimizing data-flow in Binary Neural Networks Lorenzo Vorabbi Davide Maltoni Stefano Santi MQ 22 5 0 03 Apr 2023
GradMDM: Adversarial Attack on Dynamic Networks Jianhong Pan Lin Geng Foo Qichen Zheng Zhipeng Fan Hossein Rahmani Qiuhong Ke Jing Liu AAML 29 6 0 01 Apr 2023
Q-DETR: An Efficient Low-Bit Quantized Detection Transformer Sheng Xu Yanjing Li Mingbao Lin Penglei Gao Guodong Guo Jinhu Lu Baochang Zhang MQ 37 23 0 01 Apr 2023
Reusing Deep Neural Network Models through Model Re-engineering Binhang Qi Hailong Sun Xiang Gao Hongyu Zhang Zhaotian Li Xudong Liu 24 17 0 01 Apr 2023
Unsupervised Anomaly Detection with Local-Sensitive VQVAE and Global-Sensitive Transformers Ming-Qiu Wang Jiawei Li Zhenyang Li Chengxiao Luo Bin Chen Shudong Xia Zhi Wang ViT DRL 29 3 0 29 Mar 2023
Randomly Initialized Subnetworks with Iterative Weight Recycling Matt Gorbett L. D. Whitley 26 4 0 28 Mar 2023