Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation

15 August 2013

Aaron Courville

Papers citing "Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation"

50 / 1,869 papers shown

Title
ESC: Efficient Speech Coding with Cross-Scale Residual Vector Quantized Transformers Yuzhe Gu Enmao Diao 37 4 0 30 Apr 2024
Stochastic Spiking Neural Networks with First-to-Spike Coding Yi Jiang Sen Lu Abhronil Sengupta 43 0 0 26 Apr 2024
Converting High-Performance and Low-Latency SNNs through Explicit Modelling of Residual Error in ANNs Zhipeng Huang Jianhao Ding Zhiyu Pan Haoran Li Ying Fang Zhaofei Yu Jian K. Liu 37 0 0 26 Apr 2024
How to Parameterize Asymmetric Quantization Ranges for Quantization-Aware Training Jaeseong You Minseop Park Kyunggeun Lee Seokjun An Chirag I. Patel Markus Nagel MQ 46 1 0 25 Apr 2024
Elucidating the theoretical underpinnings of surrogate gradient learning in spiking neural networks Julia Gygax Friedemann Zenke 53 3 0 23 Apr 2024
AdaQAT: Adaptive Bit-Width Quantization-Aware Training Cédric Gernigon Silviu-Ioan Filip Olivier Sentieys Clément Coggiola Mickael Bruno 25 2 0 22 Apr 2024
IMO: Greedy Layer-Wise Sparse Representation Learning for Out-of-Distribution Text Classification with Pre-trained Models Tao Feng Lizhen Qu Zhuang Li Haolan Zhan Yuncheng Hua Gholamreza Haffari VLM 37 1 0 21 Apr 2024
MP-DPD: Low-Complexity Mixed-Precision Neural Networks for Energy-Efficient Digital Predistortion of Wideband Power Amplifiers Yizhuo Wu Ang Li Mohammadreza Beikmirza G. Singh Qinyu Chen Leo C. N. de Vreede M. Alavi Chang Gao MQ 15 4 0 18 Apr 2024
MIDGET: Music Conditioned 3D Dance Generation Jinwu Wang Wei Mao Miaomiao Liu 40 0 0 18 Apr 2024
Tripod: Three Complementary Inductive Biases for Disentangled Representation Learning Kyle Hsu Jubayer Ibn Hamid Kaylee Burns Chelsea Finn Jiajun Wu CML 26 5 0 16 Apr 2024
SparseDM: Toward Sparse Efficient Diffusion Models Kafeng Wang Jianfei Chen He Li Zhenpeng Mi Jun-Jie Zhu DiffM 68 8 0 16 Apr 2024
SQUAT: Stateful Quantization-Aware Training in Recurrent Spiking Neural Networks Sreyes P. Venkatesh Razvan Marinescu Jason Eshraghian MQ 41 5 0 15 Apr 2024
EQO: Exploring Ultra-Efficient Private Inference with Winograd-Based Protocol and Quantization Co-Optimization Wenxuan Zeng Tianshi Xu Meng Li Runsheng Wang MQ 38 0 0 15 Apr 2024
Differentiable Search for Finding Optimal Quantization Strategy Lianqiang Li Chenqian Yan Yefei Chen MQ 26 2 0 10 Apr 2024
End-to-End Rate-Distortion Optimized 3D Gaussian Representation Henan Wang Hanxin Zhu Tianyu He Runsen Feng Jiajun Deng Jiang Bian Zhibo Chen 3DGS 30 25 0 09 Apr 2024
AdaBM: On-the-Fly Adaptive Bit Mapping for Image Super-Resolution Chee Hong Kyoung Mu Lee SupR MQ 26 2 0 04 Apr 2024
Cherry on Top: Parameter Heterogeneity and Quantization in Large Language Models Wanyun Cui Qianle Wang MQ 42 2 0 03 Apr 2024
Mixture-of-Depths: Dynamically allocating compute in transformer-based language models David Raposo Sam Ritter Blake A. Richards Timothy Lillicrap Peter C. Humphreys Adam Santoro MoE 46 70 0 02 Apr 2024
Accelerating Transformer Pre-training with 2:4 Sparsity Yuezhou Hu Kang Zhao Weiyu Huang Jianfei Chen Jun Zhu 65 7 0 02 Apr 2024
Instance-Aware Group Quantization for Vision Transformers Jaehyeon Moon Dohyung Kim Junyong Cheon Bumsub Ham MQ ViT 29 7 0 01 Apr 2024
Embodied Active Defense: Leveraging Recurrent Feedback to Counter Adversarial Patches Lingxuan Wu Xiao Yang Yinpeng Dong Liuwei Xie Hang Su Jun Zhu AAML 42 2 0 31 Mar 2024
Genetic Quantization-Aware Approximation for Non-Linear Operations in Transformers Pingcheng Dong Yonghao Tan Dong Zhang Tianwei Ni Xuejiao Liu ... Xijie Huang Huaiyu Zhu Yun Pan Fengwei An Kwang-Ting Cheng MQ 36 3 0 28 Mar 2024
GLAD: Improving Latent Graph Generative Modeling with Simple Quantization Van Khoa Nguyen Yoann Boget Frantzeska Lavda Alexandros Kalousis 31 2 0 25 Mar 2024
HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compression Yihang Chen Qianyi Wu Weiyao Lin Mehrtash Harandi Jianfei Cai 39 70 0 21 Mar 2024
Debiasing surgeon: fantastic weights and how to find them Rémi Nahon Ivan Luiz De Moura Matos Van-Tam Nguyen Enzo Tartaglione 36 1 0 21 Mar 2024
Auto-Train-Once: Controller Network Guided Automatic Network Pruning from Scratch Xidong Wu Shangqian Gao Zeyu Zhang Zhenzhen Li Runxue Bao Yanfu Zhang Xiaoqian Wang Heng-Chiao Huang 41 8 0 21 Mar 2024
Advancing Time Series Classification with Multimodal Language Modeling Mingyue Cheng Yiheng Chen Qi Liu Zhiding Liu Yucong Luo AI4TS 40 11 0 19 Mar 2024
HyperVQ: MLR-based Vector Quantization in Hyperbolic Space Nabarun Goswami Yusuke Mukuta Tatsuya Harada 40 4 0 18 Mar 2024
Compact 3D Gaussian Splatting For Dense Visual SLAM Tianchen Deng Yaohui Chen Leyan Zhang Jianfei Yang Shenghai Yuan Danwei W. Wang Weidong Chen 3DGS 42 32 0 17 Mar 2024
Self-Supervised Quantization-Aware Knowledge Distillation Kaiqi Zhao Ming Zhao MQ 38 2 0 17 Mar 2024
AD3: Implicit Action is the Key for World Models to Distinguish the Diverse Visual Distractors Yucen Wang Shenghua Wan Le Gan Shuai Feng De-Chuan Zhan VGen 27 4 0 15 Mar 2024
CAMSIC: Content-aware Masked Image Modeling Transformer for Stereo Image Compression Xinjie Zhang Shenyuan Gao Zhening Liu Jiawei Shao Xingtong Ge Dailan He Tongda Xu Yan Wang Jun Zhang 48 1 0 13 Mar 2024
MoAI: Mixture of All Intelligence for Large Language and Vision Models Byung-Kwan Lee Beomchan Park Chae Won Kim Yonghyun Ro MLLM VLM 48 20 0 12 Mar 2024
Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System Hongsun Jang Jaeyong Song Jaewon Jung Jaeyoung Park Youngsok Kim Jinho Lee 29 12 0 11 Mar 2024
Ensemble Quadratic Assignment Network for Graph Matching Haoru Tan Chuang Wang Sitong Wu Xu-Yao Zhang Fei Yin Cheng-Lin Liu 26 3 0 11 Mar 2024
GlossLM: Multilingual Pretraining for Low-Resource Interlinear Glossing Michael Ginn Lindia Tjuatja Taiqi He Enora Rice Graham Neubig Alexis Palmer Lori Levin University of Colorado 38 3 0 11 Mar 2024
Wavelet-Like Transform-Based Technology in Response to the Call for Proposals on Neural Network-Based Image Coding Cunhui Dong Haichuan Ma Haotian Zhang Changsheng Gao Li Li Dong Liu 44 5 0 09 Mar 2024
CoRMF: Criticality-Ordered Recurrent Mean Field Ising Solver Zhenyu Pan Ammar Gilani En-Jui Kuo Zhuo Liu LRM 43 4 0 05 Mar 2024
VQSynery: Robust Drug Synergy Prediction With Vector Quantization Mechanism Jiawei Wu Mingyuan Yan Dianbo Liu 40 2 0 05 Mar 2024
NASH: Neural Architecture Search for Hardware-Optimized Machine Learning Models Mengfei Ji Yuchun Chang Baolin Zhang Zaid Al-Ars 27 0 0 04 Mar 2024
Neural Network Assisted Lifting Steps For Improved Fully Scalable Lossy Image Compression in JPEG 2000 Xinyue Li A. Naman David S. Taubman 27 0 0 04 Mar 2024
ProtoP-OD: Explainable Object Detection with Prototypical Parts Pavlos Rath-Manakidis Frederik Strothmann Tobias Glasmachers Laurenz Wiskott ViT 35 1 0 29 Feb 2024
Exploration of Learned Lifting-Based Transform Structures for Fully Scalable and Accessible Wavelet-Like Image Compression Xinyue Li A. Naman David S. Taubman 27 0 0 29 Feb 2024
Probabilistic Bayesian optimal experimental design using conditional normalizing flows Rafael Orozco Felix J. Herrmann Peng Chen 49 5 0 28 Feb 2024
Understanding Neural Network Binarization with Forward and Backward Proximal Quantizers Yiwei Lu Yaoliang Yu Xinlin Li Vahid Partovi Nia MQ 38 3 0 27 Feb 2024
InterroGate: Learning to Share, Specialize, and Prune Representations for Multi-task Learning B. Bejnordi Gaurav Kumar Amelie Royer Christos Louizos Tijmen Blankevoort Mohsen Ghafoorian CVBM 39 0 0 26 Feb 2024
Edge Detectors Can Make Deep Convolutional Neural Networks More Robust Jin Ding Jie-Chao Zhao Yong-zhi Sun Ping Tan Jia-Wei Wang Ji-en Ma You-tong Fang AAML 47 2 0 26 Feb 2024
Towards Accurate Post-training Quantization for Reparameterized Models Luoming Zhang Yefei He Wen Fei Zhenyu Lou Weijia Wu YangWei Ying Hong Zhou MQ 43 0 0 25 Feb 2024
EncodingNet: A Novel Encoding-based MAC Design for Efficient Neural Network Acceleration Bo Liu Grace Li Zhang Xunzhao Yin Ulf Schlichtmann Bing Li MQ AI4CE 38 0 0 25 Feb 2024
MAPE-PPI: Towards Effective and Efficient Protein-Protein Interaction Prediction via Microenvironment-Aware Protein Embedding Lirong Wu Yijun Tian Yufei Huang Siyuan Li Haitao Lin Nitesh V. Chawla Stan Z. Li 34 22 0 22 Feb 2024