Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation

15 August 2013

Aaron Courville

Papers citing "Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation"

50 / 1,874 papers shown

Title
UPSCALE: Unconstrained Channel Pruning Alvin Wan Hanxiang Hao K. Patnaik Yueyang Xu Omer Hadad David Guera Zhile Ren Qi Shan 39 4 0 17 Jul 2023
A Survey of Techniques for Optimizing Transformer Inference Krishna Teja Chitty-Venkata Sparsh Mittal M. Emani V. Vishwanath Arun Somani 54 63 0 16 Jul 2023
QBitOpt: Fast and Accurate Bitwidth Reallocation during Training Jorn W. T. Peters Marios Fournarakis Markus Nagel M. V. Baalen Tijmen Blankevoort MQ 32 5 0 10 Jul 2023
Hierarchical Autoencoder-based Lossy Compression for Large-scale High-resolution Scientific Data Hieu Le Jián Tao AI4CE 29 2 0 09 Jul 2023
Learning to Group Auxiliary Datasets for Molecule Ting Huang Ziniu Hu Rex Ying 11 0 0 08 Jul 2023
MSViT: Dynamic Mixed-Scale Tokenization for Vision Transformers Jakob Drachmann Havtorn Amelie Royer Tijmen Blankevoort B. Bejnordi 35 8 0 05 Jul 2023
Facing Off World Model Backbones: RNNs, Transformers, and S4 Fei Deng Junyeong Park Sungjin Ahn 34 25 0 05 Jul 2023
Deep Cross-Modal Steganography Using Neural Representations Gyojin Han Dong-Jae Lee Jiwan Hur Jaehyun Choi Junmo Kim 19 7 0 02 Jul 2023
The future of human-centric eXplainable Artificial Intelligence (XAI) is not post-hoc explanations Vinitra Swamy Jibril Frej Tanja Käser 41 14 0 01 Jul 2023
Filter Pruning for Efficient CNNs via Knowledge-driven Differential Filter Sampler Shaohui Lin Wenxuan Huang Jiao Xie Baochang Zhang Yunhang Shen Zhou Yu Jungong Han David Doermann 27 2 0 01 Jul 2023
BinaryViT: Pushing Binary Vision Transformers Towards Convolutional Models Phuoc-Hoan Charles Le Xinlin Li ViT MQ 33 21 0 29 Jun 2023
DCP-NAS: Discrepant Child-Parent Neural Architecture Search for 1-bit CNNs Yanjing Li Sheng Xu Xianbin Cao Lian Zhuo Baochang Zhang Tian Wang Guodong Guo 38 3 0 27 Jun 2023
Variational latent discrete representation for time series modelling Max H. Cohen M. Charbit Sylvain Le Corff 33 1 0 27 Jun 2023
Efficient Contextformer: Spatio-Channel Window Attention for Fast Context Modeling in Learned Image Compression A. B. Koyuncu Panqi Jia Atanas Boev Elena Alshina Eckehard Steinbach 32 15 0 25 Jun 2023
Low-Rank Prune-And-Factorize for Language Model Compression Siyu Ren Kenny Q. Zhu 24 9 0 25 Jun 2023
A Survey on Graph Neural Network Acceleration: Algorithms, Systems, and Customized Hardware Shichang Zhang Atefeh Sohrabizadeh Cheng Wan Zijie Huang Ziniu Hu Yewen Wang Yingyan Lin Lin Jason Cong Yizhou Sun GNN AI4CE 42 23 0 24 Jun 2023
Partitioning-Guided K-Means: Extreme Empty Cluster Resolution for Extreme Model Compression Tianhong Huang Victor Agostinelli Lizhong Chen MQ 20 0 0 24 Jun 2023
Accelerating SNN Training with Stochastic Parallelizable Spiking Neurons Sidi Yaya Arnaud Yarga Sean U. N. Wood 16 8 0 22 Jun 2023
Training Transformers with 4-bit Integers Haocheng Xi Changhao Li Jianfei Chen Jun Zhu MQ 27 48 0 21 Jun 2023
Progressive Fourier Neural Representation for Sequential Video Compilation Haeyong Kang Jaehong Yoon Dahyun Kim Sung Ju Hwang Chang D. Yoo AI4TS 45 2 0 20 Jun 2023
Dynamic Size Message Scheduling for Multi-Agent Communication under Limited Bandwidth Qingshuang Sun Denis Steckelmacher Yuan Yao Ann Nowé Raphael Avalos AI4CE 29 0 0 16 Jun 2023
Differentiable Instruction Optimization for Cross-Task Generalization Masaru Isonuma Junichiro Mori Ichiro Sakata 34 0 0 16 Jun 2023
HiNeRV: Video Compression with Hierarchical Encoding-based Neural Representation Ho Man Kwan Ge Gao Fan Zhang Andrew Gower David Bull 29 49 0 16 Jun 2023
BISCUIT: Causal Representation Learning from Binary Interactions Phillip Lippe Sara Magliacane Sindy Löwe Yuki M. Asano Taco S. Cohen E. Gavves CML 46 28 0 16 Jun 2023
Neural Network Compression using Binarization and Few Full-Precision Weights F. M. Nardini Cosimo Rulli Salvatore Trani Rossano Venturini MQ 31 1 0 15 Jun 2023
Taming Reversible Halftoning via Predictive Luminance Cheuk-Kit Lau Menghan Xia T. Wong 38 1 0 14 Jun 2023
Unbiased Learning of Deep Generative Models with Structured Discrete Representations H. Bendekgey Gabriel Hope Erik B. Sudderth OCL BDL DRL 30 1 0 14 Jun 2023
Binary Radiance Fields S. Shin Jaesik Park AI4CE 36 27 0 13 Jun 2023
Measuring Sentiment Bias in Machine Translation Kai Hartung Aaricia Herygers Shubham Kurlekar Khabbab Zakaria Taylan Volkan Sören Gröttrup Munir Georges AI4CE 28 5 0 12 Jun 2023
High-Fidelity Audio Compression with Improved RVQGAN Rithesh Kumar Prem Seetharaman Alejandro Luebs I. Kumar Kundan Kumar 56 290 0 11 Jun 2023
Magnitude Attention-based Dynamic Pruning Jihye Back Namhyuk Ahn Jang-Hyun Kim 43 2 0 08 Jun 2023
Patch-level Routing in Mixture-of-Experts is Provably Sample-efficient for Convolutional Neural Networks Mohammed Nowaz Rabbani Chowdhury Shuai Zhang Ming Wang Sijia Liu Pin-Yu Chen MoE 29 18 0 07 Jun 2023
Soft Merging of Experts with Adaptive Routing Mohammed Muqeeth Haokun Liu Colin Raffel MoMe MoE 42 47 0 06 Jun 2023
Optimizing Sampling Patterns for Compressed Sensing MRI with Diffusion Generative Models Sriram Ravula Brett Levac A. Jalal Jonathan I. Tamir A. Dimakis DiffM MedIm 29 16 0 05 Jun 2023
Learning Probabilistic Symmetrization for Architecture Agnostic Equivariance Jinwoo Kim Tien Dat Nguyen Ayhan Suleymanzade Hyeokjun An Seunghoon Hong 55 23 0 05 Jun 2023
COMET: Learning Cardinality Constrained Mixture of Experts with Trees and Local Search Shibal Ibrahim Wenyu Chen Hussein Hazimeh Natalia Ponomareva Zhe Zhao Rahul Mazumder MoE 32 3 0 05 Jun 2023
Temporal Dynamic Quantization for Diffusion Models Junhyuk So Jungwon Lee Daehyun Ahn Hyungjun Kim Eunhyeok Park DiffM MQ 25 60 0 04 Jun 2023
Encoding Time-Series Explanations through Self-Supervised Model Behavior Consistency Owen Queen Thomas Hartvigsen Teddy Koker Huan He Theodoros Tsiligkaridis Marinka Zitnik AI4TS 39 19 0 03 Jun 2023
Binary and Ternary Natural Language Generation Zechun Liu Barlas Oğuz Aasish Pappu Yangyang Shi Raghuraman Krishnamoorthi MQ 41 6 0 02 Jun 2023
Task-Agnostic Structured Pruning of Speech Representation Models Haoyu Wang Siyuan Wang Weiqiang Zhang Hongbin Suo Yulong Wan VLM 29 14 0 02 Jun 2023
Towards Learning Discrete Representations via Self-Supervision for Wearables-Based Human Activity Recognition H. Haresamudram Irfan Essa Thomas Ploetz 39 7 0 01 Jun 2023
Building Rearticulable Models for Arbitrary 3D Objects from 4D Point Clouds Shao-Wei Liu Saurabh Gupta Shenlong Wang 37 13 0 01 Jun 2023
AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration Ji Lin Jiaming Tang Haotian Tang Shang Yang Wei-Ming Chen Wei-Chen Wang Guangxuan Xiao Xingyu Dang Chuang Gan Song Han EDL MQ 47 480 0 01 Jun 2023
IQL-TD-MPC: Implicit Q-Learning for Hierarchical Model Predictive Control Rohan Chitnis Yingchen Xu B. Hashemi Lucas Lehnert Ürün Dogan Zheqing Zhu Olivier Delalleau OffRL 34 9 0 01 Jun 2023
FlexRound: Learnable Rounding based on Element-wise Division for Post-Training Quantization J. H. Lee Jeonghoon Kim S. Kwon Dongsoo Lee MQ 32 33 0 01 Jun 2023
Scalable Learning of Latent Language Structure With Logical Offline Cycle Consistency Mayank Agarwal Ramón Fernández Astudillo Tahira Naseem Subhajit Chaudhury Pavan Kapanipathi Salim Roukos Alexander G. Gray OffRL 27 0 0 31 May 2023
Beam Tree Recursive Cells Jishnu Ray Chowdhury Cornelia Caragea 34 6 0 31 May 2023
Accurate and Structured Pruning for Efficient Automatic Speech Recognition Huiqiang Jiang Li Lyna Zhang Yuang Li Yu-Huan Wu Shijie Cao Ting Cao Yuqing Yang Jinyu Li Mao Yang Lili Qiu CVBM 65 9 0 31 May 2023
Graph-based Time Series Clustering for End-to-End Hierarchical Forecasting Andrea Cini Danilo Mandic Cesare Alippi AI4TS 32 9 0 30 May 2023
PreQuant: A Task-agnostic Quantization Approach for Pre-trained Language Models Zhuocheng Gong Jiahao Liu Qifan Wang Yang Yang Jingang Wang Wei Wu Yunsen Xian Dongyan Zhao Rui Yan MQ 43 5 0 30 May 2023