Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activations

22 September 2016

Papers citing "Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activations"

50 / 201 papers shown

Title
SPINN: Synergistic Progressive Inference of Neural Networks over Device and Cloud Stefanos Laskaridis Stylianos I. Venieris Mario Almeida Ilias Leontiadis Nicholas D. Lane 20 265 0 14 Aug 2020
Controlling Information Capacity of Binary Neural Network D. Ignatov Andrey D. Ignatov MQ 15 21 0 04 Aug 2020
DBS: Dynamic Batch Size For Distributed Deep Neural Network Training Qing Ye Yuhao Zhou Mingjia Shi Yanan Sun Jiancheng Lv 14 11 0 23 Jul 2020
Always-On 674uW @ 4GOP/s Error Resilient Binary Neural Networks with Aggressive SRAM Voltage Scaling on a 22nm IoT End-Node Alfio Di Mauro Francesco Conti Pasquale Davide Schiavone D. Rossi Luca Benini 11 9 0 17 Jul 2020
Term Revealing: Furthering Quantization at Run Time on Quantized DNNs H. T. Kung Bradley McDanel S. Zhang MQ 6 9 0 13 Jul 2020
Automatic heterogeneous quantization of deep neural networks for low-latency inference on the edge for particle detectors C. Coelho Aki Kuusela Shane Li Zhuang Hao T. Aarrestad Vladimir Loncar J. Ngadiuba M. Pierini Adrian Alan Pol S. Summers MQ 13 175 0 15 Jun 2020
Optimal Lottery Tickets via SubsetSum: Logarithmic Over-Parameterization is Sufficient Ankit Pensia Shashank Rajput Alliot Nagle Harit Vishwakarma Dimitris Papailiopoulos 17 102 0 14 Jun 2020
Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming Itay Hubara Yury Nahshan Y. Hanani Ron Banner Daniel Soudry MQ 18 122 0 14 Jun 2020
A Framework for Neural Network Pruning Using Gibbs Distributions Alex Labach S. Valaee 9 5 0 08 Jun 2020
A 28-nm Convolutional Neuromorphic Processor Enabling Online Learning with Spike-Based Retinas Charlotte Frenkel J. Legat D. Bol 11 42 0 13 May 2020
schuBERT: Optimizing Elements of BERT A. Khetan Zohar S. Karnin 18 30 0 09 May 2020
DeepHammer: Depleting the Intelligence of Deep Neural Networks through Targeted Chain of Bit Flips Fan Yao Adnan Siraj Rakin Deliang Fan AAML 13 154 0 30 Mar 2020
Rethinking Depthwise Separable Convolutions: How Intra-Kernel Correlations Lead to Improved MobileNets D. Haase Manuel Amthor 12 131 0 30 Mar 2020
LANCE: Efficient Low-Precision Quantized Winograd Convolution for Neural Networks Based on Graphics Processing Units Guangli Li Lei Liu Xueying Wang Xiu Ma Xiaobing Feng MQ 11 18 0 19 Mar 2020
MINT: Deep Network Compression via Mutual Information-based Neuron Trimming Madan Ravi Ganesh Jason J. Corso S. Y. Sekeh MQ 27 15 0 18 Mar 2020
Exploring the Connection Between Binary and Spiking Neural Networks Sen Lu Abhronil Sengupta MQ 14 100 0 24 Feb 2020
Communication-Efficient Decentralized Learning with Sparsification and Adaptive Peer Selection Zhenheng Tang S. Shi X. Chu FedML 13 57 0 22 Feb 2020
Least squares binary quantization of neural networks Hadi Pouransari Zhucheng Tu Oncel Tuzel MQ 12 32 0 09 Jan 2020
Mixed-Precision Quantized Neural Network with Progressively Decreasing Bitwidth For Image Classification and Object Detection Tianshu Chu Qin Luo Jie-jin Yang Xiaolin Huang MQ 14 6 0 29 Dec 2019
Fast and energy-efficient neuromorphic deep learning with first-spike times Julian Goltz Laura Kriener A. Baumbach Sebastian Billaudelle O. Breitwieser ... Á. F. Kungl Walter Senn Johannes Schemmel K. Meier Mihai A. Petrovici 22 124 0 24 Dec 2019
Adaptive Loss-aware Quantization for Multi-bit Networks Zhongnan Qu Zimu Zhou Yun Cheng Lothar Thiele MQ 20 53 0 18 Dec 2019
Design of optical neural networks with component imprecisions Michael Y.-S. Fang S. Manipatruni Casimir Wierzynski A. Khosrowshahi M. DeWeese 33 128 0 13 Dec 2019
Optimal checkpointing for heterogeneous chains: how to train deep neural networks with limited memory Julien Herrmann Olivier Beaumont Lionel Eyraud-Dubois J. Herrmann Alexis Joly Alena Shilova BDL 9 29 0 27 Nov 2019
Loss Aware Post-training Quantization Yury Nahshan Brian Chmiel Chaim Baskin Evgenii Zheltonozhskii Ron Banner A. Bronstein A. Mendelson MQ 9 163 0 17 Nov 2019
Real-time ultra-low power ECG anomaly detection using an event-driven neuromorphic processor F. Bauer Dylan R. Muir Giacomo Indiveri 11 95 0 13 Nov 2019
Iteratively Training Look-Up Tables for Network Quantization Fabien Cardinaux Stefan Uhlich K. Yoshiyama Javier Alonso García Lukas Mauch Stephen Tiedemann Thomas Kemp Akira Nakamura MQ 21 16 0 12 Nov 2019
Fully Quantized Transformer for Machine Translation Gabriele Prato Ella Charlaix Mehdi Rezagholizadeh MQ 8 68 0 17 Oct 2019
How does topology influence gradient propagation and model performance of deep networks with DenseNet-type skip connections? Kartikeya Bhardwaj Guihong Li R. Marculescu 22 1 0 02 Oct 2019
Impact of Low-bitwidth Quantization on the Adversarial Robustness for Embedded Neural Networks Rémi Bernhard Pierre-Alain Moëllic J. Dutertre AAML MQ 16 18 0 27 Sep 2019
Model Pruning Enables Efficient Federated Learning on Edge Devices Yuang Jiang Shiqiang Wang Victor Valls Bongjun Ko Wei-Han Lee Kin K. Leung Leandros Tassiulas 30 443 0 26 Sep 2019
Minimal Learning Machine: Theoretical Results and Clustering-Based Reference Point Selection J. Hämäläinen Alisson S. C. Alencar T. Kärkkäinen C. L. C. Mattos A. H. S. Júnior Joao P. P. Gomes 22 17 0 22 Sep 2019
Density Encoding Enables Resource-Efficient Randomly Connected Neural Networks Denis Kleyko Mansour Kheffache E. P. Frady U. Wiklund Evgeny Osipov 19 45 0 19 Sep 2019
Deep learning in ultrasound imaging Ruud J. G. van Sloun Regev Cohen Yonina C. Eldar 12 226 0 05 Jul 2019
New pointwise convolution in Deep Neural Networks through Extremely Fast and Non Parametric Transforms Joonhyun Jeong Sung-Ho Bae 32 1 0 25 Jun 2019
Divide and Conquer: Leveraging Intermediate Feature Representations for Quantized Training of Neural Networks Ahmed T. Elthakeb Prannoy Pilligundla Alex Cloninger H. Esmaeilzadeh MQ 16 8 0 14 Jun 2019
Butterfly Transform: An Efficient FFT Based Neural Architecture Design Keivan Alizadeh-Vahid Anish K. Prabhu Ali Farhadi Mohammad Rastegari 17 50 0 05 Jun 2019
Constructing Energy-efficient Mixed-precision Neural Networks through Principal Component Analysis for Edge Intelligence I. Chakraborty Deboleena Roy Isha Garg Aayush Ankit Kaushik Roy 17 37 0 04 Jun 2019
Mixed Precision Training With 8-bit Floating Point Naveen Mellempudi S. Srinivasan Dipankar Das Bharat Kaul MQ 8 68 0 29 May 2019
Natural Compression for Distributed Deep Learning Samuel Horváth Chen-Yu Ho L. Horvath Atal Narayan Sahu Marco Canini Peter Richtárik 13 148 0 27 May 2019
Dichotomize and Generalize: PAC-Bayesian Binary Activated Deep Neural Networks Gaël Letarte Pascal Germain Benjamin Guedj Franccois Laviolette MQ AI4CE UQCV 15 54 0 24 May 2019
Multi-layered Spiking Neural Network with Target Timestamp Threshold Adaptation and STDP Pierre Falez Pierre Tirilly Ioan Marius Bilasco P. Devienne Pierre Boulet 13 49 0 03 Apr 2019
Correlation Congruence for Knowledge Distillation Baoyun Peng Xiao Jin Jiaheng Liu Shunfeng Zhou Yichao Wu Yu Liu Dongsheng Li Zhaoning Zhang 35 507 0 03 Apr 2019
All You Need is a Few Shifts: Designing Efficient Convolutional Neural Networks for Image Classification Weijie Chen Di Xie Yuan Zhang Shiliang Pu 9 80 0 13 Mar 2019
Modulated binary cliquenet Jinpeng Xia Jiasong Wu Youyong Kong Pinzheng Zhang L. Senhadji H. Shu MQ 6 0 0 27 Feb 2019
Parameter Efficient Training of Deep Convolutional Neural Networks by Dynamic Sparse Reparameterization Hesham Mostafa Xin Wang 20 307 0 15 Feb 2019
An Optimized Recurrent Unit for Ultra-Low-Power Keyword Spotting Justice Amoh K. Odame 24 17 0 13 Feb 2019
Self-Binarizing Networks Fayez Lahoud R. Achanta Pablo Márquez-Neila Sabine Süsstrunk MQ 6 23 0 02 Feb 2019
Improving Neural Network Quantization without Retraining using Outlier Channel Splitting Ritchie Zhao Yuwei Hu Jordan Dotzel Christopher De Sa Zhiru Zhang OODD MQ 10 304 0 28 Jan 2019
CodeX: Bit-Flexible Encoding for Streaming-based FPGA Acceleration of DNNs Mohammad Samragh Mojan Javaheripi F. Koushanfar 19 11 0 17 Jan 2019
Unsupervised Visual Feature Learning with Spike-timing-dependent Plasticity: How Far are we from Traditional Feature Learning Approaches? Pierre Falez Pierre Tirilly Ioan Marius Bilasco P. Devienne Pierre Boulet SSL 13 32 0 14 Jan 2019