An Overview of Neural Network Compression

5 June 2020

Papers citing "An Overview of Neural Network Compression"

21 / 21 papers shown

Title
Climplicit: Climatic Implicit Embeddings for Global Ecological Tasks Johannes Dollinger Damien Robert Elena Plekhanova Lukas Drees Jan Dirk Wegner AI4CE 32 0 0 07 Apr 2025
Rateless Joint Source-Channel Coding, and a Blueprint for 6G Semantic Communications System Design Saeed R. Khosravirad 55 0 0 10 Feb 2025
Overcoming Slow Decision Frequencies in Continuous Control: Model-Based Sequence Reinforcement Learning for Model-Free Control Devdhar Patel H. Siegelmann OffRL 35 0 0 11 Oct 2024
Lifelong Intelligence Beyond the Edge using Hyperdimensional Computing Xiaofan Yu Anthony Thomas Ivannia Gomez Moreno Louis Gutierrez Tajana Simunic 38 3 0 07 Mar 2024
Self-Distilled Quantization: Achieving High Compression Rates in Transformer-Based Language Models James OÑeill Sourav Dutta VLM MQ 27 1 0 12 Jul 2023
Evaluation Metrics for DNNs Compression Abanoub Ghobrial S. Budgett Dieter Balemans Hamid Asgari Philippe Reiter Kerstin Eder 22 1 0 18 May 2023
Machine Learning and the Future of Bayesian Computation Steven Winter Trevor Campbell Lizhen Lin Sanvesh Srivastava David B. Dunson TPM 24 4 0 21 Apr 2023
LightTS: Lightweight Time Series Classification with Adaptive Ensemble Distillation -- Extended Version David Campos Miao Zhang B. Yang Tung Kieu Chenjuan Guo Christian S. Jensen AI4TS 35 46 0 24 Feb 2023
Improving Monocular Visual Odometry Using Learned Depth Libo Sun Wei Yin Enze Xie Zhengrong Li Changming Sun Chunhua Shen MDE 6 26 0 04 Apr 2022
On Neural Network Equivalence Checking using SMT Solvers Charis Eleftheriadis Nikolaos Kekatos Panagiotis Katsaros S. Tripakis AAML 14 12 0 22 Mar 2022
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism M. Shoeybi M. Patwary Raul Puri P. LeGresley Jared Casper Bryan Catanzaro MoE 243 1,815 0 17 Sep 2019
Q-BERT: Hessian Based Ultra Low Precision Quantization of BERT Sheng Shen Zhen Dong Jiayu Ye Linjian Ma Z. Yao A. Gholami Michael W. Mahoney Kurt Keutzer MQ 225 574 0 12 Sep 2019
ReLeQ: A Reinforcement Learning Approach for Deep Quantization of Neural Networks Ahmed T. Elthakeb Prannoy Pilligundla Fatemehsadat Mireshghallah Amir Yazdanbakhsh H. Esmaeilzadeh MQ 49 68 0 05 Nov 2018
Knowledge Distillation by On-the-Fly Native Ensemble Xu Lan Xiatian Zhu S. Gong 187 473 0 12 Jun 2018
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,943 0 20 Apr 2018
Neural Compatibility Modeling with Attentive Knowledge Distillation Xuemeng Song Fuli Feng Xianjing Han Xin Yang W. Liu Liqiang Nie 33 144 0 17 Apr 2018
Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results Antti Tarvainen Harri Valpola OOD MoMe 244 1,275 0 06 Mar 2017
Incremental Network Quantization: Towards Lossless CNNs with Low-Precision Weights Aojun Zhou Anbang Yao Yiwen Guo Lin Xu Yurong Chen MQ 311 1,047 0 10 Feb 2017
Aggregated Residual Transformations for Deep Neural Networks Saining Xie Ross B. Girshick Piotr Dollár Z. Tu Kaiming He 268 10,214 0 16 Nov 2016
Convolutional Neural Networks for Sentence Classification Yoon Kim AILaw VLM 250 13,347 0 25 Aug 2014
Improving neural networks by preventing co-adaptation of feature detectors Geoffrey E. Hinton Nitish Srivastava A. Krizhevsky Ilya Sutskever Ruslan Salakhutdinov VLM 243 7,620 0 03 Jul 2012