Dynamic Network Surgery for Efficient DNNs

16 August 2016

Papers citing "Dynamic Network Surgery for Efficient DNNs"

46 / 96 papers shown

Title
Joint Multi-Dimension Pruning via Numerical Gradient Update Zechun Liu X. Zhang Zhiqiang Shen Zhe Li Yichen Wei Kwang-Ting Cheng Jian Sun 39 18 0 18 May 2020
Generalized Bayesian Posterior Expectation Distillation for Deep Neural Networks Meet P. Vadera B. Jalaeian Benjamin M. Marlin BDL FedML UQCV 11 20 0 16 May 2020
Movement Pruning: Adaptive Sparsity by Fine-Tuning Victor Sanh Thomas Wolf Alexander M. Rush 13 466 0 15 May 2020
Dynamic Sparse Training: Find Efficient Sparse Network From Scratch With Trainable Masked Layers Junjie Liu Zhe Xu Runbin Shi R. Cheung Hayden Kwok-Hay So 9 119 0 14 May 2020
Pruning Algorithms to Accelerate Convolutional Neural Networks for Edge Applications: A Survey Jiayi Liu S. Tripathi Unmesh Kurup Mohak Shah 3DPC MedIm 17 52 0 08 May 2020
MINT: Deep Network Compression via Mutual Information-based Neuron Trimming Madan Ravi Ganesh Jason J. Corso S. Y. Sekeh MQ 27 15 0 18 Mar 2020
An Image Enhancing Pattern-based Sparsity for Real-time Inference on Mobile Devices Xiaolong Ma Wei Niu Tianyun Zhang Sijia Liu Sheng Lin ... Xiang Chen Jian Tang Kaisheng Ma Bin Ren Yanzhi Wang 25 27 0 20 Jan 2020
Discrimination-aware Network Pruning for Deep Model Compression Jing Liu Bohan Zhuang Zhuangwei Zhuang Yong Guo Junzhou Huang Jin-Hui Zhu Mingkui Tan CVBM 9 118 0 04 Jan 2020
Neural Network Pruning with Residual-Connections and Limited-Data Jian-Hao Luo Jianxin Wu 8 112 0 19 Nov 2019
2L-3W: 2-Level 3-Way Hardware-Software Co-Verification for the Mapping of Deep Learning Architecture (DLA) onto FPGA Boards Tolulope A. Odetola Katie M. Groves S. R. Hasan 6 5 0 14 Nov 2019
4-Connected Shift Residual Networks Andrew Brown Pascal Mettes M. Worring 3DPC 13 8 0 22 Oct 2019
A Pre-defined Sparse Kernel Based Convolution for Deep CNNs Souvik Kundu Saurav Prakash H. Akrami P. Beerel K. Chugg 28 12 0 02 Oct 2019
Gate Decorator: Global Filter Pruning Method for Accelerating Deep Convolutional Neural Networks Zhonghui You Kun Yan Jinmian Ye Meng Ma Ping Wang 3DPC 8 246 0 18 Sep 2019
ACNet: Strengthening the Kernel Skeletons for Powerful CNN via Asymmetric Convolution Blocks Xiaohan Ding Yuchen Guo Guiguang Ding J. Han 8 659 0 11 Aug 2019
DeepCABAC: A Universal Compression Algorithm for Deep Neural Networks Simon Wiedemann H. Kirchhoffer Stefan Matlage Paul Haase Arturo Marbán ... Ahmed Osman D. Marpe H. Schwarz Thomas Wiegand Wojciech Samek 33 92 0 27 Jul 2019
Sparse Networks from Scratch: Faster Training without Losing Performance Tim Dettmers Luke Zettlemoyer 20 333 0 10 Jul 2019
COP: Customized Deep Model Compression via Regularized Correlation-Based Filter-Level Pruning Wenxiao Wang Cong Fu Jishun Guo Deng Cai Xiaofei He VLM 8 71 0 25 Jun 2019
Parameterized Structured Pruning for Deep Neural Networks Günther Schindler Wolfgang Roth Franz Pernkopf Holger Froening 16 6 0 12 Jun 2019
Weight Agnostic Neural Networks Adam Gaier David R Ha OOD 22 239 0 11 Jun 2019
Training CNNs with Selective Allocation of Channels Jongheon Jeong Jinwoo Shin CVBM 31 15 0 11 May 2019
Progressive DNN Compression: A Key to Achieve Ultra-High Weight Pruning and Quantization Rates using ADMM Shaokai Ye Xiaoyu Feng Tianyun Zhang Xiaolong Ma Sheng Lin ... Jian Tang M. Fardad X. Lin Yongpan Liu Yanzhi Wang MQ 22 38 0 23 Mar 2019
Partial Order Pruning: for Best Speed/Accuracy Trade-off in Neural Architecture Search X. Li Yiming Zhou Zheng Pan Jiashi Feng 3DV 8 158 0 09 Mar 2019
Focused Quantization for Sparse CNNs Yiren Zhao Xitong Gao Daniel Bates Robert D. Mullins Chengzhong Xu MQ 15 26 0 07 Mar 2019
Dense xUnit Networks I. Kligvasser T. Michaeli 13 3 0 27 Nov 2018
Faster CryptoNets: Leveraging Sparsity for Real-World Encrypted Inference Edward Chou Josh Beal Daniel Levy Serena Yeung Albert Haque Li Fei-Fei 13 198 0 25 Nov 2018
NestDNN: Resource-Aware Multi-Tenant On-Device Deep Learning for Continuous Mobile Vision Biyi Fang Xiao Zeng Mi Zhang 3DH 6 263 0 23 Oct 2018
Progressive Weight Pruning of Deep Neural Networks using ADMM Shaokai Ye Tianyun Zhang Kaiqi Zhang Jiayu Li Kaidi Xu ... M. Fardad Sijia Liu Xiang Chen X. Lin Yanzhi Wang AI4CE 21 38 0 17 Oct 2018
Quantization Mimic: Towards Very Tiny CNN for Object Detection Yi Wei Xinyu Pan Hongwei Qin Wanli Ouyang Junjie Yan ObjD 17 88 0 06 May 2018
Non-Vacuous Generalization Bounds at the ImageNet Scale: A PAC-Bayesian Compression Approach Wenda Zhou Victor Veitch Morgane Austern Ryan P. Adams Peter Orbanz 19 209 0 16 Apr 2018
Deep Neural Network Compression with Single and Multiple Level Quantization Yuhui Xu Yongzhuang Wang Aojun Zhou Weiyao Lin H. Xiong MQ 20 114 0 06 Mar 2018
Compressing Neural Networks using the Variational Information Bottleneck Bin Dai Chen Zhu David Wipf MLT 20 178 0 28 Feb 2018
Recurrent Residual Module for Fast Inference in Videos Bowen Pan Wuwei Lin Xiaolin Fang Chaoqin Huang Bolei Zhou Cewu Lu ObjD 20 33 0 27 Feb 2018
Deep Defense: Training DNNs with Improved Adversarial Robustness Ziang Yan Yiwen Guo Changshui Zhang AAML 33 109 0 23 Feb 2018
A Scalable Near-Memory Architecture for Training Deep Neural Networks on Large In-Memory Datasets Fabian Schuiki Michael Schaffner Frank K. Gürkaynak Luca Benini 21 70 0 19 Feb 2018
Learning to Prune Filters in Convolutional Neural Networks Qiangui Huang S. Kevin Zhou Suya You Ulrich Neumann VLM 18 176 0 23 Jan 2018
Piggyback: Adapting a Single Network to Multiple Tasks by Learning to Mask Weights Arun Mallya Dillon Davis Svetlana Lazebnik CLL 10 35 0 19 Jan 2018
Deep Expander Networks: Efficient Deep Networks from Graph Theory Ameya Prabhu G. Varma A. Namboodiri GNN 21 70 0 23 Nov 2017
Towards Effective Low-bitwidth Convolutional Neural Networks Bohan Zhuang Chunhua Shen Mingkui Tan Lingqiao Liu Ian Reid MQ 26 231 0 01 Nov 2017
Connectivity Learning in Multi-Branch Networks Karim Ahmed Lorenzo Torresani 16 26 0 27 Sep 2017
Learning Intrinsic Sparse Structures within Long Short-Term Memory W. Wen Yuxiong He Samyam Rajbhandari Minjia Zhang Wenhan Wang Fang Liu Bin Hu Yiran Chen H. Li MQ 21 140 0 15 Sep 2017
Channel Pruning for Accelerating Very Deep Neural Networks Yihui He Xiangyu Zhang Jian-jun Sun 32 2,503 0 19 Jul 2017
Data-Driven Sparse Structure Selection for Deep Neural Networks Zehao Huang Naiyan Wang 33 558 0 05 Jul 2017
Network Sketching: Exploiting Binary Structure in Deep CNNs Yiwen Guo Anbang Yao Hao Zhao Yurong Chen MQ 21 95 0 07 Jun 2017
Bayesian Compression for Deep Learning Christos Louizos Karen Ullrich Max Welling UQCV BDL 15 479 0 24 May 2017
Speeding up Convolutional Neural Networks By Exploiting the Sparsity of Rectifier Units S. Shi Xiaowen Chu 15 43 0 25 Apr 2017
Incremental Network Quantization: Towards Lossless CNNs with Low-Precision Weights Aojun Zhou Anbang Yao Yiwen Guo Lin Xu Yurong Chen MQ 311 1,047 0 10 Feb 2017