Data-Driven Sparse Structure Selection for Deep Neural Networks

5 July 2017

Papers citing "Data-Driven Sparse Structure Selection for Deep Neural Networks"

50 / 273 papers shown

Title
The Role of Regularization in Shaping Weight and Node Pruning Dependency and Dynamics Yael Ben-Guigui Jacob Goldberger Tammy Riklin-Raviv 17 0 0 07 Dec 2020
Fine-Grained Dynamic Head for Object Detection Lin Song Yanwei Li Zhengkai Jiang Zeming Li Hongbin Sun Jian-jun Sun N. Zheng ObjD 19 41 0 07 Dec 2020
Layer Pruning via Fusible Residual Convolutional Block for Deep Neural Networks Pengtao Xu Jian Cao Fanhua Shang Wenyu Sun Pu Li 3DPC 12 24 0 29 Nov 2020
Bringing AI To Edge: From Deep Learning's Perspective Di Liu Hao Kong Xiangzhong Luo Weichen Liu Ravi Subramaniam 42 116 0 25 Nov 2020
MGIC: Multigrid-in-Channels Neural Network Architectures Moshe Eliasof Jonathan Ephrath Lars Ruthotto Eran Treister 31 7 0 17 Nov 2020
Learning Efficient GANs for Image Translation via Differentiable Masks and co-Attention Distillation Shaojie Li Mingbao Lin Yan Wang Fei Chao Ling Shao Rongrong Ji 18 32 0 17 Nov 2020
LEAN: graph-based pruning for convolutional neural networks by extracting longest chains R. Schoonhoven A. Hendriksen D. Pelt K. Batenburg 3DPC 8 4 0 13 Nov 2020
Dirichlet Pruning for Neural Network Compression Kamil Adamczewski Mijung Park 24 3 0 10 Nov 2020
Channel Planting for Deep Neural Networks using Knowledge Distillation Kakeru Mitsuno Yuichiro Nomura Takio Kurita 20 2 0 04 Nov 2020
Filter Pruning using Hierarchical Group Sparse Regularization for Deep Convolutional Neural Networks Kakeru Mitsuno Takio Kurita 6 6 0 04 Nov 2020
DAIS: Automatic Channel Pruning via Differentiable Annealing Indicator Search Yushuo Guan Ning Liu Pengyu Zhao Zhengping Che Kaigui Bian Yanzhi Wang Jian Tang 12 38 0 04 Nov 2020
Methods for Pruning Deep Neural Networks S. Vadera Salem Ameen 3DPC 16 122 0 31 Oct 2020
Greedy Optimization Provably Wins the Lottery: Logarithmic Number of Winning Tickets is Enough Mao Ye Lemeng Wu Qiang Liu 15 17 0 29 Oct 2020
Data Agnostic Filter Gating for Efficient Deep Networks Xiu Su Shan You Tao Huang Hongyan Xu Fei-Yue Wang Chao Qian Changshui Zhang Chang Xu 19 10 0 28 Oct 2020
Differentiable Channel Sparsity Search via Weight Sharing within Filters Yu Zhao Chung-Kuei Lee 6 1 0 28 Oct 2020
Towards Optimal Filter Pruning with Balanced Performance and Pruning Speed Dong Li Sitong Chen Xudong Liu Yunda Sun Li Lyna Zhang VLM 10 4 0 14 Oct 2020
Comprehensive Online Network Pruning via Learnable Scaling Factors Muhammad Umair Haider M. Taj 8 6 0 06 Oct 2020
Pruning Filter in Filter Fanxu Meng Hao Cheng Ke Li Huixiang Luo Xiao-Wei Guo Guangming Lu Xing Sun VLM 24 103 0 30 Sep 2020
Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot Jingtong Su Yihang Chen Tianle Cai Tianhao Wu Ruiqi Gao Liwei Wang J. Lee 6 85 0 22 Sep 2020
Holistic Filter Pruning for Efficient Deep Neural Networks Lukas Enderich Fabian Timm Wolfram Burgard 16 7 0 17 Sep 2020
On the Orthogonality of Knowledge Distillation with Other Techniques: From an Ensemble Perspective Seonguk Park Kiyoon Yoo Nojun Kwak FedML 8 3 0 09 Sep 2020
GAN Slimming: All-in-One GAN Compression by A Unified Optimization Framework Haotao Wang Shupeng Gui Haichuan Yang Ji Liu Zhangyang Wang 6 81 0 25 Aug 2020
HALO: Learning to Prune Neural Networks with Shrinkage Skyler Seto M. Wells Wenyu Zhang 19 0 0 24 Aug 2020
Training Sparse Neural Networks using Compressed Sensing Jonathan W. Siegel Jianhong Chen Pengchuan Zhang Jinchao Xu 24 5 0 21 Aug 2020
Learning Connectivity of Neural Networks from a Topological Perspective Kun Yuan Quanquan Li Jing Shao Junjie Yan 6 3 0 19 Aug 2020
RARTS: An Efficient First-Order Relaxed Architecture Search Method Fanghui Xue Y. Qi Jack Xin 14 1 0 10 Aug 2020
Weight-Sharing Neural Architecture Search: A Battle to Shrink the Optimization Gap Lingxi Xie Xin Chen Kaifeng Bi Longhui Wei Yuhui Xu ... Lanfei Wang Anxiang Xiao Jianlong Chang Xiaopeng Zhang Qi Tian ViT 33 108 0 04 Aug 2020
Neural Architecture Search as Sparse Supernet Y. Wu Aoming Liu Zhiwu Huang Siwei Zhang Luc Van Gool 17 22 0 31 Jul 2020
Operation-Aware Soft Channel Pruning using Differentiable Masks Minsoo Kang Bohyung Han AAML 22 138 0 08 Jul 2020
Weight-dependent Gates for Network Pruning Yun Li Zechun Liu Weiqun Wu Haotian Yao X. Zhang Chi Zhang B. Yin 24 13 0 04 Jul 2020
Ramanujan Bipartite Graph Products for Efficient Block Sparse Neural Networks Dharma Teja Vooturi G. Varma Kishore Kothapalli 8 6 0 24 Jun 2020
PFGDF: Pruning Filter via Gaussian Distribution Feature for Deep Neural Networks Acceleration Jianrong Xu Boyu Diao Bifeng Cui Kang Yang Chao Li H. Hong 11 4 0 23 Jun 2020
Slimming Neural Networks using Adaptive Connectivity Scores Madan Ravi Ganesh Dawsin Blanchard Jason J. Corso S. Y. Sekeh 6 10 0 22 Jun 2020
Cogradient Descent for Bilinear Optimization Lian Zhuo Baochang Zhang Linlin Yang Hanlin Chen QiXiang Ye David Doermann G. Guo Rongrong Ji 12 14 0 16 Jun 2020
A Feature-map Discriminant Perspective for Pruning Deep Neural Networks Zejiang Hou S. Kung 4 5 0 28 May 2020
Position-based Scaled Gradient for Model Quantization and Pruning Jangho Kim Kiyoon Yoo Nojun Kwak MQ 11 7 0 22 May 2020
Joint Multi-Dimension Pruning via Numerical Gradient Update Zechun Liu X. Zhang Zhiqiang Shen Zhe Li Yichen Wei Kwang-Ting Cheng Jian Sun 39 18 0 18 May 2020
Dynamic Sparse Training: Find Efficient Sparse Network From Scratch With Trainable Masked Layers Junjie Liu Zhe Xu Runbin Shi R. Cheung Hayden Kwok-Hay So 9 119 0 14 May 2020
Pruning Algorithms to Accelerate Convolutional Neural Networks for Edge Applications: A Survey Jiayi Liu S. Tripathi Unmesh Kurup Mohak Shah 3DPC MedIm 22 52 0 08 May 2020
Stochastic Bottleneck: Rateless Auto-Encoder for Flexible Dimensionality Reduction T. Koike-Akino Ye Wang 8 11 0 06 May 2020
Out-of-the-box channel pruned networks Ragav Venkatesan Gurumurthy Swaminathan Xiong Zhou Anna Luo 15 0 0 30 Apr 2020
Rethinking Class-Discrimination Based CNN Channel Pruning Yuchen Liu D. Wentzlaff S. Kung 11 10 0 29 Apr 2020
Finding the Optimal Network Depth in Classification Tasks Bartosz Wójcik Maciej Wołczyk Klaudia Bałazy Jacek Tabor 4 0 0 17 Apr 2020
GeneCAI: Genetic Evolution for Acquiring Compact AI Mojan Javaheripi Mohammad Samragh T. Javidi F. Koushanfar 29 9 0 08 Apr 2020
Network Adjustment: Channel Search Guided by FLOPs Utilization Ratio Zhengsu Chen J. Niu Lingxi Xie Xuefeng Liu Longhui Wei Qi Tian 14 12 0 06 Apr 2020
DSA: More Efficient Budgeted Pruning via Differentiable Sparsity Allocation Xuefei Ning Tianchen Zhao Wenshuo Li Peng Lei Yu Wang Huazhong Yang 8 103 0 05 Apr 2020
Review of data analysis in vision inspection of power lines with an in-depth discussion of deep learning technology Xinyu Liu Xiren Miao Hao Jiang Jia Chen 25 11 0 22 Mar 2020
Group Sparsity: The Hinge Between Filter Pruning and Decomposition for Network Compression Yawei Li Shuhang Gu Christoph Mayer Luc Van Gool Radu Timofte 123 1 0 19 Mar 2020
MINT: Deep Network Compression via Mutual Information-based Neuron Trimming Madan Ravi Ganesh Jason J. Corso S. Y. Sekeh MQ 30 15 0 18 Mar 2020
SlimConv: Reducing Channel Redundancy in Convolutional Neural Networks by Weights Flipping Jiaxiong Qiu Cai Chen Shuaicheng Liu B. Zeng 4 39 0 16 Mar 2020