ADMM-NN: An Algorithm-Hardware Co-Design Framework of DNNs Using Alternating Direction Method of Multipliers

31 December 2018

Papers citing "ADMM-NN: An Algorithm-Hardware Co-Design Framework of DNNs Using Alternating Direction Method of Multipliers"

50 / 63 papers shown

Title
Non-transferable Pruning Ruyi Ding Lili Su A. A. Ding Yunsi Fei AAML 24 2 0 10 Oct 2024
Realizing Unaligned Block-wise Pruning for DNN Acceleration on Mobile Devices Hayun Lee Dongkun Shin MQ 23 0 0 29 Jul 2024
Register Your Forests: Decision Tree Ensemble Optimization by Explicit CPU Register Allocation Daniel Biebert Christian Hakert Kuan-Hsun Chen Jian-Jia Chen 31 1 0 10 Apr 2024
A Survey of Lottery Ticket Hypothesis Bohan Liu Zijie Zhang Peixiong He Zhensen Wang Yang Xiao Ruimeng Ye Yang Zhou Wei-Shinn Ku Bo Hui UQCV 37 12 0 07 Mar 2024
Ada-QPacknet -- adaptive pruning with bit width reduction as an efficient continual learning method without forgetting Marcin Pietroñ Dominik Zurek Kamil Faber Roberto Corizzo CLL 29 2 0 14 Aug 2023
FPGA Resource-aware Structured Pruning for Real-Time Neural Networks Benjamin Ramhorst Vladimir Loncar G. Constantinides 25 4 0 09 Aug 2023
Sensi-BERT: Towards Sensitivity Driven Fine-Tuning for Parameter-Efficient BERT Souvik Kundu S. Nittur Maciej Szankin Sairam Sundaresan MQ 25 2 0 14 Jul 2023
Surrogate Lagrangian Relaxation: A Path To Retrain-free Deep Neural Network Pruning Shangli Zhou Mikhail A. Bragin Lynn Pepin Deniz Gurevin Fei Miao Caiwen Ding 14 3 0 08 Apr 2023
MMVC: Learned Multi-Mode Video Compression with Block-based Prediction Mode Selection and Density-Adaptive Entropy Coding Bowen Liu Yu Chen Rakesh Chowdary Machineni Shiyu Liu Hun-Seok Kim 22 17 0 05 Apr 2023
Pruning Adversarially Robust Neural Networks without Adversarial Examples T. Jian Zifeng Wang Yanzhi Wang Jennifer Dy Stratis Ioannidis AAML VLM 39 11 0 09 Oct 2022
Advancing Model Pruning via Bi-level Optimization Yihua Zhang Yuguang Yao Parikshit Ram Pu Zhao Tianlong Chen Min-Fong Hong Yanzhi Wang Sijia Liu 39 68 0 08 Oct 2022
Compressing Pre-trained Transformers via Low-Bit NxM Sparsity for Natural Language Understanding Connor Holmes Minjia Zhang Yuxiong He Bo Wu 11 3 0 30 Jun 2022
Compilation and Optimizations for Efficient Machine Learning on Embedded Systems Xiaofan Zhang Yao Chen Cong Hao Sitao Huang Yuhong Li Deming Chen 30 1 0 06 Jun 2022
Quarantine: Sparsity Can Uncover the Trojan Attack Trigger for Free Tianlong Chen Zhenyu (Allen) Zhang Yihua Zhang Shiyu Chang Sijia Liu Zhangyang Wang AAML 46 25 0 24 May 2022
Neural Network-based OFDM Receiver for Resource Constrained IoT Devices N. Soltani Hai Cheng M. Belgiovine Yanyu Li Haoqing Li ... Tommaso Melodia Pau Closas Yanzhi Wang Deniz Erdogmus Kaushik R. Chowdhury 17 10 0 12 May 2022
E^2TAD: An Energy-Efficient Tracking-based Action Detector Xin Hu Zhenyu Wu Haoyuan Miao Siqi Fan Taiyu Long ... Pengcheng Pi Yi Wu Zhou Ren Zhangyang Wang G. Hua 19 2 0 09 Apr 2022
LilNetX: Lightweight Networks with EXtreme Model Compression and Structured Sparsification Sharath Girish Kamal Gupta Saurabh Singh Abhinav Shrivastava 28 11 0 06 Apr 2022
CHEX: CHannel EXploration for CNN Model Compression Zejiang Hou Minghai Qin Fei Sun Xiaolong Ma Kun Yuan Yi Xu Yen-kuang Chen Rong Jin Yuan Xie S. Kung 16 71 0 29 Mar 2022
Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets Tianlong Chen Xuxi Chen Xiaolong Ma Yanzhi Wang Zhangyang Wang 16 34 0 09 Feb 2022
Speedup deep learning models on GPU by taking advantage of efficient unstructured pruning and bit-width reduction Marcin Pietroñ Dominik Zurek 22 13 0 28 Dec 2021
SPViT: Enabling Faster Vision Transformers via Soft Token Pruning Zhenglun Kong Peiyan Dong Xiaolong Ma Xin Meng Mengshu Sun ... Geng Yuan Bin Ren Minghai Qin H. Tang Yanzhi Wang ViT 28 141 0 27 Dec 2021
Compact Multi-level Sparse Neural Networks with Input Independent Dynamic Rerouting Minghai Qin Tianyun Zhang Fei Sun Yen-kuang Chen M. Fardad Yanzhi Wang Yuan Xie 31 0 0 21 Dec 2021
Load-balanced Gather-scatter Patterns for Sparse Deep Neural Networks Fei Sun Minghai Qin Tianyun Zhang Xiaolong Ma Haoran Li Junwen Luo Zihao Zhao Yen-kuang Chen Yuan Xie 17 1 0 20 Dec 2021
Enabling Fast Deep Learning on Tiny Energy-Harvesting IoT Devices Sahidul Islam Jieren Deng Shangli Zhou Chen Pan Caiwen Ding Mimi Xie 26 18 0 28 Nov 2021
Automatic Mapping of the Best-Suited DNN Pruning Schemes for Real-Time Mobile Acceleration Yifan Gong Geng Yuan Zheng Zhan Wei Niu Zhengang Li ... Sijia Liu Bin Ren Xue Lin Xulong Tang Yanzhi Wang 20 10 0 22 Nov 2021
DSEE: Dually Sparsity-embedded Efficient Tuning of Pre-trained Language Models Xuxi Chen Tianlong Chen Weizhu Chen Ahmed Hassan Awadallah Zhangyang Wang Yu Cheng MoE ALM 20 10 0 30 Oct 2021
NxMTransformer: Semi-Structured Sparsification for Natural Language Understanding via ADMM Connor Holmes Minjia Zhang Yuxiong He Bo Wu 29 18 0 28 Oct 2021
GDP: Stabilized Neural Network Pruning via Gates with Differentiable Polarization Yi Guo Huan Yuan Jianchao Tan Zhangyang Wang Sen Yang Ji Liu 18 46 0 06 Sep 2021
GRIM: A General, Real-Time Deep Learning Inference Framework for Mobile Devices based on Fine-Grained Structured Weight Sparsity Wei Niu Zhengang Xiaolong Ma Peiyan Dong Gang Zhou Xuehai Qian Xue Lin Yanzhi Wang Bin Ren 14 19 0 25 Aug 2021
Achieving on-Mobile Real-Time Super-Resolution with Neural Architecture and Pruning Search Zheng Zhan Yifan Gong Pu Zhao Geng Yuan Wei Niu ... Malith Jayaweera David Kaeli Bin Ren Xue Lin Yanzhi Wang SupR 27 41 0 18 Aug 2021
CAP-RAM: A Charge-Domain In-Memory Computing 6T-SRAM for Accurate and Precision-Programmable CNN Inference Zhiyu Chen Zhanghao Yu Qing Jin Yan He Jingyu Wang Sheng Lin Dai Li Yanzhi Wang Kaiyuan Yang MQ 21 78 0 06 Jul 2021
Improving DNN Fault Tolerance using Weight Pruning and Differential Crossbar Mapping for ReRAM-based Edge AI Geng Yuan Zhiheng Liao Xiaolong Ma Yuxuan Cai Zhenglun Kong ... Hongwu Peng Ning Liu Ao Ren Jinhui Wang Yanzhi Wang AAML 36 33 0 16 Jun 2021
FORMS: Fine-grained Polarized ReRAM-based In-situ Computation for Mixed-signal DNN Accelerator Geng Yuan Payman Behnam Zhengang Li Ali Shafiee Sheng Lin ... Hang Liu Xuehai Qian M. N. Bojnordi Yanzhi Wang Caiwen Ding 19 68 0 16 Jun 2021
Extremely Low Footprint End-to-End ASR System for Smart Device Zhifu Gao Yiwu Yao Shiliang Zhang Jun Yang Ming Lei Ian Mcloughlin 14 12 0 06 Apr 2021
Lottery Ticket Preserves Weight Correlation: Is It Desirable or Not? Ning Liu Geng Yuan Zhengping Che Xuan Shen Xiaolong Ma Qing Jin Jian Ren Jian Tang Sijia Liu Yanzhi Wang 26 30 0 19 Feb 2021
Variational Nested Dropout Yufei Cui Yushun Mao Ziquan Liu Qiao Li Antoni B. Chan Xue Liu Tei-Wei Kuo Chun Jason Xue BDL 22 5 0 27 Jan 2021
Learn-Prune-Share for Lifelong Learning Zifeng Wang T. Jian Kaushik R. Chowdhury Yanzhi Wang Jennifer Dy Stratis Ioannidis KELM CLL 23 35 0 13 Dec 2020
Mix and Match: A Novel FPGA-Centric Deep Neural Network Quantization Framework Sung-En Chang Yanyu Li Mengshu Sun Runbin Shi Hayden Kwok-Hay So Xuehai Qian Yanzhi Wang Xue Lin MQ 18 82 0 08 Dec 2020
A Tunable Robust Pruning Framework Through Dynamic Network Rewiring of DNNs Souvik Kundu M. Nazemi P. Beerel Massoud Pedram AAML 13 67 0 03 Nov 2020
Scalable Adversarial Attack on Graph Neural Networks with Alternating Direction Method of Multipliers Boyuan Feng Yuke Wang Xu Li Yufei Ding GNN AAML 11 2 0 22 Sep 2020
MSP: An FPGA-Specific Mixed-Scheme, Multi-Precision Deep Neural Network Quantization Framework Sung-En Chang Yanyu Li Mengshu Sun Weiwen Jiang Runbin Shi Xue Lin Yanzhi Wang MQ 19 7 0 16 Sep 2020
Alternating Direction Method of Multipliers for Quantization Tianjian Huang Prajwal Singhania Maziar Sanjabi Pabitra Mitra Meisam Razaviyayn MQ 19 10 0 08 Sep 2020
SparseTrain: Exploiting Dataflow Sparsity for Efficient Convolutional Neural Networks Training Pengcheng Dai Jianlei Yang Xucheng Ye Xingzhou Cheng Junyu Luo Linghao Song Yiran Chen Weisheng Zhao 19 21 0 21 Jul 2020
Term Revealing: Furthering Quantization at Run Time on Quantized DNNs H. T. Kung Bradley McDanel S. Zhang MQ 13 9 0 13 Jul 2020
Hardware Acceleration of Sparse and Irregular Tensor Computations of ML Models: A Survey and Insights Shail Dave Riyadh Baghdadi Tony Nowatzki Sasikanth Avancha Aviral Shrivastava Baoxin Li 46 81 0 02 Jul 2020
Adversarial Attacks on Brain-Inspired Hyperdimensional Computing-Based Classifiers Fangfang Yang Shaolei Ren AAML 16 16 0 10 Jun 2020
Computation on Sparse Neural Networks: an Inspiration for Future Hardware Fei Sun Minghai Qin Tianyun Zhang Liu Liu Yen-kuang Chen Yuan Xie 29 7 0 24 Apr 2020
A Unified DNN Weight Compression Framework Using Reweighted Optimization Methods Tianyun Zhang Xiaolong Ma Zheng Zhan Shangli Zhou Minghai Qin Fei Sun Yen-kuang Chen Caiwen Ding M. Fardad Yanzhi Wang 25 5 0 12 Apr 2020
Sparse Optimization for Green Edge AI Inference Xiangyu Yang Sheng Hua Yuanming Shi Hao Wang Jun Zhang Khaled B. Letaief 19 14 0 24 Feb 2020
RTMobile: Beyond Real-Time Mobile Acceleration of RNNs for Speech Recognition Peiyan Dong Siyue Wang Wei Niu Chengming Zhang Sheng Lin ... Yifan Gong Bin Ren X. Lin Yanzhi Wang Dingwen Tao 9 45 0 19 Feb 2020