ADMM-NN: An Algorithm-Hardware Co-Design Framework of DNNs Using Alternating Direction Method of Multipliers

31 December 2018

Papers citing "ADMM-NN: An Algorithm-Hardware Co-Design Framework of DNNs Using Alternating Direction Method of Multipliers"

50 / 63 papers shown

Title
The Right to be Forgotten in Pruning: Unveil Machine Unlearning on Sparse Models Yang Xiao Gen Li Jie Ji Ruimeng Ye Xiaolong Ma Bo Hui MU 234 1 0 24 Jul 2025
Non-transferable PruningEuropean Conference on Computer Vision (ECCV), 2024 Ruyi Ding Lili Su A. A. Ding Yunsi Fei AAML 172 3 0 10 Oct 2024
Realizing Unaligned Block-wise Pruning for DNN Acceleration on Mobile Devices Hayun Lee Dongkun Shin MQ 179 0 0 29 Jul 2024
Register Your Forests: Decision Tree Ensemble Optimization by Explicit CPU Register Allocation Daniel Biebert Christian Hakert Kuan-Hsun Chen Jian-Jia Chen 175 2 0 10 Apr 2024
A Survey of Lottery Ticket Hypothesis Bohan Liu Zijie Zhang Peixiong He Zhensen Wang Yang Xiao Ruimeng Ye Yang Zhou Wei-Shinn Ku Bo Hui UQCV 243 22 0 07 Mar 2024
Ada-QPacknet -- adaptive pruning with bit width reduction as an efficient continual learning method without forgetting Marcin Pietroñ Dominik Zurek Kamil Faber Roberto Corizzo CLL 195 2 0 14 Aug 2023
FPGA Resource-aware Structured Pruning for Real-Time Neural NetworksInternational Conference on Field-Programmable Technology (ICFPT), 2023 Benjamin Ramhorst Vladimir Loncar George A. Constantinides 180 10 0 09 Aug 2023
Sensi-BERT: Towards Sensitivity Driven Fine-Tuning for Parameter-Efficient BERT Souvik Kundu S. Nittur Maciej Szankin Sairam Sundaresan MQ 179 2 0 14 Jul 2023
Surrogate Lagrangian Relaxation: A Path To Retrain-free Deep Neural Network Pruning Shangli Zhou Mikhail A. Bragin Lynn Pepin Deniz Gurevin Fei Miao Caiwen Ding 160 3 0 08 Apr 2023
MMVC: Learned Multi-Mode Video Compression with Block-based Prediction Mode Selection and Density-Adaptive Entropy CodingComputer Vision and Pattern Recognition (CVPR), 2023 Bowen Liu Yu Chen Rakesh Chowdary Machineni Shiyu Liu Hun-Seok Kim 141 24 0 05 Apr 2023
Pruning Adversarially Robust Neural Networks without Adversarial ExamplesIndustrial Conference on Data Mining (IDM), 2022 T. Jian Zifeng Wang Yanzhi Wang Jennifer Dy Stratis Ioannidis AAML VLM 130 14 0 09 Oct 2022
Advancing Model Pruning via Bi-level OptimizationNeural Information Processing Systems (NeurIPS), 2022 Yihua Zhang Yuguang Yao Parikshit Ram Pu Zhao Tianlong Chen Min-Fong Hong Yanzhi Wang Sijia Liu 376 82 0 08 Oct 2022
Compressing Pre-trained Transformers via Low-Bit NxM Sparsity for Natural Language Understanding Connor Holmes Minjia Zhang Yuxiong He Bo Wu 133 3 0 30 Jun 2022
Compilation and Optimizations for Efficient Machine Learning on Embedded Systems Xiaofan Zhang Yao Chen Cong Hao Sitao Huang Yuhong Li Deming Chen 175 2 0 06 Jun 2022
Quarantine: Sparsity Can Uncover the Trojan Attack Trigger for FreeComputer Vision and Pattern Recognition (CVPR), 2022 Tianlong Chen Zhenyu Zhang Yihua Zhang Shiyu Chang Sijia Liu Zinan Lin AAML 160 26 0 24 May 2022
Neural Network-based OFDM Receiver for Resource Constrained IoT DevicesIEEE Internet of Things Magazine (IEEE IoT Magazine), 2022 N. Soltani Hai Cheng M. Belgiovine Yanyu Li Haoqing Li ... Tommaso Melodia Pau Closas Yanzhi Wang Deniz Erdogmus Kaushik R. Chowdhury 155 13 0 12 May 2022
E^2TAD: An Energy-Efficient Tracking-based Action Detector Xin Hu Zhenyu Wu Haoyuan Miao Siqi Fan Taiyu Long ... Pengcheng Pi Yi Wu Zhou Ren Zinan Lin G. Hua 374 2 0 09 Apr 2022
LilNetX: Lightweight Networks with EXtreme Model Compression and Structured SparsificationInternational Conference on Learning Representations (ICLR), 2022 Sharath Girish Kamal Gupta Saurabh Singh Abhinav Shrivastava 192 12 0 06 Apr 2022
CHEX: CHannel EXploration for CNN Model CompressionComputer Vision and Pattern Recognition (CVPR), 2022 Zejiang Hou Minghai Qin Fei Sun Xiaolong Ma Kun Yuan Yi Xu Yen-kuang Chen Rong Jin Yuan Xie S. Kung 159 82 0 29 Mar 2022
Coarsening the Granularity: Towards Structurally Sparse Lottery TicketsInternational Conference on Machine Learning (ICML), 2022 Tianlong Chen Xuxi Chen Xiaolong Ma Yanzhi Wang Zinan Lin 153 41 0 09 Feb 2022
Speedup deep learning models on GPU by taking advantage of efficient unstructured pruning and bit-width reductionJournal of Computer Science (JCS), 2021 Marcin Pietroñ Dominik Zurek 150 17 0 28 Dec 2021
SPViT: Enabling Faster Vision Transformers via Soft Token PruningEuropean Conference on Computer Vision (ECCV), 2021 Zhenglun Kong Zhaoyang Han Xiaolong Ma Xin Meng Mengshu Sun ... Geng Yuan Bin Ren Minghai Qin Hao Tang Yanzhi Wang ViT 308 192 0 27 Dec 2021
Compact Multi-level Sparse Neural Networks with Input Independent Dynamic ReroutingIEEE International Conference on Tools with Artificial Intelligence (ICTAI), 2021 Minghai Qin Tianyun Zhang Fei Sun Yen-kuang Chen M. Fardad Yanzhi Wang Yuan Xie 223 0 0 21 Dec 2021
Load-balanced Gather-scatter Patterns for Sparse Deep Neural Networks Fei Sun Minghai Qin Tianyun Zhang Xiaolong Ma Haoran Li Junwen Luo Zihao Zhao Yen-kuang Chen Yuan Xie 157 1 0 20 Dec 2021
Enabling Fast Deep Learning on Tiny Energy-Harvesting IoT DevicesDesign, Automation and Test in Europe (DATE), 2021 Sahidul Islam Jieren Deng Shangli Zhou Chen Pan Caiwen Ding Mimi Xie 194 26 0 28 Nov 2021
Automatic Mapping of the Best-Suited DNN Pruning Schemes for Real-Time Mobile Acceleration Yifan Gong Geng Yuan Zheng Zhan Wei Niu Zhengang Li ... Sijia Liu Bin Ren Xue Lin Xulong Tang Yanzhi Wang 150 12 0 22 Nov 2021
DSEE: Dually Sparsity-embedded Efficient Tuning of Pre-trained Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Xuxi Chen Tianlong Chen Weizhu Chen Ahmed Hassan Awadallah Zinan Lin Yu Cheng MoE ALM 255 10 0 30 Oct 2021
NxMTransformer: Semi-Structured Sparsification for Natural Language Understanding via ADMMNeural Information Processing Systems (NeurIPS), 2021 Connor Holmes Minjia Zhang Yuxiong He Bo Wu 107 24 0 28 Oct 2021
GDP: Stabilized Neural Network Pruning via Gates with Differentiable Polarization Yi Guo Huan Yuan Jianchao Tan Zinan Lin Sen Yang Ji Liu 265 51 0 06 Sep 2021
GRIM: A General, Real-Time Deep Learning Inference Framework for Mobile Devices based on Fine-Grained Structured Weight SparsityIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021 Wei Niu Zhengang Xiaolong Ma Zhaoyang Han Gang Zhou Xuehai Qian Xue Lin Yanzhi Wang Bin Ren 106 23 0 25 Aug 2021
Achieving on-Mobile Real-Time Super-Resolution with Neural Architecture and Pruning Search Zheng Zhan Yifan Gong Pu Zhao Geng Yuan Wei Niu ... Malith Jayaweera David Kaeli Bin Ren Xue Lin Yanzhi Wang SupR 193 58 0 18 Aug 2021
CAP-RAM: A Charge-Domain In-Memory Computing 6T-SRAM for Accurate and Precision-Programmable CNN Inference Zhiyu Chen Zhanghao Yu Qing Jin Yan He Jingyu Wang Sheng Lin Dai Li Yanzhi Wang Kaiyuan Yang MQ 112 93 0 06 Jul 2021
Improving DNN Fault Tolerance using Weight Pruning and Differential Crossbar Mapping for ReRAM-based Edge AI Geng Yuan Zhiheng Liao Xiaolong Ma Yuxuan Cai Zhenglun Kong ... Hongwu Peng Ning Liu Ao Ren Jinhui Wang Yanzhi Wang AAML 222 35 0 16 Jun 2021
FORMS: Fine-grained Polarized ReRAM-based In-situ Computation for Mixed-signal DNN Accelerator Geng Yuan Rohit Das Zhengang Li Ali Shafiee Sheng Lin ... Hang Liu Xuehai Qian M. N. Bojnordi Yanzhi Wang Caiwen Ding 181 74 0 16 Jun 2021
Extremely Low Footprint End-to-End ASR System for Smart DeviceInterspeech (Interspeech), 2021 Zhifu Gao Yiwu Yao Shiliang Zhang Jun Yang Ming Lei Ian Mcloughlin 100 14 0 06 Apr 2021
Lottery Ticket Preserves Weight Correlation: Is It Desirable or Not?International Conference on Machine Learning (ICML), 2021 Ning Liu Geng Yuan Zhengping Che Xuan Shen Xiaolong Ma Qing Jin Jian Ren Jian Tang Sijia Liu Yanzhi Wang 197 33 0 19 Feb 2021
Variational Nested DropoutIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021 Yufei Cui Yushun Mao Ziquan Liu Qiao Li Antoni B. Chan Xue Liu Tei-Wei Kuo Chun Jason Xue BDL 122 5 0 27 Jan 2021
Learn-Prune-Share for Lifelong LearningIndustrial Conference on Data Mining (IDM), 2020 Zifeng Wang T. Jian Kaushik R. Chowdhury Yanzhi Wang Jennifer Dy Stratis Ioannidis KELM CLL 146 43 0 13 Dec 2020
Mix and Match: A Novel FPGA-Centric Deep Neural Network Quantization Framework Sung-En Chang Yanyu Li Mengshu Sun Runbin Shi Hayden Kwok-Hay So Xuehai Qian Yanzhi Wang Xue Lin MQ 270 104 0 08 Dec 2020
A Tunable Robust Pruning Framework Through Dynamic Network Rewiring of DNNs Souvik Kundu M. Nazemi Peter A. Beerel Massoud Pedram AAML 258 69 0 03 Nov 2020
Scalable Adversarial Attack on Graph Neural Networks with Alternating Direction Method of Multipliers Boyuan Feng Yuke Wang Xu Li Yufei Ding GNN AAML 162 2 0 22 Sep 2020
MSP: An FPGA-Specific Mixed-Scheme, Multi-Precision Deep Neural Network Quantization Framework Sung-En Chang Yanyu Li Mengshu Sun Weiwen Jiang Runbin Shi Xue Lin Yanzhi Wang MQ 134 8 0 16 Sep 2020
Alternating Direction Method of Multipliers for QuantizationInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2020 Tianjian Huang Prajwal Singhania Maziar Sanjabi Pabitra Mitra Meisam Razaviyayn MQ 243 12 0 08 Sep 2020
SparseTrain: Exploiting Dataflow Sparsity for Efficient Convolutional Neural Networks Training Pengcheng Dai Jianlei Yang Xucheng Ye Xingzhou Cheng Junyu Luo Linghao Song Yiran Chen Weisheng Zhao 125 25 0 21 Jul 2020
Term Revealing: Furthering Quantization at Run Time on Quantized DNNs H. T. Kung Bradley McDanel Shanghang Zhang MQ 153 10 0 13 Jul 2020
Hardware Acceleration of Sparse and Irregular Tensor Computations of ML Models: A Survey and Insights Shail Dave Riyadh Baghdadi Tony Nowatzki Sasikanth Avancha Aviral Shrivastava Baoxin Li 267 98 0 02 Jul 2020
Adversarial Attacks on Brain-Inspired Hyperdimensional Computing-Based Classifiers Fangfang Yang Shaolei Ren AAML 104 17 0 10 Jun 2020
Computation on Sparse Neural Networks: an Inspiration for Future Hardware Fei Sun Minghai Qin Tianyun Zhang Liu Liu Yen-kuang Chen Yuan Xie 284 7 0 24 Apr 2020
A Unified DNN Weight Compression Framework Using Reweighted Optimization Methods Tianyun Zhang Xiaolong Ma Zheng Zhan Shangli Zhou Minghai Qin Fei Sun Yen-kuang Chen Caiwen Ding M. Fardad Yanzhi Wang 89 5 0 12 Apr 2020
Sparse Optimization for Green Edge AI Inference Xiangyu Yang Sheng Hua Yuanming Shi Hao Wang Jun Zhang Khaled B. Letaief 190 15 0 24 Feb 2020