An Automatic and Efficient BERT Pruning for Edge AI Systems

An Automatic and Efficient BERT Pruning for Edge AI Systems

21 June 2022

Hongwu Peng

Dongkuan Xu

Caiwen Ding

Papers citing "An Automatic and Efficient BERT Pruning for Edge AI Systems"

11 / 11 papers shown

Title
Accel-GCN: High-Performance GPU Accelerator Design for Graph Convolution Networks Xiaoru Xie Hongwu Peng Amit Hasan Shaoyi Huang Jiahui Zhao Haowen Fang Wei Zhang Tong Geng O. Khan Caiwen Ding GNN 30 30 0 22 Aug 2023
AutoReP: Automatic ReLU Replacement for Fast Private Network Inference Hongwu Peng Shaoyi Huang Tong Zhou Yukui Luo Chenghong Wang ... Tony Geng Kaleel Mahmood Wujie Wen Xiaolin Xu Caiwen Ding OffRL 32 38 0 20 Aug 2023
Block-wise Bit-Compression of Transformer-based Models Gaochen Dong W. Chen 8 0 0 16 Mar 2023
Dynamic Sparse Training via Balancing the Exploration-Exploitation Trade-off Shaoyi Huang Bowen Lei Dongkuan Xu Hongwu Peng Yue Sun Mimi Xie Caiwen Ding 13 19 0 30 Nov 2022
PolyMPCNet: Towards ReLU-free Neural Architecture Search in Two-party Computation Based Private Inference Hongwu Peng Shangli Zhou Yukui Luo Shijin Duan Nuo Xu ... Tong Geng Ang Li Wujie Wen Xiaolin Xu Caiwen Ding 21 3 0 20 Sep 2022
Towards Sparsification of Graph Neural Networks Hongwu Peng Deniz Gurevin Shaoyi Huang Tong Geng Weiwen Jiang O. Khan Caiwen Ding GNN 30 24 0 11 Sep 2022
A Length Adaptive Algorithm-Hardware Co-design of Transformer on FPGA Through Sparse Attention and Dynamic Pipelining Hongwu Peng Shaoyi Huang Shiyang Chen Bingbing Li Tong Geng ... Weiwen Jiang Wujie Wen J. Bi Hang Liu Caiwen Ding 32 54 0 07 Aug 2022
The Lottery Ticket Hypothesis for Pre-trained BERT Networks Tianlong Chen Jonathan Frankle Shiyu Chang Sijia Liu Yang Zhang Zhangyang Wang Michael Carbin 148 376 0 23 Jul 2020
What is the State of Neural Network Pruning? Davis W. Blalock Jose Javier Gonzalez Ortiz Jonathan Frankle John Guttag 181 1,027 0 06 Mar 2020
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,950 0 20 Apr 2018
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 214 7,923 0 17 Aug 2015