AdaBERT: Task-Adaptive BERT Compression with Differentiable Neural Architecture Search

13 January 2020

Jingren Zhou

Papers citing "AdaBERT: Task-Adaptive BERT Compression with Differentiable Neural Architecture Search"

20 / 20 papers shown

Title
Vesper: A Compact and Effective Pretrained Model for Speech Emotion Recognition Weidong Chen Xiaofen Xing Peihao Chen Xiangmin Xu VLM 28 35 0 20 Jul 2023
DDNAS: Discretized Differentiable Neural Architecture Search for Text Classification Kuan-Yu Chen Cheng Li Kuo-Jung Lee 22 1 0 12 Jul 2023
ALT: An Automatic System for Long Tail Scenario Modeling Ya-Lin Zhang Jun Zhou Yankun Ren Yue Zhang Xinxing Yang Meng Li Qitao Shi Longfei Li 25 0 0 19 May 2023
Auto-CARD: Efficient and Robust Codec Avatar Driving for Real-time Mobile Telepresence Y. Fu Yuecheng Li Chenghui Li Jason M. Saragih Peizhao Zhang Xiaoliang Dai Yingyan Lin 3DH 37 2 0 24 Apr 2023
EdgeTran: Co-designing Transformers for Efficient Inference on Mobile Edge Platforms Shikhar Tuli N. Jha 34 3 0 24 Mar 2023
Neural Architecture Search for Effective Teacher-Student Knowledge Transfer in Language Models Aashka Trivedi Takuma Udagawa Michele Merler Rameswar Panda Yousef El-Kurdi Bishwaranjan Bhattacharjee 22 6 0 16 Mar 2023
Prompting to Distill: Boosting Data-Free Knowledge Distillation via Reinforced Prompt Xinyin Ma Xinchao Wang Gongfan Fang Yongliang Shen Weiming Lu 11 11 0 16 May 2022
Fast Monte-Carlo Approximation of the Attention Mechanism Hyunjun Kim Jeonggil Ko 17 2 0 30 Jan 2022
RT-RCG: Neural Network and Accelerator Search Towards Effective and Real-time ECG Reconstruction from Intracardiac Electrograms Yongan Zhang Anton Banta Yonggan Fu M. John A. Post M. Razavi Joseph R. Cavallaro B. Aazhang Yingyan Lin 10 4 0 04 Nov 2021
Differentiable NAS Framework and Application to Ads CTR Prediction Ravi Krishna Aravind Kalaiah Bichen Wu Maxim Naumov Dheevatsa Mudigere M. Smelyanskiy Kurt Keutzer 20 8 0 25 Oct 2021
Towards Efficient Post-training Quantization of Pre-trained Language Models Haoli Bai Lu Hou Lifeng Shang Xin Jiang Irwin King M. Lyu MQ 71 47 0 30 Sep 2021
Low-Latency Incremental Text-to-Speech Synthesis with Distilled Context Prediction Network Takaaki Saeki Shinnosuke Takamichi Hiroshi Saruwatari 18 3 0 22 Sep 2021
EfficientBERT: Progressively Searching Multilayer Perceptron via Warm-up Knowledge Distillation Chenhe Dong Guangrun Wang Hang Xu Jiefeng Peng Xiaozhe Ren Xiaodan Liang 16 28 0 15 Sep 2021
AutoBERT-Zero: Evolving BERT Backbone from Scratch Jiahui Gao Hang Xu Han Shi Xiaozhe Ren Philip L. H. Yu Xiaodan Liang Xin Jiang Zhenguo Li 19 37 0 15 Jul 2021
GiBERT: Introducing Linguistic Knowledge into BERT through a Lightweight Gated Injection Method Nicole Peinelt Marek Rei Maria Liakata 22 2 0 23 Oct 2020
AutoADR: Automatic Model Design for Ad Relevance Yiren Chen Yaming Yang Hong Sun Yujing Wang Yu Xu Wei Shen Rong Zhou Yunhai Tong Jing Bai Ruofei Zhang 34 3 0 14 Oct 2020
Q-BERT: Hessian Based Ultra Low Precision Quantization of BERT Sheng Shen Zhen Dong Jiayu Ye Linjian Ma Z. Yao A. Gholami Michael W. Mahoney Kurt Keutzer MQ 225 574 0 12 Sep 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,950 0 20 Apr 2018
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 264 5,326 0 05 Nov 2016
Convolutional Neural Networks for Sentence Classification Yoon Kim AILaw VLM 250 13,360 0 25 Aug 2014