Probing Structured Pruning on Multilingual Pre-trained Models: Settings,
Algorithms, and Efficiency

Probing Structured Pruning on Multilingual Pre-trained Models: Settings, Algorithms, and Efficiency

6 April 2022

Runxin Xu

Fei Huang

Papers citing "Probing Structured Pruning on Multilingual Pre-trained Models: Settings, Algorithms, and Efficiency"

5 / 5 papers shown

Title
On the Prunability of Attention Heads in Multilingual BERT Aakriti Budhraja Madhura Pande Pratyush Kumar Mitesh M. Khapra 42 4 0 26 Sep 2021
Importance-based Neuron Allocation for Multilingual Neural Machine Translation Wanying Xie Yang Feng Shuhao Gu Dong Yu 31 32 0 14 Jul 2021
Larger-Scale Transformers for Multilingual Masked Language Modeling Naman Goyal Jingfei Du Myle Ott Giridhar Anantharaman Alexis Conneau 90 98 0 02 May 2021
Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks Torsten Hoefler Dan Alistarh Tal Ben-Nun Nikoli Dryden Alexandra Peste MQ 139 684 0 31 Jan 2021
MLQA: Evaluating Cross-lingual Extractive Question Answering Patrick Lewis Barlas Oğuz Ruty Rinott Sebastian Riedel Holger Schwenk ELM 246 491 0 16 Oct 2019