LightMBERT: A Simple Yet Effective Method for Multilingual BERT Distillation

11 March 2021

Lifeng Shang

Xin Jiang

Linlin Li

Qun Liu

Papers citing "LightMBERT: A Simple Yet Effective Method for Multilingual BERT Distillation"

3 / 3 papers shown

Title
CAMeMBERT: Cascading Assistant-Mediated Multilingual BERT Dan DeGenaro Jugal Kalita 22 0 0 22 Dec 2022
Too Brittle To Touch: Comparing the Stability of Quantization and Distillation Towards Developing Lightweight Low-Resource MT Models Harshita Diddee Sandipan Dandapat Monojit Choudhury T. Ganu Kalika Bali 27 5 0 27 Oct 2022
Distilling the Knowledge of Romanian BERTs Using Multiple Teachers Andrei-Marius Avram Darius Catrina Dumitru-Clementin Cercel Mihai Dascualu Traian Rebedea Vasile Puaics Dan Tufics 22 12 0 23 Dec 2021