How multilingual is Multilingual BERT?

4 June 2019

Papers citing "How multilingual is Multilingual BERT?"

50 / 655 papers shown

Title
Indic-Transformers: An Analysis of Transformer Language Models for Indian Languages Kushal Kumar Jain Adwait Deshpande Kumar Shridhar F. Laumann Ayushman Dash 43 51 0 04 Nov 2020
Probing Multilingual BERT for Genetic and Typological Signals Taraka Rama Lisa Beinborn Steffen Eger 8 24 0 04 Nov 2020
TransQuest: Translation Quality Estimation with Cross-lingual Transformers Tharindu Ranasinghe Constantin Orasan R. Mitkov ViT 9 108 0 01 Nov 2020
RussianSuperGLUE: A Russian Language Understanding Evaluation Benchmark Tatiana Shavrina Alena Fenogenova Anton A. Emelyanov Denis Shevelev Ekaterina Artemova Valentin Malykh Vladislav Mikhailov Maria Tikhonova Andrey Chertok Andrey Evlampiev VLM ELM 25 81 0 29 Oct 2020
Cross-lingual Machine Reading Comprehension with Language Branch Knowledge Distillation Junhao Liu Linjun Shou J. Pei Ming Gong Min Yang Daxin Jiang 18 13 0 27 Oct 2020
UPB at SemEval-2020 Task 12: Multilingual Offensive Language Detection on Social Media by Fine-tuning a Variety of BERT-based Models Mircea-Adrian Tanase Dumitru-Clementin Cercel Costin-Gabriel Chiru 6 15 0 26 Oct 2020
When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language Models Benjamin Muller Antonis Anastasopoulos Benoît Sagot Djamé Seddah LRM 124 165 0 24 Oct 2020
Rethinking embedding coupling in pre-trained language models Hyung Won Chung Thibault Févry Henry Tsai Melvin Johnson Sebastian Ruder 93 142 0 24 Oct 2020
DICT-MLM: Improved Multilingual Pre-Training using Bilingual Dictionaries Aditi Chaudhary K. Raman Krishna Srinivasan Jiecao Chen 27 24 0 23 Oct 2020
Multilingual BERT Post-Pretraining Alignment Lin Pan Chung-Wei Hang Haode Qi Abhishek Shah Saloni Potdar Mo Yu 103 44 0 23 Oct 2020
Unsupervised Cross-lingual Adaptation for Sequence Tagging and Beyond Xin Li Lidong Bing Wenxuan Zhang Zheng Li Wai Lam 42 25 0 23 Oct 2020
A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarios Michael A. Hedderich Lukas Lange Heike Adel Jannik Strötgen Dietrich Klakow 194 286 0 23 Oct 2020
Towards Fully Bilingual Deep Language Modeling Li-Hsin Chang S. Pyysalo Jenna Kanerva Filip Ginter 18 3 0 22 Oct 2020
What makes multilingual BERT multilingual? Chi-Liang Liu Tsung-Yuan Hsu Yung-Sung Chuang Hung-yi Lee 31 6 0 20 Oct 2020
Looking for Clues of Language in Multilingual BERT to Improve Cross-lingual Generalization Chi-Liang Liu Tsung-Yuan Hsu Yung-Sung Chuang Chung-Yi Li Hung-yi Lee 20 3 0 20 Oct 2020
Cross-Lingual Transfer in Zero-Shot Cross-Language Entity Linking Elliot Schumacher J. Mayfield Mark Dredze 13 6 0 19 Oct 2020
The RELX Dataset and Matching the Multilingual Blanks for Cross-Lingual Relation Classification Abdullatif Köksal Arzucan Özgür 30 19 0 19 Oct 2020
Mixed-Lingual Pre-training for Cross-lingual Summarization Ruochen Xu Chenguang Zhu Yu Shi Michael Zeng Xuedong Huang 22 25 0 18 Oct 2020
TweetBERT: A Pretrained Language Representation Model for Twitter Text Analysis Mohiuddin Md Abdul Qudar Vijay K. Mago SSeg 15 35 0 17 Oct 2020
Cross-Lingual Relation Extraction with Transformers Jian Ni Taesun Moon Parul Awasthy Radu Florian ViT 15 6 0 16 Oct 2020
Delaying Interaction Layers in Transformer-based Encoders for Efficient Open Domain Question Answering W. Siblini Mohamed Challal Charlotte Pasqual 8 3 0 16 Oct 2020
It's not Greek to mBERT: Inducing Word-Level Translations from Multilingual BERT Hila Gonen Shauli Ravfogel Yanai Elazar Yoav Goldberg 18 50 0 16 Oct 2020
Explicit Alignment Objectives for Multilingual Bidirectional Encoders Junjie Hu Melvin Johnson Orhan Firat Aditya Siddhant Graham Neubig 18 56 0 15 Oct 2020
No Rumours Please! A Multi-Indic-Lingual Approach for COVID Fake-Tweet Detection Debanjana Kar M. Bhardwaj Suranjana Samanta A. Azad 23 65 0 14 Oct 2020
Pretrained Transformers for Text Ranking: BERT and Beyond Jimmy J. Lin Rodrigo Nogueira Andrew Yates VLM 219 608 0 13 Oct 2020
Modeling the Music Genre Perception across Language-Bound Cultures Elena V. Epure Guillaume Salha-Galvan Manuel Moussallam Romain Hennequin 14 5 0 13 Oct 2020
Model Selection for Cross-Lingual Transfer Yang Chen Alan Ritter 10 12 0 13 Oct 2020
Gradient Vaccine: Investigating and Improving Multi-task Optimization in Massively Multilingual Models Zirui Wang Yulia Tsvetkov Orhan Firat Yuan Cao 19 195 0 12 Oct 2020
Multilingual Offensive Language Identification with Cross-lingual Embeddings Tharindu Ranasinghe Marcos Zampieri 11 153 0 11 Oct 2020
Detecting Foodborne Illness Complaints in Multiple Languages Using English Annotations Only Ziyi Liu Giannis Karamanolakis Daniel J. Hsu Luis Gravano 6 1 0 11 Oct 2020
Structural Knowledge Distillation: Tractably Distilling Information for Structured Predictor Xinyu Wang Yong-jia Jiang Zhaohui Yan Zixia Jia Nguyen Bach Tao Wang Zhongqiang Huang Fei Huang Kewei Tu 26 10 0 10 Oct 2020
Automated Concatenation of Embeddings for Structured Prediction Xinyu Wang Yong-jia Jiang Nguyen Bach Tao Wang Zhongqiang Huang Fei Huang Kewei Tu 35 172 0 10 Oct 2020
Learning to Evaluate Translation Beyond English: BLEURT Submissions to the WMT Metrics 2020 Shared Task Thibault Sellam Amy Pu Hyung Won Chung Sebastian Gehrmann Qijun Tan Markus Freitag Dipanjan Das Ankur P. Parikh VLM 9 36 0 08 Oct 2020
Transfer Learning and Distant Supervision for Multilingual Transformer Models: A Study on African Languages Michael A. Hedderich David Ifeoluwa Adelani D. Zhu Jesujoba Oluwadara Alabi Udia Markus Dietrich Klakow 17 71 0 07 Oct 2020
On Negative Interference in Multilingual Models: Findings and A Meta-Learning Treatment Zirui Wang Zachary Chase Lipton Yulia Tsvetkov 18 31 0 06 Oct 2020
Cross-Lingual Text Classification with Minimal Resources by Transferring a Sparse Teacher Giannis Karamanolakis Daniel J. Hsu Luis Gravano VLM 20 17 0 06 Oct 2020
Participatory Research for Low-resourced Machine Translation: A Case Study in African Languages W. Nekoto Vukosi Marivate T. Matsila Timi E. Fasubaa T. Kolawole ... A. Olabiyi A. Ramkilowan A. Oktem Adewale Akinfaderin Abdallah Bashir 24 198 0 05 Oct 2020
Cross-Lingual Transfer Learning for Complex Word Identification George-Eduard Zaharia Dumitru-Clementin Cercel M. Dascalu 14 13 0 02 Oct 2020
Which *BERT? A Survey Organizing Contextualized Encoders Patrick Xia Shijie Wu Benjamin Van Durme 26 50 0 02 Oct 2020
STIL -- Simultaneous Slot Filling, Translation, Intent Classification, and Language Identification: Initial Results using mBART on MultiATIS++ Jack G. M. FitzGerald 14 13 0 02 Oct 2020
Evaluating Multilingual BERT for Estonian Claudia Kittask Kirill Milintsevich Kairit Sirts 14 6 0 01 Oct 2020
Cross-lingual Spoken Language Understanding with Regularized Representation Alignment Zihan Liu Genta Indra Winata Peng-Tao Xu Zhaojiang Lin Pascale Fung 10 14 0 30 Sep 2020
Parsing with Multilingual BERT, a Small Corpus, and a Small Treebank Ethan C. Chau Lucy H. Lin Noah A. Smith 19 15 0 29 Sep 2020
Deep Transformers with Latent Depth Xian Li Asa Cooper Stickland Yuqing Tang X. Kong 19 22 0 28 Sep 2020
What does it mean to be language-agnostic? Probing multilingual sentence encoders for typological properties Rochelle Choenni Ekaterina Shutova 12 37 0 27 Sep 2020
Preserving Integrity in Online Social Networks A. Halevy Cristian Canton Ferrer Hao Ma Umut Ozertem Patrick Pantel Marzieh Saeidi Fabrizio Silvestri Ves Stoyanov 17 57 0 22 Sep 2020
COMET: A Neural Framework for MT Evaluation Ricardo Rei Craig Alan Stewart Ana C. Farinha A. Lavie 6 1,026 0 18 Sep 2020
More Embeddings, Better Sequence Labelers? Xinyu Wang Yong-jia Jiang Nguyen Bach Tao Wang Zhongqiang Huang Fei Huang Kewei Tu 16 10 0 17 Sep 2020
Cascaded Models for Better Fine-Grained Named Entity Recognition Parul Awasthy Taesun Moon Jian Ni Radu Florian 11 2 0 15 Sep 2020
Improving Indonesian Text Classification Using Multilingual Language Model Ilham Firdausi Putra Ayu Purwarianti 6 7 0 12 Sep 2020