How multilingual is Multilingual BERT?

4 June 2019

Papers citing "How multilingual is Multilingual BERT?"

50 / 655 papers shown

Title
What's so special about BERT's layers? A closer look at the NLP pipeline in monolingual and multilingual models Wietse de Vries Andreas van Cranenburgh Malvina Nissim MILM SSeg MoE 11 64 0 14 Apr 2020
LAReQA: Language-agnostic answer retrieval from a multilingual pool Uma Roy Noah Constant Rami Al-Rfou Aditya Barua Aaron B. Phillips Yinfei Yang RALM 14 55 0 11 Apr 2020
A New Dataset for Natural Language Inference from Code-mixed Conversations Simran Khanuja Sandipan Dandapat Sunayana Sitaram Monojit Choudhury 27 40 0 10 Apr 2020
On the Language Neutrality of Pre-trained Multilingual Representations Jindrich Libovický Rudolf Rosa Alexander M. Fraser 17 99 0 09 Apr 2020
Learning to Scale Multilingual Representations for Vision-Language Tasks Andrea Burns Donghyun Kim Derry Wijaya Kate Saenko Bryan A. Plummer 13 35 0 09 Apr 2020
Structure-Level Knowledge Distillation For Multilingual Sequence Labeling Xinyu Wang Yong-jia Jiang Nguyen Bach Tao Wang Fei Huang Kewei Tu 26 36 0 08 Apr 2020
Dynamic Data Selection and Weighting for Iterative Back-Translation Zi-Yi Dou Antonios Anastasopoulos Graham Neubig 8 50 0 07 Apr 2020
Machine Translation Pre-training for Data-to-Text Generation -- A Case Study in Czech Mihir Kale Scott Roy 6 14 0 05 Apr 2020
Give your Text Representation Models some Love: the Case for Basque Rodrigo Agerri Iñaki San Vicente Jon Ander Campos Ander Barrena X. Saralegi Aitor Soroa Etxabe Eneko Agirre 12 61 0 31 Mar 2020
Understanding Cross-Lingual Syntactic Transfer in Multilingual Recurrent Neural Networks Prajit Dhar Arianna Bisazza 4 10 0 31 Mar 2020
BERT Fine-tuning For Arabic Text Summarization Khalid N. Elmadani Mukhtar Elgezouli Anas Showk 6 22 0 29 Mar 2020
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization Junjie Hu Sebastian Ruder Aditya Siddhant Graham Neubig Orhan Firat Melvin Johnson ELM 51 955 0 24 Mar 2020
Data-driven models and computational tools for neurolinguistics: a language technology perspective Ekaterina Artemova Amir Bakarov A. Artemov E. Burnaev M. Sharaev 15 4 0 23 Mar 2020
Probing Word Translations in the Transformer and Trading Decoder for Encoder Layers Hongfei Xu Josef van Genabith Qiuhui Liu Deyi Xiong 15 3 0 21 Mar 2020
The value of text for small business default prediction: A deep learning approach Matthew Stevenson Christophe Mues Cristián Bravo 45 76 0 19 Mar 2020
X-Stance: A Multilingual Multi-Target Dataset for Stance Detection Jannis Vamvas Rico Sennrich 14 83 0 18 Mar 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 243 1,450 0 18 Mar 2020
XPersona: Evaluating Multilingual Personalized Chatbot Zhaojiang Lin Zihan Liu Genta Indra Winata Samuel Cahyawijaya Andrea Madotto Yejin Bang Etsuko Ishii Pascale Fung 40 57 0 17 Mar 2020
Multi-SimLex: A Large-Scale Evaluation of Multilingual and Cross-Lingual Lexical Semantic Similarity Ivan Vulić Simon Baker E. Ponti Ulla Petti Ira Leviant ... Eden Bar Matt Malone Thierry Poibeau Roi Reichart Anna Korhonen 14 81 0 10 Mar 2020
What the [MASK]? Making Sense of Language-Specific BERT Models Debora Nozza Federico Bianchi Dirk Hovy 84 105 0 05 Mar 2020
A Primer in BERTology: What we know about how BERT works Anna Rogers Olga Kovaleva Anna Rumshisky OffRL 30 1,455 0 27 Feb 2020
Language-Independent Tokenisation Rivals Language-Specific Tokenisation for Word Similarity Prediction Danushka Bollegala Ryuichi Kiryo K. Tsujino Haruki Yukawa 6 7 0 25 Feb 2020
What BERT Sees: Cross-Modal Transfer for Visual Question Generation Thomas Scialom Patrick Bordes Paul-Alexis Dray Jacopo Staiano Patrick Gallinari 23 6 0 25 Feb 2020
Contextual Lensing of Universal Sentence Representations J. Kiros 8 5 0 20 Feb 2020
CodeBERT: A Pre-Trained Model for Programming and Natural Languages Zhangyin Feng Daya Guo Duyu Tang Nan Duan Xiaocheng Feng ... Linjun Shou Bing Qin Ting Liu Daxin Jiang Ming Zhou 45 2,532 0 19 Feb 2020
Multilingual Alignment of Contextual Word Representations Steven Cao Nikita Kitaev Dan Klein 16 191 0 10 Feb 2020
Parameter Space Factorization for Zero-Shot Learning across Tasks and Languages E. Ponti Ivan Vulić Ryan Cotterell Marinela Parović Roi Reichart Anna Korhonen BDL 21 29 0 30 Jan 2020
On the Importance of Word Order Information in Cross-lingual Sequence Labeling Zihan Liu Genta Indra Winata Samuel Cahyawijaya Andrea Madotto Zhaojiang Lin Pascale Fung 14 3 0 30 Jan 2020
Multilingual Denoising Pre-training for Neural Machine Translation Yinhan Liu Jiatao Gu Naman Goyal Xian Li Sergey Edunov Marjan Ghazvininejad M. Lewis Luke Zettlemoyer AI4CE AIMat 17 1,768 0 22 Jan 2020
Contextualized Embeddings in Named-Entity Recognition: An Empirical Study on Generalization Bruno Taillé Vincent Guigue Patrick Gallinari 23 25 0 22 Jan 2020
RobBERT: a Dutch RoBERTa-based Language Model Pieter Delobelle Thomas Winters Bettina Berendt 10 232 0 17 Jan 2020
A Comprehensive Survey of Multilingual Neural Machine Translation Raj Dabre Chenhui Chu Anoop Kunchukuttan LRM 28 33 0 04 Jan 2020
SberQuAD -- Russian Reading Comprehension Dataset: Description and Analysis Pavel Efimov Andrey Chertok Leonid Boytsov Pavel Braslavski 58 59 0 20 Dec 2019
Cross-Lingual Ability of Multilingual BERT: An Empirical Study Karthikeyan K Zihan Wang Stephen D. Mayhew Dan Roth LRM 25 334 0 17 Dec 2019
Multilingual is not enough: BERT for Finnish Antti Virtanen Jenna Kanerva Rami Ilo Jouni Luoma Juhani Luotolahti T. Salakoski Filip Ginter S. Pyysalo 17 277 0 15 Dec 2019
Cross-lingual Pre-training Based Transfer for Zero-shot Neural Machine Translation Baijun Ji Zhirui Zhang Xiangyu Duan Min Zhang Boxing Chen Weihua Luo 37 67 0 03 Dec 2019
Towards Lingua Franca Named Entity Recognition with BERT Taesun Moon Parul Awasthy Jian Ni Radu Florian 9 29 0 19 Nov 2019
Can Monolingual Pretrained Models Help Cross-Lingual Classification? Zewen Chi Li Dong Furu Wei Xian-Ling Mao Heyan Huang LRM VLM 20 13 0 10 Nov 2019
CamemBERT: a Tasty French Language Model Louis Martin Benjamin Muller Pedro Ortiz Suarez Yoann Dupont Laurent Romary Eric Villemonte de la Clergerie Djamé Seddah Benoît Sagot 16 956 0 10 Nov 2019
How Language-Neutral is Multilingual BERT? Jindrich Libovický Rudolf Rosa Alexander M. Fraser 8 114 0 08 Nov 2019
Probing Contextualized Sentence Representations with Visual Awareness Zhuosheng Zhang Rui Wang Kehai Chen Masao Utiyama Eiichiro Sumita Hai Zhao 6 2 0 07 Nov 2019
Unsupervised Cross-lingual Representation Learning at Scale Alexis Conneau Kartikay Khandelwal Naman Goyal Vishrav Chaudhary Guillaume Wenzek Francisco Guzmán Edouard Grave Myle Ott Luke Zettlemoyer Veselin Stoyanov 6 6,356 0 05 Nov 2019
On the Cross-lingual Transferability of Monolingual Representations Mikel Artetxe Sebastian Ruder Dani Yogatama 28 771 0 25 Oct 2019
Zero-shot Dependency Parsing with Pre-trained Multilingual Sentence Representations Ke M. Tran Arianna Bisazza 17 28 0 12 Oct 2019
Cross-lingual Alignment vs Joint Training: A Comparative Study and A Simple Unified Framework Zirui Wang Jiateng Xie Ruochen Xu Yiming Yang Graham Neubig J. Carbonell 8 77 0 10 Oct 2019
Multilingual Question Answering from Formatted Text applied to Conversational Agents W. Siblini Charlotte Pasqual Axel Lavielle Mohamed Challal Cyril Cauchois 12 17 0 10 Oct 2019
Language Transfer for Early Warning of Epidemics from Social Media Mattias Appelgren Patrick Schrempf Matús Falis Satoshi Ikeda Alison Q. OÑeil 17 1 0 10 Oct 2019
Is Multilingual BERT Fluent in Language Generation? Samuel Rönnqvist Jenna Kanerva T. Salakoski Filip Ginter 11 71 0 09 Oct 2019
Low-Resource Parsing with Crosslingual Contextualized Representations Phoebe Mulcaire Jungo Kasai Noah A. Smith 11 19 0 19 Sep 2019
Cross-Lingual BERT Transformation for Zero-Shot Dependency Parsing Yuxuan Wang Wanxiang Che Jiang Guo Yijia Liu Ting Liu 11 118 0 15 Sep 2019