How multilingual is Multilingual BERT?

4 June 2019

Papers citing "How multilingual is Multilingual BERT?"

50 / 655 papers shown

Title
The Impact of Positional Encodings on Multilingual Compression Vinit Ravishankar Anders Søgaard 17 5 0 11 Sep 2021
We went to look for meaning and all we got were these lousy representations: aspects of meaning representation for computational semantics Simon Dobnik R. Cooper Adam Ek Bill Noble Staffan Larsson N. Ilinykh Vladislav Maraev Vidya Somashekarappa 14 0 0 10 Sep 2021
Examining Cross-lingual Contextual Embeddings with Orthogonal Structural Probes Tomasz Limisiewicz David Marevcek 11 3 0 10 Sep 2021
Subword Mapping and Anchoring across Languages Giorgos Vernikos Andrei Popescu-Belis 62 12 0 09 Sep 2021
Filling the Gaps in Ancient Akkadian Texts: A Masked Language Modelling Approach Koren Lazar Benny Saret Asaf Yehudai W. Horowitz N. Wasserman Gabriel Stanovsky 25 23 0 09 Sep 2021
Distributionally Robust Multilingual Machine Translation Chunting Zhou Daniel Levy Xian Li Marjan Ghazvininejad Graham Neubig 73 24 0 09 Sep 2021
Discrete and Soft Prompting for Multilingual Models Mengjie Zhao Hinrich Schütze LRM 10 71 0 08 Sep 2021
Mixed Attention Transformer for Leveraging Word-Level Knowledge to Neural Cross-Lingual Information Retrieval Zhiqi Huang Hamed Bonab Sheikh Muhammad Sarwar Razieh Rahimi James Allan 32 10 0 07 Sep 2021
Nearest Neighbour Few-Shot Learning for Cross-lingual Classification M Saiful Bari Batool Haider Saab Mansour VLM 11 13 0 06 Sep 2021
Discovering Representation Sprachbund For Multilingual Pre-Training Yiming Fan Yaobo Liang Alexandre Muzio Hany Hassan Houqiang Li Ming Zhou Nan Duan 20 9 0 01 Sep 2021
Cross-Lingual Text Classification of Transliterated Hindi and Malayalam Jitin Krishnan Antonios Anastasopoulos Hemant Purohit Huzefa Rangwala 11 15 0 31 Aug 2021
Transfer Learning for Multi-lingual Tasks -- a Survey A. Jafari Behnam Heidary R. Farahbakhsh Mostafa Salehi Mahdi Jalili LRM 21 5 0 28 Aug 2021
UzBERT: pretraining a BERT model for Uzbek B. Mansurov A. Mansurov VLM 10 13 0 22 Aug 2021
Not All Linearizations Are Equally Data-Hungry in Sequence Labeling Parsing Alberto Muñoz-Ortiz Michalina Strzyz David Vilares 19 8 0 17 Aug 2021
Embodied BERT: A Transformer Model for Embodied, Language-guided Visual Task Completion Alessandro Suglia Qiaozi Gao Jesse Thomason Govind Thattai Gaurav Sukhatme LM&Ro 14 76 0 10 Aug 2021
Hope Speech detection in under-resourced Kannada language Adeep Hande R. Priyadharshini Anbukkarasi Sampath K. Thamburaj Prabakaran Chandran Bharathi Raja Chakravarthi 8 28 0 10 Aug 2021
Do Images really do the Talking? Analysing the significance of Images in Tamil Troll meme classification Siddhanth U Hegde Adeep Hande R. Priyadharshini Sajeetha Thavareesan Ratnasingam Sakuntharaj S. Thangasamy B. Bharathi Bharathi Raja Chakravarthi 34 7 0 09 Aug 2021
PARADISE: Exploiting Parallel Data for Multilingual Sequence-to-Sequence Pretraining Machel Reid Mikel Artetxe VLM 42 26 0 04 Aug 2021
Transfer Learning for Mining Feature Requests and Bug Reports from Tweets and App Store Reviews Pablo Restrepo Henao Jannik Fischbach Dominik Spies Julian Frattini Andreas Vogelsang 11 25 0 02 Aug 2021
The Effectiveness of Intermediate-Task Training for Code-Switched Natural Language Understanding Archiki Prasad Mohammad Ali Rehan Shreyasi Pathak P. Jyothi 19 9 0 21 Jul 2021
From Machine Translation to Code-Switching: Generating High-Quality Code-Switched Text Ishan Tarunesh Syamantak Kumar P. Jyothi 36 45 0 14 Jul 2021
A Primer on Pretrained Multilingual Language Models Sumanth Doddapaneni Gowtham Ramesh Mitesh M. Khapra Anoop Kunchukuttan Pratyush Kumar LRM 43 73 0 01 Jul 2021
Revisiting the Primacy of English in Zero-shot Cross-lingual Transfer Iulia Turc Kenton Lee Jacob Eisenstein Ming-Wei Chang Kristina Toutanova 24 58 0 30 Jun 2021
It's All in the Heads: Using Attention Heads as a Baseline for Cross-Lingual Transfer in Commonsense Reasoning Alexey Tikhonov Max Ryabinin LRM 13 57 0 22 Jun 2021
Phrase-level Active Learning for Neural Machine Translation Junjie Hu Graham Neubig AI4CE 24 13 0 21 Jun 2021
Specializing Multilingual Language Models: An Empirical Study Ethan C. Chau Noah A. Smith 25 27 0 16 Jun 2021
Pre-Trained Models: Past, Present and Future Xu Han Zhengyan Zhang Ning Ding Yuxian Gu Xiao Liu ... Jie Tang Ji-Rong Wen Jinhui Yuan Wayne Xin Zhao Jun Zhu AIFin MQ AI4MH 37 813 0 14 Jun 2021
Assessing Multilingual Fairness in Pre-trained Multimodal Representations Jialu Wang Yang Liu X. Wang EGVM 21 35 0 12 Jun 2021
CodemixedNLP: An Extensible and Open NLP Toolkit for Code-Mixing Sai Muralidhar Jayanthi Kavya Nerella Khyathi Raghavi Chandu A. Black MoE 23 8 0 10 Jun 2021
AMU-EURANOVA at CASE 2021 Task 1: Assessing the stability of multilingual BERT Léo Bouscarrat Antoine Bonnefoy Cécile Capponi Carlos Ramisch 9 3 0 10 Jun 2021
Crosslingual Embeddings are Essential in UNMT for Distant Languages: An English to IndoAryan Case Study Tamali Banerjee V. Rudra Murthy P. Bhattacharyya 24 9 0 09 Jun 2021
Probing Multilingual Language Models for Discourse Murathan Kurfali Robert Östling 25 17 0 09 Jun 2021
Investigating Transfer Learning in Multilingual Pre-trained Language Models through Chinese Natural Language Inference Hai Hu He Zhou Zuoyu Tian Yiwen Zhang Yina Ma Yanting Li Yixin Nie Kyle Richardson 19 11 0 07 Jun 2021
Exploiting Language Relatedness for Low Web-Resource Language Model Adaptation: An Indic Languages Study Yash Khemchandani Sarvesh Mehtani Vaidehi Patil Abhijeet Awasthi Partha P. Talukdar Sunita Sarawagi 19 32 0 07 Jun 2021
MergeDistill: Merging Pre-trained Language Models using Distillation Simran Khanuja Melvin Johnson Partha P. Talukdar 27 16 0 05 Jun 2021
Syntax-augmented Multilingual BERT for Cross-lingual Transfer Wasi Uddin Ahmad Haoran Li Kai-Wei Chang Yashar Mehdad 39 34 0 03 Jun 2021
How to Adapt Your Pretrained Multilingual Model to 1600 Languages Abteen Ebrahimi Katharina Kann LRM VLM 25 67 0 03 Jun 2021
Language Embeddings for Typology and Cross-lingual Transfer Learning Dian Yu Taiqi He Kenji Sagae 19 12 0 03 Jun 2021
HIT: A Hierarchically Fused Deep Attention Network for Robust Code-mixed Language Representation Ayan Sengupta S. Bhattacharjee Tanmoy Chakraborty Md. Shad Akhtar 14 12 0 30 May 2021
A Simple Voting Mechanism for Online Sexist Content Identification Chao Feng 6 1 0 29 May 2021
Deception detection in text and its relation to the cultural dimension of individualism/collectivism Katerina Papantoniou P. Papadakos T. Patkos G. Flouris Ion Androutsopoulos Dimitris Plexousakis 38 7 0 26 May 2021
Unsupervised Multilingual Sentence Embeddings for Parallel Corpus Mining Ivana Kvapilíková Mikel Artetxe Gorka Labaka Eneko Agirre Ondrej Bojar SSL 11 36 0 21 May 2021
A cost-benefit analysis of cross-lingual transfer methods G. Rosa L. Bonifacio Leandro Rodrigues de Souza R. Lotufo Rodrigo Nogueira 19 12 0 14 May 2021
Multilingual Offensive Language Identification for Low-resource Languages Tharindu Ranasinghe Marcos Zampieri 22 64 0 12 May 2021
Analysing The Impact Of Linguistic Features On Cross-Lingual Transfer B. Dolički Gerasimos Spanakis 13 16 0 12 May 2021
How Reliable are Model Diagnostics? V. Aribandi Yi Tay Donald Metzler 19 19 0 12 May 2021
Priberam Labs at the NTCIR-15 SHINRA2020-ML: Classification Task Rúben Cardoso Afonso Mendes Andre Lamurias 11 2 0 12 May 2021
Graph-based Multilingual Product Retrieval in E-commerce Search Hanqing Lu You-Heng Hu Tong Zhao Tony Wu Yiwei Song Bing Yin 6 25 0 06 May 2021
Adapting Monolingual Models: Data can be Scarce when Language Similarity is High Wietse de Vries Martijn Bartelds Malvina Nissim Martijn B. Wieling 21 22 0 06 May 2021
Rethinking Search: Making Domain Experts out of Dilettantes Donald Metzler Yi Tay Dara Bahri Marc Najork LRM 28 46 0 05 May 2021