How multilingual is Multilingual BERT?

4 June 2019

Papers citing "How multilingual is Multilingual BERT?"

50 / 655 papers shown

Title
TiBERT: Tibetan Pre-trained Language Model Yuan Sun Sisi Liu Junjie Deng Xiaobing Zhao 59 9 0 15 May 2022
Domain Adaptation in Multilingual and Multi-Domain Monolingual Settings for Complex Word Identification George-Eduard Zaharia Razvan-Alexandru Smadu Dumitru-Clementin Cercel M. Dascalu 19 3 0 15 May 2022
Beyond Static Models and Test Sets: Benchmarking the Potential of Pre-trained Models Across Tasks and Languages Kabir Ahuja Sandipan Dandapat Sunayana Sitaram Monojit Choudhury LRM 39 16 0 12 May 2022
On the Economics of Multilingual Few-shot Learning: Modeling the Cost-Performance Trade-offs of Machine Translated and Manual Data Kabir Ahuja Monojit Choudhury Sandipan Dandapat 21 3 0 12 May 2022
Lifting the Curse of Multilinguality by Pre-training Modular Transformers Jonas Pfeiffer Naman Goyal Xi Victoria Lin Xian Li James Cross Sebastian Riedel Mikel Artetxe LRM 40 138 0 12 May 2022
Multi Task Learning For Zero Shot Performance Prediction of Multilingual Models Kabir Ahuja Shanu Kumar Sandipan Dandapat Monojit Choudhury 9 25 0 12 May 2022
A Balanced Data Approach for Evaluating Cross-Lingual Transfer: Mapping the Linguistic Blood Bank Daniel Malkin Tomasz Limisiewicz Gabriel Stanovsky 10 24 0 09 May 2022
Bridging the Domain Gap for Stance Detection for the Zulu language Gcinizwe Dlamini I. E. I. Bekkouch A. Khan Leon Derczynski 10 3 0 06 May 2022
Same Neurons, Different Languages: Probing Morphosyntax in Multilingual Pre-trained Models Karolina Stañczak E. Ponti Lucas Torroba Hennigen Ryan Cotterell Isabelle Augenstein MILM LRM 25 10 0 04 May 2022
Por Qué Não Utiliser Alla Språk? Mixed Training with Gradient Optimization in Few-Shot Cross-Lingual Transfer Haoran Xu Kenton W. Murray 24 12 0 29 Apr 2022
Translation between Molecules and Natural Language Carl N. Edwards T. Lai Kevin Ros Garrett Honke Kyunghyun Cho Heng Ji 25 155 0 25 Apr 2022
Cross-Lingual Query-Based Summarization of Crisis-Related Social Media: An Abstractive Approach Using Transformers Fedor Vitiugin Carlos Castillo 16 12 0 21 Apr 2022
You Are What You Write: Preserving Privacy in the Era of Large Language Models Richard Plant V. Giuffrida Dimitra Gkatzia PILM 17 19 0 20 Apr 2022
Analyzing Gender Representation in Multilingual Models Hila Gonen Shauli Ravfogel Yoav Goldberg 15 11 0 20 Apr 2022
ALBETO and DistilBETO: Lightweight Spanish Language Models J. Canete S. Donoso Felipe Bravo-Marquez Andrés Carvallo Vladimir Araujo 40 20 0 19 Apr 2022
IndicXNLI: Evaluating Multilingual Inference for Indian Languages Divyanshu Aggarwal V. Gupta Anoop Kunchukuttan 23 27 0 19 Apr 2022
Mono vs Multilingual BERT for Hate Speech Detection and Text Classification: A Case Study in Marathi Abhishek Velankar H. Patil Raviraj Joshi 28 31 0 19 Apr 2022
MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languages Jack G. M. FitzGerald C. Hench Charith Peris Scott Mackie Kay Rottmann ... Laurie Crist Misha Britan Wouter Leeuwis Gökhan Tür Premkumar Natarajan 6 126 0 18 Apr 2022
L3Cube-HingCorpus and HingBERT: A Code Mixed Hindi-English Dataset and BERT Language Models Ravindra Nayak Raviraj Joshi 18 39 0 18 Apr 2022
AfriWOZ: Corpus for Exploiting Cross-Lingual Transferability for Generation of Dialogues in Low-Resource, African Languages Tosin P. Adewumi Mofetoluwa Adeyemi Aremu Anuoluwapo Bukola Peters Happy Buzaaba ... Phylis Ngigi Orevaoghene Ahia Ruqayya Nasir F. Liwicki Marcus Liwicki 13 1 0 17 Apr 2022
mGPT: Few-Shot Learners Go Multilingual Oleh Shliazhko Alena Fenogenova Maria Tikhonova Vladislav Mikhailov Anastasia Kozlova Tatiana Shavrina 40 148 0 15 Apr 2022
The Impact of Cross-Lingual Adjustment of Contextual Word Representations on Zero-Shot Transfer Pavel Efimov Leonid Boytsov E. Arslanova Pavel Braslavski 22 7 0 13 Apr 2022
IIITDWD-ShankarB@ Dravidian-CodeMixi-HASOC2021: mBERT based model for identification of offensive content in south Indian languages Shankar Biradar Sunil Saumya 17 10 0 13 Apr 2022
L3Cube-MahaNER: A Marathi Named Entity Recognition Dataset and BERT models Parth Patil Aparna Ranade Maithili Sabane Onkar Litake Raviraj Joshi 30 20 0 12 Apr 2022
Bridging the Gap between Language Models and Cross-Lingual Sequence Labeling Nuo Chen Linjun Shou Ming Gong Jian Pei Daxin Jiang 19 10 0 11 Apr 2022
A Comparative Study of Pre-trained Encoders for Low-Resource Named Entity Recognition Yuxuan Chen Jonas Mikkelsen Arne Binder Christoph Alt Leonhard Hennig 19 2 0 11 Apr 2022
Few-Shot Cross-lingual Transfer for Coarse-grained De-identification of Code-Mixed Clinical Texts Saadullah Amin N. Goldstein M. Wixted Alejandro García-Rudolph Catalina Martínez-Costa G. Neumann 17 5 0 10 Apr 2022
Marvelous Agglutinative Language Effect on Cross Lingual Transfer Learning Wooyoung Kim Chaerin Jo Minjung Kim Wooju Kim 19 1 0 08 Apr 2022
BERTuit: Understanding Spanish language in Twitter through a native transformer Javier Huertas-Tato Alejandro Martín David Camacho 18 9 0 07 Apr 2022
Towards Best Practices for Training Multilingual Dense Retrieval Models Xinyu Crystina Zhang Kelechi Ogueji Xueguang Ma Jimmy J. Lin RALM 24 34 0 05 Apr 2022
On Efficiently Acquiring Annotations for Multilingual Models Joel Ruben Antony Moniz Barun Patra Matthew R. Gormley 31 7 0 03 Apr 2022
Metaphors in Pre-Trained Language Models: Probing and Generalization Across Datasets and Languages Ehsan Aghazadeh Mohsen Fayyaz Yadollah Yaghoobzadeh 33 51 0 26 Mar 2022
Match the Script, Adapt if Multilingual: Analyzing the Effect of Multilingual Pretraining on Cross-lingual Transferability Yoshinari Fujinuma Jordan L. Boyd-Graber Katharina Kann AAML 51 23 0 21 Mar 2022
Pretraining with Artificial Language: Studying Transferable Knowledge in Language Models Ryokan Ri Yoshimasa Tsuruoka 21 25 0 19 Mar 2022
Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation Xinyi Wang Sebastian Ruder Graham Neubig 21 60 0 17 Mar 2022
Pre-Trained Multilingual Sequence-to-Sequence Models: A Hope for Low-Resource Language Translation? E. Lee Sarubi Thillainathan Shravan Nayak Surangika Ranathunga David Ifeoluwa Adelani Ruisi Su Arya D. McCarthy VLM 21 43 0 16 Mar 2022
Zero-Shot Dependency Parsing with Worst-Case Aware Automated Curriculum Learning Miryam de Lhoneux Shenmin Zhang Anders Søgaard 33 11 0 16 Mar 2022
Cross-Lingual Ability of Multilingual Masked Language Models: A Study of Language Structure Yuan Chai Yaobo Liang Nan Duan LRM 27 21 0 16 Mar 2022
Does Corpus Quality Really Matter for Low-Resource Languages? Mikel Artetxe Itziar Aldabe Rodrigo Agerri Olatz Perez-de-Viñaspre Aitor Soroa Etxabe 41 19 0 15 Mar 2022
A new approach to calculating BERTScore for automatic assessment of translation quality A. Vetrov E. Gorn 14 1 0 10 Mar 2022
A Survey on Aspect-Based Sentiment Analysis: Tasks, Methods, and Challenges Wenxuan Zhang Xin Li Yang Deng Lidong Bing W. Lam 35 241 0 02 Mar 2022
Multilingual Abusiveness Identification on Code-Mixed Social Media Text Ekagra Ranjan Naman Poddar 24 0 0 01 Mar 2022
Cross-Lingual Text Classification with Multilingual Distillation and Zero-Shot-Aware Training Ziqing Yang Yiming Cui Zhigang Chen Shijin Wang VLM 19 3 0 28 Feb 2022
Semi-Structured Query Grounding for Document-Oriented Databases with Deep Retrieval and Its Application to Receipt and POI Matching Geewook Kim Wonseok Hwang Minjoon Seo Seunghyun Park 18 0 0 23 Feb 2022
Delving Deeper into Cross-lingual Visual Question Answering Chen Cecilia Liu Jonas Pfeiffer Anna Korhonen Ivan Vulić Iryna Gurevych 26 8 0 15 Feb 2022
Wukong: A 100 Million Large-scale Chinese Cross-modal Pre-training Benchmark Jiaxi Gu Xiaojun Meng Guansong Lu Lu Hou Minzhe Niu ... Runhu Huang Wei Zhang Xingda Jiang Chunjing Xu Hang Xu VLM 35 87 0 14 Feb 2022
Toward a traceable, explainable, and fairJD/Resume recommendation system Amine Barrak Bram Adams Amal Zouaq 11 2 0 02 Feb 2022
L3Cube-MahaCorpus and MahaBERT: Marathi Monolingual Corpus, Marathi BERT Language Models, and Resources Raviraj Joshi 41 52 0 02 Feb 2022
Constrained Density Matching and Modeling for Cross-lingual Alignment of Contextualized Representations Wei-Ye Zhao Steffen Eger 21 1 0 31 Jan 2022
Does Transliteration Help Multilingual Language Modeling? Ibraheem Muhammad Moosa Mahmud Elahi Akhter Ashfia Binte Habib 40 11 0 29 Jan 2022