How multilingual is Multilingual BERT?

4 June 2019

Papers citing "How multilingual is Multilingual BERT?"

50 / 655 papers shown

Title
Systematic Investigation of Strategies Tailored for Low-Resource Settings for Low-Resource Dependency Parsing Jivnesh Sandhan Laxmidhar Behera Pawan Goyal 22 0 0 27 Jan 2022
CsFEVER and CTKFacts: Acquiring Czech data for fact verification Herbert Ullrich Jan Drchal Martin Rýpar Hana Vincourová Václav Moravec HILM 19 9 0 26 Jan 2022
Transferability in Deep Learning: A Survey Junguang Jiang Yang Shu Jianmin Wang Mingsheng Long OOD 31 101 0 15 Jan 2022
A Warm Start and a Clean Crawled Corpus -- A Recipe for Good Language Models Vésteinn Snæbjarnarson Haukur Barri Símonarson Pétur Orri Ragnarsson Svanhvít Lilja Ingólfsdóttir H. Jónsson Vilhjálmur Þorsteinsson H. Einarsson 16 26 0 14 Jan 2022
The Dark Side of the Language: Pre-trained Transformers in the DarkNet Leonardo Ranaldi Aria Nourbakhsh Arianna Patrizi Elena Sofia Ruzzetti Dario Onorati Francesca Fallucchi Fabio Massimo Zanzotto VLM 11 19 0 14 Jan 2022
Pretrained Language Models for Text Generation: A Survey Junyi Li Tianyi Tang Wayne Xin Zhao J. Nie Ji-Rong Wen AI4CE 36 125 0 14 Jan 2022
QEMind: Alibaba's Submission to the WMT21 Quality Estimation Shared Task Jiayi Wang Ke Min Wang Boxing Chen Yu Zhao Weihua Luo Yuqi Zhang 59 13 0 30 Dec 2021
Do Multi-Lingual Pre-trained Language Models Reveal Consistent Token Attributions in Different Languages? Junxiang Wang Xuchao Zhang Bo Zong Yanchi Liu Wei Cheng Jingchao Ni Haifeng Chen Liang Zhao AAML 22 0 0 23 Dec 2021
On Cross-Lingual Retrieval with Multilingual Text Encoders Robert Litschko Ivan Vulić Simone Paolo Ponzetto Goran Glavavs 11 38 0 21 Dec 2021
Few-shot Learning with Multilingual Language Models Xi Victoria Lin Todor Mihaylov Mikel Artetxe Tianlu Wang Shuohui Chen ... Luke Zettlemoyer Zornitsa Kozareva Mona T. Diab Ves Stoyanov Xian Li BDL ELM LRM 64 284 0 20 Dec 2021
Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLP Sabrina J. Mielke Zaid Alyafeai Elizabeth Salesky Colin Raffel Manan Dey ... Arun Raja Chenglei Si Wilson Y. Lee Benoît Sagot Samson Tan 30 140 0 20 Dec 2021
Cascading Adaptors to Leverage English Data to Improve Performance of Question Answering for Low-Resource Languages Hariom A. Pandya Bhavik Ardeshna Brijesh S. Bhatt 16 6 0 18 Dec 2021
Harnessing Cross-lingual Features to Improve Cognate Detection for Low-resource Languages Diptesh Kanojia Raj Dabre Shubham Dewangan P. Bhattacharyya Gholamreza Haffari Malhar A. Kulkarni 10 5 0 16 Dec 2021
WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models Benjamin Minixhofer Fabian Paischer Navid Rekabsaz 22 72 0 13 Dec 2021
From Good to Best: Two-Stage Training for Cross-lingual Machine Reading Comprehension Nuo Chen Linjun Shou Ming Gong Jian Pei Daxin Jiang 24 16 0 09 Dec 2021
JABER and SABER: Junior and Senior Arabic BERt Abbas Ghaddar Yimeng Wu Ahmad Rashid Khalil Bibi Mehdi Rezagholizadeh ... Zhefeng Wang Baoxing Huai Xin Jiang Qun Liu Philippe Langlais 16 5 0 08 Dec 2021
DPRK-BERT: The Supreme Language Model Arda Akdemir Yeojoo Jeon OffRL 9 1 0 01 Dec 2021
Tapping BERT for Preposition Sense Disambiguation Siddhesh Pawar S. Thombre Anirudh Mittal Girishkumar Ponkiya P. Bhattacharyya 12 2 0 27 Nov 2021
TunBERT: Pretrained Contextualized Text Representation for Tunisian Dialect Abir Messaoudi Ahmed Cheikhrouhou Hatem Haddad Nourchene Ferchichi Moez BenHajhmida Abir Korched Malek Naski Faten Ghriss Amine Kerkeni 11 8 0 25 Nov 2021
IIITT@Dravidian-CodeMix-FIRE2021: Transliterate or translate? Sentiment analysis of code-mixed text in Dravidian languages Karthik Puranik B. Bharathi Senthil Kumar B 27 7 0 15 Nov 2021
Deep Learning Transformer Architecture for Named Entity Recognition on Low Resourced Languages: State of the art results Ridewaan Hanslo 9 11 0 01 Nov 2021
AdvCodeMix: Adversarial Attack on Code-Mixed Data Sourya Dipta Das Ayan Basak Soumil Mandal Dipankar Das AAML 9 3 0 30 Oct 2021
When is BERT Multilingual? Isolating Crucial Ingredients for Cross-lingual Transfer A. Deshpande Partha P. Talukdar Karthik Narasimhan 19 38 0 27 Oct 2021
Can Character-based Language Models Improve Downstream Task Performance in Low-Resource and Noisy Language Scenarios? Arij Riabi Benoît Sagot Djamé Seddah 26 15 0 26 Oct 2021
Improved Multilingual Language Model Pretraining for Social Media Text via Translation Pair Prediction Shubhanshu Mishra A. Haghighi VLM 18 4 0 20 Oct 2021
Multilingual Domain Adaptation for NMT: Decoupling Language and Domain Information with Adapters Asa Cooper Stickland Alexandre Berard Vassilina Nikoulina AI4CE 11 28 0 18 Oct 2021
A Data Bootstrapping Recipe for Low Resource Multilingual Relation Classification Arijit Nag Bidisha Samanta Animesh Mukherjee Niloy Ganguly Soumen Chakrabarti 19 13 0 18 Oct 2021
Ceasing hate withMoH: Hate Speech Detection in Hindi-English Code-Switched Language Arushi Sharma Anubha Kabra Minni Jain 21 52 0 18 Oct 2021
Contextual Hate Speech Detection in Code Mixed Text using Transformer Based Approaches Ravindra Nayak Raviraj Joshi 21 19 0 18 Oct 2021
Predicting the Performance of Multilingual NLP Models A. Srinivasan Sunayana Sitaram T. Ganu Sandipan Dandapat Kalika Bali Monojit Choudhury LRM 30 27 0 17 Oct 2021
Substructure Distribution Projection for Zero-Shot Cross-Lingual Dependency Parsing Freda Shi Kevin Gimpel Karen Livescu 145 7 0 16 Oct 2021
Cross-Lingual Fine-Grained Entity Typing N. Selvaraj Yasumasa Onoe Greg Durrett 6 2 0 15 Oct 2021
Cross-Lingual Open-Domain Question Answering with Answer Sentence Generation Benjamin Muller Luca Soldaini Rik Koncel-Kedziorski Eric Lind Alessandro Moschitti LRM 16 7 0 14 Oct 2021
Learning Compact Metrics for MT Amy Pu Hyung Won Chung Ankur P. Parikh Sebastian Gehrmann Thibault Sellam 22 98 0 12 Oct 2021
Småprat: DialoGPT for Natural Language Generation of Swedish Dialogue by Transfer Learning Tosin P. Adewumi Rickard Brannvall Nosheen Abid M. Pahlavan Sana Sabah Sabry F. Liwicki Marcus Liwicki 12 21 0 12 Oct 2021
An Isotropy Analysis in the Multilingual BERT Embedding Space S. Rajaee Mohammad Taher Pilehvar 16 32 0 09 Oct 2021
Multilingual Counter Narrative Type Classification Yi-Ling Chung Marco Guerini Rodrigo Agerri 93 15 0 28 Sep 2021
Exploring Teacher-Student Learning Approach for Multi-lingual Speech-to-Intent Classification Bidisha Sharma Maulik C. Madhavi Xuehao Zhou Haizhou Li 15 2 0 28 Sep 2021
Rumour Detection via Zero-shot Cross-lingual Transfer Learning Lin Tian Xiuzhen Zhang Jey Han Lau 44 13 0 27 Sep 2021
On the Prunability of Attention Heads in Multilingual BERT Aakriti Budhraja Madhura Pande Pratyush Kumar Mitesh M. Khapra 42 4 0 26 Sep 2021
Cross-Lingual Language Model Meta-Pretraining Zewen Chi Heyan Huang Luyang Liu Yu Bai Xian-Ling Mao LRM 68 0 0 23 Sep 2021
Role of Language Relatedness in Multilingual Fine-tuning of Language Models: A Case Study in Indo-Aryan Languages Tejas I. Dhamecha V. Rudramurthy Samarth Bharadwaj Karthik Sankaranarayanan P. Bhattacharyya 37 25 0 22 Sep 2021
BERT Cannot Align Characters Antonis Maronikolakis Philipp Dufter Hinrich Schütze 23 0 0 20 Sep 2021
Locating Language-Specific Information in Contextualized Embeddings Sheng Liang Philipp Dufter Hinrich Schütze 22 7 0 16 Sep 2021
Cross-lingual Transfer of Monolingual Models Evangelia Gogoulou Ariel Ekgren T. Isbister Magnus Sahlgren 27 16 0 15 Sep 2021
Beyond Glass-Box Features: Uncertainty Quantification Enhanced Quality Estimation for Neural Machine Translation Ke Min Wang Yangbin Shi Jiayi Wang Yuqi Zhang Yu Zhao Xiaolin Zheng 44 6 0 15 Sep 2021
On the Language-specificity of Multilingual BERT and the Impact of Fine-tuning Marc Tanti Lonneke van der Plas Claudia Borg Albert Gatt 18 10 0 14 Sep 2021
A Massively Multilingual Analysis of Cross-linguality in Shared Embedding Space Alex Jones W. Wang Kyle Mahowald 15 8 0 13 Sep 2021
xGQA: Cross-Lingual Visual Question Answering Jonas Pfeiffer Gregor Geigle Aishwarya Kamath Jan-Martin O. Steitz Stefan Roth Ivan Vulić Iryna Gurevych 26 56 0 13 Sep 2021
Wine is Not v i n. -- On the Compatibility of Tokenizations Across Languages Antonis Maronikolakis Philipp Dufter Hinrich Schütze 17 17 0 13 Sep 2021