How multilingual is Multilingual BERT?

4 June 2019

Papers citing "How multilingual is Multilingual BERT?"

50 / 655 papers shown

Title
Persian Emotion Detection using ParsBERT and Imbalanced Data Handling Approaches Amirhossein Abaskohi Nazanin Sabri B. Bahrak 25 4 0 15 Nov 2022
High-Resource Methodological Bias in Low-Resource Investigations Maartje ter Hoeve David Grangier Natalie Schluter 33 2 0 14 Nov 2022
GreenPLM: Cross-Lingual Transfer of Monolingual Pre-Trained Language Models at Almost No Cost Qingcheng Zeng Lucas Garay Peilin Zhou Dading Chong Yining Hua Jiageng Wu Yi-Cheng Pan Han Zhou Rob Voigt Jie Yang VLM 19 22 0 13 Nov 2022
English Contrastive Learning Can Learn Universal Cross-lingual Sentence Embeddings Yau-Shian Wang Ashley Wu Graham Neubig SSL 27 31 0 11 Nov 2022
Cross-lingual Transfer Learning for Check-worthy Claim Identification over Twitter Maram Hasanain Tamer Elsayed 19 4 0 09 Nov 2022
Detecting Languages Unintelligible to Multilingual Models through Local Structure Probes Louis Clouâtre Prasanna Parthasarathi Amal Zouaq Sarath Chandar 33 3 0 09 Nov 2022
Parameter and Data Efficient Continual Pre-training for Robustness to Dialectal Variance in Arabic Soumajyoti Sarkar Kaixiang Lin Sailik Sengupta Leonard Lausen Sheng Zha Saab Mansour CLL 15 3 0 08 Nov 2022
Intriguing Properties of Compression on Multilingual Models Kelechi Ogueji Orevaoghene Ahia Gbemileke Onilude Sebastian Gehrmann Sara Hooker Julia Kreutzer 21 12 0 04 Nov 2022
Data-Efficient Cross-Lingual Transfer with Language-Specific Subnetworks Rochelle Choenni Dan Garrette Ekaterina Shutova 24 2 0 31 Oct 2022
Benchmarking Language Models for Code Syntax Understanding Da Shen Xinyun Chen Chenguang Wang Koushik Sen Dawn Song ELM 19 16 0 26 Oct 2022
Progressive Sentiment Analysis for Code-Switched Text Data Sudhanshu Ranjan Dheeraj Mekala Jingbo Shang 24 4 0 25 Oct 2022
Adapters for Enhanced Modeling of Multilingual Knowledge and Text Yifan Hou Wenxiang Jiao Mei-Jun Liu Carl Allen Zhaopeng Tu Mrinmaya Sachan 21 11 0 24 Oct 2022
Universal and Independent: Multilingual Probing Framework for Exhaustive Model Interpretation and Evaluation O. Serikov Vitaly Protasov E. Voloshina V. Knyazkova Tatiana Shavrina 27 3 0 24 Oct 2022
Model and Data Transfer for Cross-Lingual Sequence Labelling in Zero-Resource Settings Iker García-Ferrero Rodrigo Agerri German Rigau 61 21 0 23 Oct 2022
MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition David Ifeoluwa Adelani Graham Neubig Sebastian Ruder Shruti Rijhwani Michael Beukman ... Idris Abdulmumin Odunayo Ogundepo Oreen Yousuf Tatiana Moteu Ngoli Dietrich Klakow 36 43 0 22 Oct 2022
Prompt-Tuning Can Be Much Better Than Fine-Tuning on Cross-lingual Understanding With Multilingual Language Models Lifu Tu Caiming Xiong Yingbo Zhou VLM AAML LRM 92 27 0 22 Oct 2022
Data-Efficient Strategies for Expanding Hate Speech Detection into Under-Resourced Languages Paul Röttger Debora Nozza Federico Bianchi Dirk Hovy 23 10 0 20 Oct 2022
Synergy with Translation Artifacts for Training and Inference in Multilingual Tasks Jaehoon Oh Jongwoo Ko Se-Young Yun 42 9 0 18 Oct 2022
Shapley Head Pruning: Identifying and Removing Interference in Multilingual Transformers William B. Held Diyi Yang VLM 32 5 0 11 Oct 2022
Robustification of Multilingual Language Models to Real-world Noise in Crosslingual Zero-shot Settings with Robust Contrastive Pretraining Asa Cooper Stickland Sailik Sengupta Jason Krone Saab Mansour He He 44 7 0 10 Oct 2022
Language Models are Multilingual Chain-of-Thought Reasoners Freda Shi Mirac Suzgun Markus Freitag Xuezhi Wang Suraj Srivats ... Yi Tay Sebastian Ruder Denny Zhou Dipanjan Das Jason W. Wei ReLM LRM 170 325 0 06 Oct 2022
State-of-the-art generalisation research in NLP: A taxonomy and review Dieuwke Hupkes Mario Giulianelli Verna Dankers Mikel Artetxe Yanai Elazar ... Leila Khalatbari Maria Ryskina Rita Frieske Ryan Cotterell Zhijing Jin 111 93 0 06 Oct 2022
MonoByte: A Pool of Monolingual Byte-level Language Models Hugo Queiroz Abonizio Leandro Rodrigues de Souza R. Lotufo Rodrigo Nogueira 23 1 0 22 Sep 2022
Adaptation of domain-specific transformer models with text oversampling for sentiment analysis of social media posts on Covid-19 vaccines Anmol Bansal Arjun Choudhry Anubhav Sharma Seba Susan MedIm 19 4 0 22 Sep 2022
Language Chameleon: Transformation analysis between languages using Cross-lingual Post-training based on Pre-trained language models Suhyune Son Chanjun Park Jungseob Lee Midan Shim Chanhee Lee Yoonna Jang Jaehyung Seo Heu-Jeoung Lim 24 0 0 14 Sep 2022
Multilingual Transformer Language Model for Speech Recognition in Low-resource Languages Li Miao Jian Wu Piyush Behre Shuangyu Chang S. Parthasarathy 16 2 0 08 Sep 2022
Trust in Language Grounding: a new AI challenge for human-robot teams David M. Bossens C. Evers 32 1 0 05 Sep 2022
KoCHET: a Korean Cultural Heritage corpus for Entity-related Tasks Gyeongmin Kim Jinsung Kim Junyoung Son Heu-Jeoung Lim 14 7 0 01 Sep 2022
Massively Multilingual Lexical Specialization of Multilingual Transformers Tommaso Green Simone Paolo Ponzetto Goran Glavavs 22 0 0 01 Aug 2022
On the cross-lingual transferability of multilingual prototypical models across NLU tasks Oralie Cattan Christophe Servan S. Rosset 19 9 0 19 Jul 2022
On the Usability of Transformers-based models for a French Question-Answering task Oralie Cattan Christophe Servan Sophie Rosset 12 14 0 19 Jul 2022
Multilingual Transformer Encoders: a Word-Level Task-Agnostic Evaluation Félix Gaschi François Plesse Parisa Rastin Y. Toussaint 20 8 0 19 Jul 2022
u-HuBERT: Unified Mixed-Modal Speech Pretraining And Zero-Shot Transfer to Unlabeled Modality Wei-Ning Hsu Bowen Shi SSL VLM 19 41 0 14 Jul 2022
Language Modelling with Pixels Phillip Rust Jonas F. Lotz Emanuele Bugliarello Elizabeth Salesky Miryam de Lhoneux Desmond Elliott VLM 30 46 0 14 Jul 2022
"Diversity and Uncertainty in Moderation" are the Key to Data Selection for Multilingual Few-shot Transfer Shanu Kumar Sandipan Dandapat Monojit Choudhury 21 6 0 30 Jun 2022
Extreme compression of sentence-transformer ranker models: faster inference, longer battery life, and less storage on edge devices Amit Chaulwar Lukas Malik Maciej Krajewski Felix Reichel Leif-Nissen Lundbæk M. Huth B. Matejczyk VLM 15 3 0 29 Jun 2022
SPBERTQA: A Two-Stage Question Answering System Based on Sentence Transformers for Medical Texts N. T. Nguyen Phuong Phan-Dieu Ha Luan Thanh Nguyen Kiet Van Nguyen N. Nguyen MedIm 15 10 0 20 Jun 2022
BITS Pilani at HinglishEval: Quality Evaluation for Code-Mixed Hinglish Text Using Transformers Shaz Furniturewala V. Kumari Amulya Ratna Dash Hriday Kedia Yashvardhan Sharma 15 2 0 17 Jun 2022
PreCogIIITH at HinglishEval : Leveraging Code-Mixing Metrics & Language Model Embeddings To Estimate Code-Mix Quality Prashant Kodali Tanmay Sachan Akshay Goindani Anmol Goel Naman Ahuja Manish Shrivastava Ponnurangam Kumaraguru 11 2 0 16 Jun 2022
1Cademy at Semeval-2022 Task 1: Investigating the Effectiveness of Multilingual, Multitask, and Language-Agnostic Tricks for the Reverse Dictionary Task Zhiyong Wang Ge Zhang Nineli Lashkarashvili 16 3 0 08 Jun 2022
Transfer Language Selection for Zero-Shot Cross-Lingual Abusive Language Detection J. Eronen M. Ptaszynski Fumito Masui Masaki Arata Gniewosz Leliwa Michal Wroczynski 19 31 0 02 Jun 2022
Punctuation Restoration in Spanish Customer Support Transcripts using Transfer Learning Xiliang Zhu Shayna Gardiner David Rossouw T. Roldán Simon Corston-Oliver 36 1 0 27 May 2022
Discovering Language-neutral Sub-networks in Multilingual Language Models Negar Foroutan Mohammadreza Banaei R. Lebret Antoine Bosselut Karl Aberer LRM 41 25 0 25 May 2022
Analysing the Greek Parliament Records with Emotion Classification John Pavlopoulos Vanessa Lislevand 17 2 0 24 May 2022
Word-order typology in Multilingual BERT: A case study in subordinate-clause detection Dmitry Nikolaev Sebastian Padó 27 6 0 24 May 2022
Analyzing the Mono- and Cross-Lingual Pretraining Dynamics of Multilingual Language Models Terra Blevins Hila Gonen Luke Zettlemoyer LRM 54 26 0 24 May 2022
The Geometry of Multilingual Language Model Representations Tyler A. Chang Z. Tu Benjamin Bergen 16 56 0 22 May 2022
Phylogeny-Inspired Adaptation of Multilingual Models to New Languages Fahim Faisal Antonios Anastasopoulos AI4CE LRM 34 26 0 19 May 2022
OneAligner: Zero-shot Cross-lingual Transfer with One Rich-Resource Language Pair for Low-Resource Sentence Retrieval Tong Niu Kazuma Hashimoto Yingbo Zhou Caiming Xiong VLM 27 5 0 17 May 2022
Feature Aggregation in Zero-Shot Cross-Lingual Transfer Using Multilingual BERT Beiduo Chen Wu Guo Quan Liu Kun Tao 29 1 0 17 May 2022