How multilingual is Multilingual BERT?

4 June 2019

Papers citing "How multilingual is Multilingual BERT?"

50 / 655 papers shown

Title
DA-Net: A Disentangled and Adaptive Network for Multi-Source Cross-Lingual Transfer Learning Ling Ge Chunming Hu Guanghui Ma Jihong Liu Hong Zhang 29 0 0 07 Mar 2024
A Measure for Transparent Comparison of Linguistic Diversity in Multilingual NLP Data Sets Tanja Samardzic Ximena Gutierrez-Vasques Christian Bentz Steven Moran Olga Pelloni 32 4 0 06 Mar 2024
Advancing Generative AI for Portuguese with Open Decoder Gervásio PT* Rodrigo Santos Joao Silva Luís Gomes João Rodrigues António Branco 44 10 0 29 Feb 2024
Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Models Tianyi Tang Wenyang Luo Haoyang Huang Dongdong Zhang Xiaolei Wang Xin Zhao Furu Wei Ji-Rong Wen 56 46 0 26 Feb 2024
$C^3$ : Confidence Calibration Model Cascade for Inference-Efficient Cross-Lingual Natural Language Understanding Taixi Lu Haoyu Wang Huajie Shao Jing Gao Huaxiu Yao 33 0 0 25 Feb 2024
Zero-shot cross-lingual transfer in instruction tuning of large language models Nadezhda Chirkova Vassilina Nikoulina LRM 38 3 0 22 Feb 2024
Unveiling Linguistic Regions in Large Language Models Zhihao Zhang Jun Zhao Qi Zhang Tao Gui Xuanjing Huang 42 11 0 22 Feb 2024
Analysis of Multi-Source Language Training in Cross-Lingual Transfer Seong Hoon Lim Taejun Yun Jinhyeon Kim Jihun Choi Taeuk Kim 46 2 0 21 Feb 2024
The Hidden Space of Transformer Language Adapters Jesujoba Oluwadara Alabi Marius Mosbach Matan Eyal Dietrich Klakow Mor Geva 51 7 1 20 Feb 2024
Key ingredients for effective zero-shot cross-lingual knowledge transfer in generative tasks Nadezhda Chirkova Vassilina Nikoulina 18 7 0 19 Feb 2024
Share What You Already Know: Cross-Language-Script Transfer and Alignment for Sentiment Detection in Code-Mixed Data Niraj Pahari Kazutaka Shimada 24 0 0 07 Feb 2024
Stanceosaurus 2.0: Classifying Stance Towards Russian and Spanish Misinformation Anton Lavrouk Ian Ligon Tarek Naous Jonathan Zheng Alan Ritter Wei-ping Xu 16 0 0 06 Feb 2024
BGE M3-Embedding: Multi-Lingual, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillation Jianlv Chen Shitao Xiao Peitian Zhang Kun Luo Defu Lian Zheng Liu 115 325 0 05 Feb 2024
Analyzing the Evaluation of Cross-Lingual Knowledge Transfer in Multilingual Language Models Sara Rajaee Christof Monz 30 3 0 03 Feb 2024
LangBridge: Multilingual Reasoning Without Multilingual Supervision Dongkeun Yoon Joel Jang Sungdong Kim Seungone Kim Sheikh Shafayat Minjoon Seo LRM 24 14 0 19 Jan 2024
Cross-lingual neural fuzzy matching for exploiting target-language monolingual corpora in computer-aided translation M. Esplà-Gomis Víctor M. Sánchez-Cartagena J. A. Pérez-Ortiz F. Sánchez-Martínez 6 3 0 16 Jan 2024
Discovering Low-rank Subspaces for Language-agnostic Multilingual Representations Zhihui Xie Handong Zhao Tong Yu Shuai Li 34 13 0 11 Jan 2024
Multilingual Instruction Tuning With Just a Pinch of Multilinguality Uri Shaham Jonathan Herzig Roee Aharoni Idan Szpektor Reut Tsarfaty Matan Eyal LRM 37 41 0 03 Jan 2024
LLaMA Beyond English: An Empirical Study on Language Capability Transfer Jun Zhao Zhihao Zhang Luhui Gao Qi Zhang Tao Gui Xuanjing Huang ELM 33 65 0 02 Jan 2024
From Bytes to Biases: Investigating the Cultural Self-Perception of Large Language Models Wolfgang Messner Tatum Greene Josephine Matalone 19 4 0 21 Dec 2023
Cross-Lingual Learning in Multilingual Scene Text Recognition Jeonghun Baek Yusuke Matsui Kiyoharu Aizawa 13 0 0 17 Dec 2023
SegMix: A Simple Structure-Aware Data Augmentation Method Yuxin Pei Pushkar Bhuse Zhengzhong Liu Eric P. Xing 18 1 0 16 Nov 2023
When Is Multilinguality a Curse? Language Modeling for 250 High- and Low-Resource Languages Tyler A. Chang Catherine Arnett Zhuowen Tu Benjamin Bergen LRM 28 7 0 15 Nov 2023
How Vocabulary Sharing Facilitates Multilingualism in LLaMA? Fei Yuan Shuai Yuan Zhiyong Wu Lei Li 24 10 0 15 Nov 2023
OFA: A Framework of Initializing Unseen Subword Embeddings for Efficient Large-scale Multilingual Continued Pretraining Yihong Liu Peiqin Lin Mingyang Wang Hinrich Schütze 24 21 0 15 Nov 2023
A Material Lens on Coloniality in NLP William B. Held Camille Harris Michael Best Diyi Yang 20 11 0 14 Nov 2023
Examining Modularity in Multilingual LMs via Language-Specialized Subnetworks Rochelle Choenni Ekaterina Shutova Daniel H Garrette 27 8 0 14 Nov 2023
On the Analysis of Cross-Lingual Prompt Tuning for Decoder-based Multilingual Model Nohil Park Joonsuk Park Kang Min Yoo Sungroh Yoon 21 3 0 14 Nov 2023
Sharing, Teaching and Aligning: Knowledgeable Transfer Learning for Cross-Lingual Machine Reading Comprehension Tingfeng Cao Chengyu Wang Chuanqi Tan Jun Huang Jinhui Zhu 8 0 0 12 Nov 2023
Task-Agnostic Low-Rank Adapters for Unseen English Dialects Zedian Xiao William B. Held Yanchen Liu Diyi Yang 25 7 0 02 Nov 2023
Syntactic Inductive Bias in Transformer Language Models: Especially Helpful for Low-Resource Languages? Luke Gessler Nathan Schneider 11 1 0 01 Nov 2023
Two-Stage Classifier for Campaign Negativity Detection using Axis Embeddings: A Case Study on Tweets of Political Users during 2021 Presidential Election in Iran Fatemeh Rajabi Ali Mohades 11 0 0 31 Oct 2023
CreoleVal: Multilingual Multitask Benchmarks for Creoles Heather Lent Kushal Tatariya Raj Dabre Yiyi Chen Marcell Richard Fekete ... Miryam de Lhoneux Daniel Hershcovich Michel DeGraff Anders Sogaard Johannes Bjerva SLR 41 9 0 30 Oct 2023
Counterfactually Probing Language Identity in Multilingual Models Anirudh Srinivasan Venkata S Govindarajan Kyle Mahowald 21 1 0 29 Oct 2023
X-SNS: Cross-Lingual Transfer Prediction through Sub-Network Similarity Taejun Yun Jinhyeon Kim Deokyeong Kang Seong Hoon Lim Jihoon Kim Taeuk Kim 29 0 0 26 Oct 2023
Language Agnostic Code Embeddings Saiteja Utpala Alex Gu Pin-Yu Chen 31 1 0 25 Oct 2023
GradSim: Gradient-Based Language Grouping for Effective Multilingual Training Mingyang Wang Heike Adel Lukas Lange Jannik Strötgen Hinrich Schütze 20 3 0 23 Oct 2023
Breaking the Language Barrier: Improving Cross-Lingual Reasoning with Structured Self-Attention Negar Foroutan Mohammadreza Banaei Karl Aberer Antoine Bosselut LRM 25 3 0 23 Oct 2023
Boosting Unsupervised Machine Translation with Pseudo-Parallel Data Ivana Kvapilíková Ondrej Bojar MoE 22 0 0 22 Oct 2023
The Less the Merrier? Investigating Language Representation in Multilingual Models H. Nigatu A. Tonja Jugal Kalita 23 0 0 20 Oct 2023
Are Structural Concepts Universal in Transformer Language Models? Towards Interpretable Cross-Lingual Generalization Ningyu Xu Qi Zhang Jingting Ye Menghan Zhang Xuanjing Huang 38 4 0 19 Oct 2023
Towards a Better Understanding of Variations in Zero-Shot Neural Machine Translation Performance Shaomu Tan Christof Monz 22 11 0 16 Oct 2023
Investigating Bias in Multilingual Language Models: Cross-Lingual Transfer of Debiasing Techniques Manon Reusens Philipp Borchert Margot Mieskes Jochen De Weerdt Bart Baesens 27 8 0 16 Oct 2023
UvA-MT's Participation in the WMT23 General Translation Shared Task Di Wu Shaomu Tan David Stap Ali Araabi Christof Monz 16 3 0 15 Oct 2023
Empirical study of pretrained multilingual language models for zero-shot cross-lingual knowledge transfer in generation Nadezhda Chirkova Sheng Liang Vassilina Nikoulina 11 0 0 15 Oct 2023
Political claim identification and categorization in a multilingual setting: First experiments Urs Zaberer Sebastian Padó Gabriella Lapesa 24 3 0 13 Oct 2023
Comparing Styles across Languages: A Cross-Cultural Exploration of Politeness Shreya Havaldar Matthew Pressimone Eric Wong Lyle Ungar 50 2 0 11 Oct 2023
Cultural Compass: Predicting Transfer Learning Success in Offensive Language Detection with Cultural Features Li Zhou Antonia Karamolegkou Wenyu Chen Daniel Hershcovich 43 11 0 10 Oct 2023
Few-Shot Spoken Language Understanding via Joint Speech-Text Models Chung-Ming Chien Mingjiamei Zhang Ju-Chieh Chou Karen Livescu 26 3 0 09 Oct 2023
Tik-to-Tok: Translating Language Models One Token at a Time: An Embedding Initialization Strategy for Efficient Language Adaptation François Remy Pieter Delobelle Bettina Berendt Kris Demuynck Thomas Demeester 29 3 0 05 Oct 2023