Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment

11 June 2021

Papers citing "Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment"

39 / 39 papers shown

Title
A Practical Guide to Fine-tuning Language Models with Limited Data Márton Szép Daniel Rueckert Rüdiger von Eisenhart-Rothe Florian Hinterwimmer SyDa ALM 42 2 0 14 Nov 2024
How Transliterations Improve Crosslingual Alignment Yihong Liu Mingyang Wang Amir Hossein Kargaran Ayyoob Imani Orgest Xhelili Haotian Ye Chunlan Ma François Yvon Hinrich Schütze 31 2 0 25 Sep 2024
BinaryAlign: Word Alignment as Binary Sequence Labeling Gaetan Lopez Latouche M. Carbonneau Ben Swanson 31 1 0 16 Jul 2024
A Recipe of Parallel Corpora Exploitation for Multilingual Large Language Models Peiqin Lin André F. T. Martins Hinrich Schütze 51 2 0 29 Jun 2024
UniPSDA: Unsupervised Pseudo Semantic Data Augmentation for Zero-Shot Cross-Lingual Natural Language Understanding Dongyang Li Taolin Zhang Jiali Deng Longtao Huang Chengyu Wang Xiaofeng He Hui Xue 29 1 0 24 Jun 2024
OTTAWA: Optimal TransporT Adaptive Word Aligner for Hallucination and Omission Translation Errors Detection Chenyang Huang Abbas Ghaddar I. Kobyzev Mehdi Rezagholizadeh Osmar R. Zaiane Boxing Chen 39 0 0 04 Jun 2024
Word Alignment as Preference for Machine Translation Qiyu Wu Masaaki Nagata Zhongtao Miao Yoshimasa Tsuruoka 41 5 0 15 May 2024
Mitigating Language-Level Performance Disparity in mPLMs via Teacher Language Selection and Cross-lingual Self-Distillation Haozhe Zhao Zefan Cai Shuzheng Si Liang Chen Yufeng He Kaikai An Baobao Chang 16 0 0 12 Apr 2024
Understanding Cross-Lingual Alignment -- A Survey Katharina Hämmerl Jindvrich Libovický Alexander M. Fraser 36 10 0 09 Apr 2024
Enhancing Cross-lingual Sentence Embedding for Low-resource Languages with Word Alignment Zhongtao Miao Qiyu Wu Kaiyan Zhao Zilong Wu Yoshimasa Tsuruoka 23 9 0 03 Apr 2024
Effectively Prompting Small-sized Language Models for Cross-lingual Tasks via Winning Tickets Mingqi Li Feng Luo LRM 25 0 0 01 Apr 2024
Enhancing Multilingual Capabilities of Large Language Models through Self-Distillation from Resource-Rich Languages Yuan Zhang Yile Wang Zijun Liu Shuo Wang Xiaolong Wang Peng Li Maosong Sun Yang Janet Liu LRM 27 9 0 19 Feb 2024
Translate-Distill: Learning Cross-Language Dense Retrieval by Translation and Distillation Eugene Yang Dawn J Lawrie J. Mayfield Douglas W. Oard Scott Miller FedML VLM 36 8 0 09 Jan 2024
Interpreting Indirect Answers to Yes-No Questions in Multiple Languages Zijie Wang Md Mosharaf Hossain Shivam Mathur Terry Cruz Melo Kadir Bulut Ozler ... Jacob Quintero MohammadHossein Rezaei Shreya Nupur Shakya Md Nayem Uddin Eduardo Blanco 24 1 0 20 Oct 2023
Cross-modal Alignment with Optimal Transport for CTC-based ASR Xugang Lu Peng Shen Yu Tsao Hisashi Kawai 22 4 0 24 Sep 2023
Soft Language Clustering for Multilingual Model Pre-training Jiali Zeng Yu Jiang Yongjing Yin Yingqi Jing Fandong Meng Binghuai Lin Yunbo Cao Jie Zhou 15 4 0 13 Jun 2023
WSPAlign: Word Alignment Pre-training via Large-Scale Weakly Supervised Span Prediction Qiyu Wu Masaaki Nagata Yoshimasa Tsuruoka 19 5 0 09 Jun 2023
mPLM-Sim: Better Cross-Lingual Similarity and Transfer in Multilingual Pretrained Language Models Peiqin Lin Chengzhi Hu Zheyu Zhang André F. T. Martins Hinrich Schütze 22 1 0 23 May 2023
Measuring Cross-Lingual Transferability of Multilingual Transformers on Sentence Classification Zewen Chi Heyan Huang Xian-Ling Mao 31 0 0 15 May 2023
Efficiently Aligned Cross-Lingual Transfer Learning for Conversational Tasks using Prompt-Tuning Lifu Tu Jin Qu Semih Yavuz Shafiq R. Joty Wenhao Liu Caiming Xiong Yingbo Zhou 13 7 0 03 Apr 2023
HIT-SCIR at MMNLU-22: Consistency Regularization for Multilingual Spoken Language Understanding Bo Zheng Zhouyang Li Fuxuan Wei Qiguang Chen Libo Qin Wanxiang Che 18 3 0 05 Jan 2023
Speaking Multiple Languages Affects the Moral Bias of Language Models Katharina Hämmerl Bjorn Deiseroth P. Schramowski Jindrich Libovický Constantin Rothkopf Alexander M. Fraser Kristian Kersting 16 31 0 14 Nov 2022
Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning Barun Patra Saksham Singhal Shaohan Huang Zewen Chi Li Dong Furu Wei Vishrav Chaudhary Xia Song 56 23 0 26 Oct 2022
MM-Align: Learning Optimal Transport-based Alignment Dynamics for Fast and Accurate Inference on Missing Modality Sequences Wei Han Hui Chen MingSung Kan Soujanya Poria 27 10 0 23 Oct 2022
EntityCS: Improving Zero-Shot Cross-lingual Transfer with Entity-Centric Code Switching Chenxi Whitehouse Fenia Christopoulou Ignacio Iacobacci 29 9 0 22 Oct 2022
C3: Continued Pretraining with Contrastive Weak Supervision for Cross Language Ad-Hoc Retrieval Eugene Yang Suraj Nair Ramraj Chandradevan Rebecca Iglesias-Flores Douglas W. Oard RALM CLL 14 19 0 25 Apr 2022
On the Representation Collapse of Sparse Mixture of Experts Zewen Chi Li Dong Shaohan Huang Damai Dai Shuming Ma ... Payal Bajaj Xia Song Xian-Ling Mao Heyan Huang Furu Wei MoMe MoE 32 95 0 20 Apr 2022
Bridging the Gap between Language Models and Cross-Lingual Sequence Labeling Nuo Chen Linjun Shou Ming Gong Jian Pei Daxin Jiang 19 10 0 11 Apr 2022
Combining Static and Contextualised Multilingual Embeddings Katharina Hämmerl Jindrich Libovický Alexander M. Fraser 20 10 0 17 Mar 2022
Using Optimal Transport as Alignment Objective for fine-tuning Multilingual Contextualized Embeddings Sawsan Alqahtani Garima Lalwani Yi Zhang Salvatore Romeo Saab Mansour OT 31 24 0 06 Oct 2021
Cross-Lingual Language Model Meta-Pretraining Zewen Chi Heyan Huang Luyang Liu Yu Bai Xian-Ling Mao LRM 45 0 0 23 Sep 2021
Allocating Large Vocabulary Capacity for Cross-lingual Language Model Pre-training Bo Zheng Li Dong Shaohan Huang Saksham Singhal Wanxiang Che Ting Liu Xia Song Furu Wei VLM 13 22 0 15 Sep 2021
A Primer on Pretrained Multilingual Language Models Sumanth Doddapaneni Gowtham Ramesh Mitesh M. Khapra Anoop Kunchukuttan Pratyush Kumar LRM 30 73 0 01 Jul 2021
XLM-E: Cross-lingual Language Model Pre-training via ELECTRA Zewen Chi Shaohan Huang Li Dong Shuming Ma Bo Zheng ... Payal Bajaj Xia Song Xian-Ling Mao Heyan Huang Furu Wei 34 118 0 30 Jun 2021
MT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs Zewen Chi Li Dong Shuming Ma Shaohan Huang Xian-Ling Mao Heyan Huang Furu Wei LRM 45 71 0 18 Apr 2021
Natural Language Understanding for Argumentative Dialogue Systems in the Opinion Building Domain W. A. Abro Annalena Aicher Niklas Rach Stefan Ultes Wolfgang Minker Guilin Qi 23 32 0 03 Mar 2021
ERNIE-M: Enhanced Multilingual Representation by Aligning Cross-lingual Semantics with Monolingual Corpora Ouyang Xuan Shuohuan Wang Chao Pang Yu Sun Hao Tian Hua-Hong Wu Haifeng Wang 51 100 0 31 Dec 2020
MLQA: Evaluating Cross-lingual Extractive Question Answering Patrick Lewis Barlas Oğuz Ruty Rinott Sebastian Riedel Holger Schwenk ELM 242 490 0 16 Oct 2019
Six Challenges for Neural Machine Translation Philipp Koehn Rebecca Knowles AAML AIMat 208 1,205 0 12 Jun 2017