Multilingual Alignment of Contextual Word Representations

10 February 2020

Papers citing "Multilingual Alignment of Contextual Word Representations"

50 / 128 papers shown

Title
Investigating the Effect of Parallel Data in the Cross-Lingual Transfer for Vision-Language Encoders Andrei-Alexandru Manea Jindřich Libovický VLM 52 0 0 30 Apr 2025
ALGEN: Few-shot Inversion Attacks on Textual Embeddings using Alignment and Generation Yiyi Chen Qiongkai Xu Johannes Bjerva 44 0 0 16 Feb 2025
A Practical Guide to Fine-tuning Language Models with Limited Data Márton Szép Daniel Rueckert Rüdiger von Eisenhart-Rothe Florian Hinterwimmer SyDa ALM 44 2 0 14 Nov 2024
The Semantic Hub Hypothesis: Language Models Share Semantic Representations Across Languages and Modalities Zhaofeng Wu Xinyan Velocity Yu Dani Yogatama Jiasen Lu Yoon Kim AIFin 46 10 0 07 Nov 2024
MEXA: Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment Amir Hossein Kargaran Ali Modarressi Nafiseh Nikeghbal Jana Diesner François Yvon Hinrich Schütze ELM 46 3 0 08 Oct 2024
CiMaTe: Citation Count Prediction Effectively Leveraging the Main Text Jun Hirako Ryohei Sasano Koichi Takeda 32 1 0 06 Oct 2024
LangSAMP: Language-Script Aware Multilingual Pretraining Yihong Liu Haotian Ye Chunlan Ma Mingyang Wang Hinrich Schütze VLM 29 0 0 26 Sep 2024
How Transliterations Improve Crosslingual Alignment Yihong Liu Mingyang Wang Amir Hossein Kargaran Ayyoob Imani Orgest Xhelili Haotian Ye Chunlan Ma François Yvon Hinrich Schütze 34 2 0 25 Sep 2024
Pruning Multilingual Large Language Models for Multilingual Inference Hwichan Kim Jun Suzuki Tosho Hirasawa Mamoru Komachi 26 0 0 25 Sep 2024
PreAlign: Boosting Cross-Lingual Transfer by Early Establishment of Multilingual Alignment Jiahuan Li Shujian Huang Xinyu Dai Jiajun Chen LLMSV 41 5 0 23 Jul 2024
Cross-Lingual Transfer Learning for Speech Translation Rao Ma Yassir Fathullah Mengjie Qian Siyuan Tang Mark J. F. Gales Kate Knill 20 1 0 01 Jul 2024
Breaking the Script Barrier in Multilingual Pre-Trained Language Models with Transliteration-Based Post-Training Alignment Orgest Xhelili Yihong Liu Hinrich Schütze 31 6 0 28 Jun 2024
Improving Zero-Shot Cross-Lingual Transfer via Progressive Code-Switching Zhuoran Li Chunming Hu J. Chen Zhijun Chen Xiaohui Guo Richong Zhang 29 2 0 19 Jun 2024
Probing the Emergence of Cross-lingual Alignment during LLM Training Hetong Wang Pasquale Minervini E. Ponti 39 7 0 19 Jun 2024
Exploring Alignment in Shared Cross-lingual Spaces Basel Mousi Nadir Durrani Fahim Dalvi Majd Hawasly Ahmed Abdelali 30 0 0 23 May 2024
XAMPLER: Learning to Retrieve Cross-Lingual In-Context Examples Peiqin Lin André F. T. Martins Hinrich Schütze RALM 45 2 0 08 May 2024
Unknown Script: Impact of Script on Cross-Lingual Transfer Wondimagegnhue Tufa Ilia Markov Piek Vossen 37 0 0 29 Apr 2024
Understanding Cross-Lingual Alignment -- A Survey Katharina Hämmerl Jindvrich Libovický Alexander M. Fraser 36 10 0 09 Apr 2024
A Survey on Multilingual Large Language Models: Corpora, Alignment, and Bias Yuemei Xu Ling Hu Jiayi Zhao Zihan Qiu Yuqi Ye Hanwen Gu LRM 27 36 0 01 Apr 2024
Multilingual Sentence-T5: Scalable Sentence Encoders for Multilingual Applications Chihiro Yano Akihiko Fukuchi Shoko Fukasawa Hideyuki Tachibana Yotaro Watanabe 39 2 0 26 Mar 2024
Can Machine Translation Bridge Multilingual Pretraining and Cross-lingual Transfer Learning? Shaoxiong Ji Timothee Mickus Vincent Segonne Jörg Tiedemann CLL 25 3 0 25 Mar 2024
Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Models Tianyi Tang Wenyang Luo Haoyang Huang Dongdong Zhang Xiaolei Wang Xin Zhao Furu Wei Ji-Rong Wen 56 46 0 26 Feb 2024
Unveiling Linguistic Regions in Large Language Models Zhihao Zhang Jun Zhao Qi Zhang Tao Gui Xuanjing Huang 45 11 0 22 Feb 2024
Transferring BERT Capabilities from High-Resource to Low-Resource Languages Using Vocabulary Matching Piotr Rybak 27 1 0 22 Feb 2024
Do Llamas Work in English? On the Latent Language of Multilingual Transformers Chris Wendler V. Veselovsky Giovanni Monea Robert West 56 95 0 16 Feb 2024
Share What You Already Know: Cross-Language-Script Transfer and Alignment for Sentiment Detection in Code-Mixed Data Niraj Pahari Kazutaka Shimada 24 0 0 07 Feb 2024
Domain Adaptation of Multilingual Semantic Search -- Literature Review Anna Bringmann Anastasia Zhukova VLM 30 0 0 05 Feb 2024
LLaMA Beyond English: An Empirical Study on Language Capability Transfer Jun Zhao Zhihao Zhang Luhui Gao Qi Zhang Tao Gui Xuanjing Huang ELM 33 65 0 02 Jan 2024
Improving In-context Learning of Multilingual Generative Language Models with Cross-lingual Alignment Chong Li Shaonan Wang Jiajun Zhang Chengqing Zong 21 15 0 14 Nov 2023
X-SNS: Cross-Lingual Transfer Prediction through Sub-Network Similarity Taejun Yun Jinhyeon Kim Deokyeong Kang Seong Hoon Lim Jihoon Kim Taeuk Kim 29 0 0 26 Oct 2023
Are Structural Concepts Universal in Transformer Language Models? Towards Interpretable Cross-Lingual Generalization Ningyu Xu Qi Zhang Jingting Ye Menghan Zhang Xuanjing Huang 38 4 0 19 Oct 2023
Self-Augmentation Improves Zero-Shot Cross-Lingual Transfer Fei Wang Kuan-Hao Huang Kai-Wei Chang Muhao Chen 26 4 0 19 Sep 2023
Multilingual Text Representation Fahim Faisal 19 0 0 02 Sep 2023
KDSTM: Neural Semi-supervised Topic Modeling with Knowledge Distillation Weijie Xu Xiaoyu Jiang Jay Desai Bin Han Fuqin Yan Francis Iannacci BDL 18 3 0 04 Jul 2023
Exploring the Relationship between Alignment and Cross-lingual Transfer in Multilingual Transformers Félix Gaschi Patricio Cerda Parisa Rastin Y. Toussaint 17 9 0 05 Jun 2023
Why Does Zero-Shot Cross-Lingual Generation Fail? An Explanation and a Solution Tianjian Li Kenton W. Murray 35 23 0 27 May 2023
Free Lunch: Robust Cross-Lingual Transfer via Model Checkpoint Averaging Fabian David Schmidt Ivan Vulić Goran Glavavs 18 8 0 26 May 2023
Linear Cross-Lingual Mapping of Sentence Embeddings Oleg V. Vasilyev Fumika Isono John Bohannon LLMSV 21 1 0 23 May 2023
InstructAlign: High-and-Low Resource Language Alignment via Continual Crosslingual Instruction Tuning Samuel Cahyawijaya Holy Lovenia Tiezheng Yu Willy Chung Pascale Fung ALM 39 14 0 23 May 2023
A General-Purpose Multilingual Document Encoder Onur Galoglu Robert Litschko Goran Glavas 29 2 0 11 May 2023
PR-MCS: Perturbation Robust Metric for MultiLingual Image Captioning Yongil Kim Yerin Hwang Hyeongu Yun Seunghyun Yoon Trung Bui Kyomin Jung 19 6 0 15 Mar 2023
Cross-Linguistic Syntactic Difference in Multilingual BERT: How Good is It and How Does It Affect Transfer? Ningyu Xu Tao Gui Ruotian Ma Qi Zhang Jingting Ye Menghan Zhang Xuanjing Huang 30 13 0 21 Dec 2022
ALIGN-MLM: Word Embedding Alignment is Crucial for Multilingual Pre-training Henry Tang A. Deshpande Karthik Narasimhan 24 5 0 15 Nov 2022
Speaking Multiple Languages Affects the Moral Bias of Language Models Katharina Hämmerl Bjorn Deiseroth P. Schramowski Jindrich Libovický Constantin Rothkopf Alexander M. Fraser Kristian Kersting 27 31 0 14 Nov 2022
English Contrastive Learning Can Learn Universal Cross-lingual Sentence Embeddings Yau-Shian Wang Ashley Wu Graham Neubig SSL 27 31 0 11 Nov 2022
Third-Party Aligner for Neural Word Alignments Jinpeng Zhang C. Dong Xiangyu Duan Yuqi Zhang M. Zhang 17 0 0 08 Nov 2022
Multi-level Distillation of Semantic Knowledge for Pre-training Multilingual Language Model Mingqi Li Fei Ding Dan Zhang Long Cheng Hongxin Hu Feng Luo 33 6 0 02 Nov 2022
A Simple and Effective Method to Improve Zero-Shot Cross-Lingual Transfer Learning Kunbo Ding Weijie Liu Yuejian Fang Weiquan Mao Zhe Zhao Tao Zhu Haoyan Liu Rong Tian Yiren Chen 30 8 0 18 Oct 2022
IsoVec: Controlling the Relative Isomorphism of Word Embedding Spaces Kelly Marchisio Neha Verma Kevin Duh Philipp Koehn 18 6 0 11 Oct 2022
Massively Multilingual Lexical Specialization of Multilingual Transformers Tommaso Green Simone Paolo Ponzetto Goran Glavavs 22 0 0 01 Aug 2022