Multilingual Alignment of Contextual Word Representations

10 February 2020

Papers citing "Multilingual Alignment of Contextual Word Representations"

50 / 128 papers shown

Title
Mismatching-Aware Unsupervised Translation Quality Estimation For Low-Resource Languages Fatemeh Azadi Heshaam Faili M. Dousti 15 4 0 31 Jul 2022
The Geometry of Multilingual Language Model Representations Tyler A. Chang Z. Tu Benjamin Bergen 16 56 0 22 May 2022
Label-aware Multi-level Contrastive Learning for Cross-lingual Spoken Language Understanding Shining Liang Linjun Shou Jian Pei Ming Gong Wanli Zuo Xianglin Zuo Daxin Jiang 25 7 0 07 May 2022
Same Neurons, Different Languages: Probing Morphosyntax in Multilingual Pre-trained Models Karolina Stañczak E. Ponti Lucas Torroba Hennigen Ryan Cotterell Isabelle Augenstein MILM LRM 25 10 0 04 May 2022
Analyzing Gender Representation in Multilingual Models Hila Gonen Shauli Ravfogel Yoav Goldberg 15 11 0 20 Apr 2022
The Impact of Cross-Lingual Adjustment of Contextual Word Representations on Zero-Shot Transfer Pavel Efimov Leonid Boytsov E. Arslanova Pavel Braslavski 22 7 0 13 Apr 2022
Parameter-Efficient Neural Reranking for Cross-Lingual and Multilingual Retrieval Robert Litschko Ivan Vulić Goran Glavavs LRM 29 13 0 05 Apr 2022
Combining Static and Contextualised Multilingual Embeddings Katharina Hämmerl Jindrich Libovický Alexander M. Fraser 25 10 0 17 Mar 2022
Overlap-based Vocabulary Generation Improves Cross-lingual Transfer Among Related Languages Vaidehi Patil Partha P. Talukdar Sunita Sarawagi 8 21 0 03 Mar 2022
Cross-Lingual Text Classification with Multilingual Distillation and Zero-Shot-Aware Training Ziqing Yang Yiming Cui Zhigang Chen Shijin Wang VLM 19 3 0 28 Feb 2022
CINO: A Chinese Minority Pre-trained Language Model Ziqing Yang Zihang Xu Yiming Cui Baoxin Wang Min-Bin Lin Dayong Wu Zhigang Chen 21 25 0 28 Feb 2022
USCORE: An Effective Approach to Fully Unsupervised Evaluation Metrics for Machine Translation Jonas Belouadi Steffen Eger 31 20 0 21 Feb 2022
Do Transformers know symbolic rules, and would we know if they did? Tommi Gröndahl Yu-Wen Guo Nirmal Asokan 25 0 0 19 Feb 2022
Constrained Density Matching and Modeling for Cross-lingual Alignment of Contextualized Representations Wei-Ye Zhao Steffen Eger 21 1 0 31 Jan 2022
On Cross-Lingual Retrieval with Multilingual Text Encoders Robert Litschko Ivan Vulić Simone Paolo Ponzetto Goran Glavavs 11 38 0 21 Dec 2021
DPRK-BERT: The Supreme Language Model Arda Akdemir Yeojoo Jeon OffRL 9 1 0 01 Dec 2021
When is BERT Multilingual? Isolating Crucial Ingredients for Cross-lingual Transfer A. Deshpande Partha P. Talukdar Karthik Narasimhan 17 38 0 27 Oct 2021
Improved Multilingual Language Model Pretraining for Social Media Text via Translation Pair Prediction Shubhanshu Mishra A. Haghighi VLM 18 4 0 20 Oct 2021
mLUKE: The Power of Entity Representations in Multilingual Pretrained Language Models Ryokan Ri Ikuya Yamada Yoshimasa Tsuruoka 23 30 0 15 Oct 2021
Global Explainability of BERT-Based Evaluation Metrics by Disentangling along Linguistic Factors Marvin Kaster Wei-Ye Zhao Steffen Eger 19 24 0 08 Oct 2021
Using Optimal Transport as Alignment Objective for fine-tuning Multilingual Contextualized Embeddings Sawsan Alqahtani Garima Lalwani Yi Zhang Salvatore Romeo Saab Mansour OT 31 25 0 06 Oct 2021
Sequential Reptile: Inter-Task Gradient Alignment for Multilingual Learning Seanie Lee Haebeom Lee Juho Lee S. Hwang MoMe CLL 38 16 0 06 Oct 2021
Investigating Post-pretraining Representation Alignment for Cross-Lingual Question Answering Fahim Faisal Antonios Anastasopoulos 29 4 0 24 Sep 2021
Cross-Lingual Language Model Meta-Pretraining Zewen Chi Heyan Huang Luyang Liu Yu Bai Xian-Ling Mao LRM 68 0 0 23 Sep 2021
Cross-Lingual Text Classification of Transliterated Hindi and Malayalam Jitin Krishnan Antonios Anastasopoulos Hemant Purohit Huzefa Rangwala 13 15 0 31 Aug 2021
Changes in European Solidarity Before and During COVID-19: Evidence from a Large Crowd- and Expert-Annotated Twitter Dataset A. Ils Dan Liu Daniela Grunow Steffen Eger 21 8 0 02 Aug 2021
Cross-lingual Transferring of Pre-trained Contextualized Language Models Zuchao Li Kevin Parnow Hai Zhao Zhuosheng Zhang Rui Wang Masao Utiyama Eiichiro Sumita 13 8 0 27 Jul 2021
A Primer on Pretrained Multilingual Language Models Sumanth Doddapaneni Gowtham Ramesh Mitesh M. Khapra Anoop Kunchukuttan Pratyush Kumar LRM 43 73 0 01 Jul 2021
Revisiting the Primacy of English in Zero-shot Cross-lingual Transfer Iulia Turc Kenton Lee Jacob Eisenstein Ming-Wei Chang Kristina Toutanova 24 58 0 30 Jun 2021
XLM-E: Cross-lingual Language Model Pre-training via ELECTRA Zewen Chi Shaohan Huang Li Dong Shuming Ma Bo Zheng ... Payal Bajaj Xia Song Xian-Ling Mao Heyan Huang Furu Wei 48 118 0 30 Jun 2021
Specializing Multilingual Language Models: An Empirical Study Ethan C. Chau Noah A. Smith 25 27 0 16 Jun 2021
Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment Zewen Chi Li Dong Bo Zheng Shaohan Huang Xian-Ling Mao Heyan Huang Furu Wei 45 67 0 11 Jun 2021
Exploiting Language Relatedness for Low Web-Resource Language Model Adaptation: An Indic Languages Study Yash Khemchandani Sarvesh Mehtani Vaidehi Patil Abhijeet Awasthi Partha P. Talukdar Sunita Sarawagi 19 32 0 07 Jun 2021
Combining Static Word Embeddings and Contextual Representations for Bilingual Lexicon Induction Jinpeng Zhang Baijun Ji Nini Xiao Xiangyu Duan Min Zhang Yangbin Shi Weihua Luo 26 22 0 06 Jun 2021
Bilingual Alignment Pre-Training for Zero-Shot Cross-Lingual Transfer Ziqing Yang Wentao Ma Yiming Cui Jiani Ye Wanxiang Che Shijin Wang 23 11 0 03 Jun 2021
Unsupervised Multilingual Sentence Embeddings for Parallel Corpus Mining Ivana Kvapilíková Mikel Artetxe Gorka Labaka Eneko Agirre Ondrej Bojar SSL 11 36 0 21 May 2021
MT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs Zewen Chi Li Dong Shuming Ma Shaohan Huang Xian-Ling Mao Heyan Huang Furu Wei LRM 45 71 0 18 Apr 2021
Improving Zero-Shot Cross-Lingual Transfer Learning via Robust Training Kuan-Hao Huang Wasi Uddin Ahmad Nanyun Peng Kai-Wei Chang AAML 89 34 0 17 Apr 2021
Crossing the Conversational Chasm: A Primer on Natural Language Processing for Multilingual Task-Oriented Dialogue Systems E. Razumovskaia Goran Glavavs Olga Majewska E. Ponti Anna Korhonen Ivan Vulić 18 32 0 17 Apr 2021
Towards Multi-Sense Cross-Lingual Alignment of Contextual Embeddings Linlin Liu Thien Hai Nguyen Shafiq R. Joty Lidong Bing Luo Si 35 5 0 11 Mar 2021
LightMBERT: A Simple Yet Effective Method for Multilingual BERT Distillation Xiaoqi Jiao Yichun Yin Lifeng Shang Xin Jiang Xiao Chen Linlin Li Fang Wang Qun Liu 19 9 0 11 Mar 2021
Majority Voting with Bidirectional Pre-translation For Bitext Retrieval Alex Jones Derry Wijaya 14 6 0 10 Mar 2021
El Volumen Louder Por Favor: Code-switching in Task-oriented Semantic Parsing Arash Einolghozati Abhinav Arora Lorena Sainz-Maza Lecanda Anuj Kumar Sonal Gupta 35 9 0 26 Jan 2021
Evaluating Multilingual Text Encoders for Unsupervised Cross-Lingual Retrieval Robert Litschko Ivan Vulić Simone Paolo Ponzetto Goran Glavavs 13 23 0 21 Jan 2021
Word Alignment by Fine-tuning Embeddings on Parallel Corpora Zi-Yi Dou Graham Neubig 96 257 0 20 Jan 2021
Probing Multilingual BERT for Genetic and Typological Signals Taraka Rama Lisa Beinborn Steffen Eger 14 24 0 04 Nov 2020
Learning Contextualised Cross-lingual Word Embeddings and Alignments for Extremely Low-Resource Languages Using Parallel Corpora Takashi Wada Tomoharu Iwata Yuji Matsumoto Timothy Baldwin Jey Han Lau 25 6 0 27 Oct 2020
Multilingual BERT Post-Pretraining Alignment Lin Pan Chung-Wei Hang Haode Qi Abhishek Shah Saloni Potdar Mo Yu 103 44 0 23 Oct 2020
Unsupervised Cross-lingual Adaptation for Sequence Tagging and Beyond Xin Li Lidong Bing Wenxuan Zhang Zheng Li Wai Lam 42 25 0 23 Oct 2020
A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarios Michael A. Hedderich Lukas Lange Heike Adel Jannik Strötgen Dietrich Klakow 196 286 0 23 Oct 2020