Unicoder: A Universal Language Encoder by Pre-training with Multiple Cross-lingual Tasks

3 September 2019

Papers citing "Unicoder: A Universal Language Encoder by Pre-training with Multiple Cross-lingual Tasks"

41 / 41 papers shown

Title
A Recipe of Parallel Corpora Exploitation for Multilingual Large Language Models Peiqin Lin André F. T. Martins Hinrich Schütze 51 2 0 29 Jun 2024
Composing Object Relations and Attributes for Image-Text Matching Khoi Pham Chuong Huynh Ser-Nam Lim Abhinav Shrivastava CoGe 38 3 0 17 Jun 2024
Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback Viet Dac Lai Chien Van Nguyen Nghia Trung Ngo Thuat Nguyen Franck Dernoncourt Ryan A. Rossi Thien Huu Nguyen ALM 40 128 0 29 Jul 2023
Modeling Sequential Sentence Relation to Improve Cross-lingual Dense Retrieval Shunyu Zhang Yaobo Liang Ming Gong Daxin Jiang Nan Duan 21 4 0 03 Feb 2023
Advancing Multilingual Pre-training: TRIP Triangular Document-level Pre-training for Multilingual Language Models Hongyuan Lu Haoyang Huang Shuming Ma Dongdong Zhang W. Lam Furu Wei 22 4 0 15 Dec 2022
Multi-level Distillation of Semantic Knowledge for Pre-training Multilingual Language Model Mingqi Li Fei Ding Dan Zhang Long Cheng Hongxin Hu Feng Luo 33 6 0 02 Nov 2022
A Simple and Effective Method to Improve Zero-Shot Cross-Lingual Transfer Learning Kunbo Ding Weijie Liu Yuejian Fang Weiquan Mao Zhe Zhao Tao Zhu Haoyan Liu Rong Tian Yiren Chen 30 8 0 18 Oct 2022
Multi-stage Distillation Framework for Cross-Lingual Semantic Similarity Matching Kunbo Ding Weijie Liu Yuejian Fang Zhe Zhao Qi Ju Xuefeng Yang 20 1 0 13 Sep 2022
Mismatching-Aware Unsupervised Translation Quality Estimation For Low-Resource Languages Fatemeh Azadi Heshaam Faili M. Dousti 15 4 0 31 Jul 2022
mGPT: Few-Shot Learners Go Multilingual Oleh Shliazhko Alena Fenogenova Maria Tikhonova Vladislav Mikhailov Anastasia Kozlova Tatiana Shavrina 43 148 0 15 Apr 2022
Learning to Generalize to More: Continuous Semantic Augmentation for Neural Machine Translation Xiangpeng Wei Heng Yu Yue Hu Rongxiang Weng Weihua Luo Jun Xie Rong Jin CLL 15 24 0 14 Apr 2022
Cross-Lingual Ability of Multilingual Masked Language Models: A Study of Language Structure Yuan Chai Yaobo Liang Nan Duan LRM 27 21 0 16 Mar 2022
CINO: A Chinese Minority Pre-trained Language Model Ziqing Yang Zihang Xu Yiming Cui Baoxin Wang Min-Bin Lin Dayong Wu Zhigang Chen 21 25 0 28 Feb 2022
NoisyTune: A Little Noise Can Help You Finetune Pretrained Language Models Better Chuhan Wu Fangzhao Wu Tao Qi Yongfeng Huang Xing Xie 25 58 0 24 Feb 2022
From Good to Best: Two-Stage Training for Cross-lingual Machine Reading Comprehension Nuo Chen Linjun Shou Ming Gong Jian Pei Daxin Jiang 24 16 0 09 Dec 2021
Uni-Perceiver: Pre-training Unified Architecture for Generic Perception for Zero-shot and Few-shot Tasks Xizhou Zhu Jinguo Zhu Hao Li Xiaoshi Wu Xiaogang Wang Hongsheng Li Xiaohua Wang Jifeng Dai 47 129 0 02 Dec 2021
Improved Multilingual Language Model Pretraining for Social Media Text via Translation Pair Prediction Shubhanshu Mishra A. Haghighi VLM 18 4 0 20 Oct 2021
SlovakBERT: Slovak Masked Language Model Matúš Pikuliak Stefan Grivalsky Martin Konopka Miroslav Blšták Martin Tamajka Viktor Bachratý Marián Simko Pavol Balázik Michal Trnka Filip Uhlárik 27 25 0 30 Sep 2021
Efficient Test Time Adapter Ensembling for Low-resource Language Varieties Xinyi Wang Yulia Tsvetkov Sebastian Ruder Graham Neubig 30 34 0 10 Sep 2021
Learning from Multiple Noisy Augmented Data Sets for Better Cross-Lingual Spoken Language Understanding Yingmei Guo Linjun Shou J. Pei Ming Gong Mingxing Xu Zhiyong Wu Daxin Jiang 24 5 0 03 Sep 2021
PARADISE: Exploiting Parallel Data for Multilingual Sequence-to-Sequence Pretraining Machel Reid Mikel Artetxe VLM 42 26 0 04 Aug 2021
A Primer on Pretrained Multilingual Language Models Sumanth Doddapaneni Gowtham Ramesh Mitesh M. Khapra Anoop Kunchukuttan Pratyush Kumar LRM 43 73 0 01 Jul 2021
Specializing Multilingual Language Models: An Empirical Study Ethan C. Chau Noah A. Smith 25 27 0 16 Jun 2021
Pre-Trained Models: Past, Present and Future Xu Han Zhengyan Zhang Ning Ding Yuxian Gu Xiao Liu ... Jie Tang Ji-Rong Wen Jinhui Yuan Wayne Xin Zhao Jun Zhu AIFin MQ AI4MH 37 813 0 14 Jun 2021
Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment Zewen Chi Li Dong Bo Zheng Shaohan Huang Xian-Ling Mao Heyan Huang Furu Wei 45 67 0 11 Jun 2021
Reinforced Iterative Knowledge Distillation for Cross-Lingual Named Entity Recognition Shining Liang Ming Gong J. Pei Linjun Shou Wanli Zuo Xianglin Zuo Daxin Jiang 31 34 0 01 Jun 2021
SILT: Efficient transformer training for inter-lingual inference Javier Huertas-Tato Alejandro Martín David Camacho 19 11 0 17 Mar 2021
Code-Mixing on Sesame Street: Dawn of the Adversarial Polyglots Samson Tan Shafiq R. Joty AAML 21 35 0 17 Mar 2021
Multilingual Multimodal Pre-training for Zero-Shot Cross-Lingual Transfer of Vision-Language Models Po-Yao (Bernie) Huang Mandela Patrick Junjie Hu Graham Neubig Florian Metze Alexander G. Hauptmann MLLM VLM 21 56 0 16 Mar 2021
Unsupervised Cross-lingual Adaptation for Sequence Tagging and Beyond Xin Li Lidong Bing Wenxuan Zhang Zheng Li Wai Lam 42 25 0 23 Oct 2020
FILTER: An Enhanced Fusion Method for Cross-lingual Language Understanding Yuwei Fang Shuohang Wang Zhe Gan S. Sun Jingjing Liu VLM 21 58 0 10 Sep 2020
On Learning Language-Invariant Representations for Universal Machine Translation Hao Zhao Junjie Hu Andrej Risteski 29 8 0 11 Aug 2020
ConvBERT: Improving BERT with Span-based Dynamic Convolution Zihang Jiang Weihao Yu Daquan Zhou Yunpeng Chen Jiashi Feng Shuicheng Yan 32 156 0 06 Aug 2020
CoSDA-ML: Multi-Lingual Code-Switching Data Augmentation for Zero-Shot Cross-Lingual NLP Libo Qin Minheng Ni Yue Zhang Wanxiang Che 30 149 0 11 Jun 2020
Are All Languages Created Equal in Multilingual BERT? Shijie Wu Mark Dredze 8 316 0 18 May 2020
Translation Artifacts in Cross-lingual Transfer Learning Mikel Artetxe Gorka Labaka Eneko Agirre 19 114 0 09 Apr 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 243 1,450 0 18 Mar 2020
On the Cross-lingual Transferability of Monolingual Representations Mikel Artetxe Sebastian Ruder Dani Yogatama 28 771 0 25 Oct 2019
Unicoder-VL: A Universal Encoder for Vision and Language by Cross-modal Pre-training Gen Li Nan Duan Yuejian Fang Ming Gong Daxin Jiang Ming Zhou SSL VLM MLLM 57 895 0 16 Aug 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 297 6,956 0 20 Apr 2018
Word Translation Without Parallel Data Alexis Conneau Guillaume Lample MarcÁurelio Ranzato Ludovic Denoyer Hervé Jégou 171 1,635 0 11 Oct 2017