Cross-Lingual BERT Transformation for Zero-Shot Dependency Parsing

Conference on Empirical Methods in Natural Language Processing (EMNLP), 2019

15 September 2019

Papers citing "Cross-Lingual BERT Transformation for Zero-Shot Dependency Parsing"

50 / 67 papers shown

Title
ALGEN: Few-shot Inversion Attacks on Textual Embeddings using Alignment and Generation Yiyi Chen Qiongkai Xu Johannes Bjerva 357 4 0 16 Feb 2025
A survey of neural-network-based methods utilising comparable data for finding translation equivalents Michaela Denisová Pavel Rychlý 222 0 0 19 Oct 2024
Evaluating and explaining training strategies for zero-shot cross-lingual news sentiment analysis Luka Andrenšek Boshko Koloski Andraz Pelicon Nada Lavrac Senja Pollak Matthew Purver 243 2 0 30 Sep 2024
Can Machine Translation Bridge Multilingual Pretraining and Cross-lingual Transfer Learning? Shaoxiong Ji Timothee Mickus Vincent Segonne Jörg Tiedemann CLL 207 6 0 25 Mar 2024
Improving Cross-Lingual Transfer through Subtree-Aware Word Reordering Ofir Arviv Dmitry Nikolaev Taelin Karidi Omri Abend LRM 177 3 0 20 Oct 2023
I $^2$ KD-SLU: An Intra-Inter Knowledge Distillation Framework for Zero-Shot Cross-Lingual Spoken Language UnderstandingInternational Conference on Artificial Neural Networks (ICANN), 2023 Tianjun Mao Chenghong Zhang VLM 262 0 0 04 Oct 2023
Measuring Catastrophic Forgetting in Cross-Lingual Transfer Paradigms: Exploring Tuning Strategies Boshko Koloski Blaž Škrlj Marko Robnik-Šikonja Senja Pollak CLL 320 2 0 12 Sep 2023
Combating the Curse of Multilinguality in Cross-Lingual WSD by Aligning Sparse Contextualized Word RepresentationsNorth American Chapter of the Association for Computational Linguistics (NAACL), 2023 Gábor Berend 164 11 0 25 Jul 2023
Exploring the Relationship between Alignment and Cross-lingual Transfer in Multilingual TransformersAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Félix Gaschi Patricio Cerda Parisa Rastin Y. Toussaint 192 15 0 05 Jun 2023
Free Lunch: Robust Cross-Lingual Transfer via Model Checkpoint AveragingAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Fabian David Schmidt Ivan Vulić Goran Glavaš 153 11 0 26 May 2023
Fine-Tuning BERT with Character-Level Noise for Zero-Shot Transfer to Dialects and Closely-Related LanguagesWorkshop on NLP for Similar Languages, Varieties and Dialects (VarDial), 2023 Aarohi Srivastava David Chiang 256 12 0 30 Mar 2023
ALIGN-MLM: Word Embedding Alignment is Crucial for Multilingual Pre-training Henry Tang Ameet Deshpande Karthik Narasimhan 204 7 0 15 Nov 2022
IsoVec: Controlling the Relative Isomorphism of Word Embedding SpacesConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Kelly Marchisio Neha Verma Kevin Duh Philipp Koehn 272 8 0 11 Oct 2022
Mismatching-Aware Unsupervised Translation Quality Estimation For Low-Resource LanguagesLanguage Resources and Evaluation (LRE), 2022 Fatemeh Azadi Heshaam Faili M. Dousti 281 4 0 31 Jul 2022
Transfer Language Selection for Zero-Shot Cross-Lingual Abusive Language DetectionInformation Processing & Management (IPM), 2022 J. Eronen M. Ptaszynski Fumito Masui Masaki Arata Gniewosz Leliwa Michal Wroczynski 217 36 0 02 Jun 2022
Polyglot Prompt: Multilingual Multitask PrompTrainingConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Jinlan Fu See-Kiong Ng Pengfei Liu 154 13 0 29 Apr 2022
Por Qué Não Utiliser Alla Språk? Mixed Training with Gradient Optimization in Few-Shot Cross-Lingual Transfer Haoran Xu Kenton W. Murray 144 12 0 29 Apr 2022
Analyzing Gender Representation in Multilingual ModelsWorkshop on Representation Learning for NLP (RepL4NLP), 2022 Hila Gonen Shauli Ravfogel Yoav Goldberg 210 15 0 20 Apr 2022
Cross-Lingual Phrase RetrievalAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Heqi Zheng Xiao Zhang Zewen Chi Heyan Huang T. Yan Tian Lan Wei Wei Xian-Ling Mao RALM LRM 140 3 0 19 Apr 2022
GL-CLeF: A Global-Local Contrastive Learning Framework for Cross-lingual Spoken Language UnderstandingAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Libo Qin Qiguang Chen Tianbao Xie Qixin Li Jian-Guang Lou Wanxiang Che MingSung Kan 143 35 0 18 Apr 2022
The Impact of Cross-Lingual Adjustment of Contextual Word Representations on Zero-Shot TransferEuropean Conference on Information Retrieval (ECIR), 2022 Pavel Efimov Leonid Boytsov E. Arslanova Pavel Braslavski 164 10 0 13 Apr 2022
Combining Static and Contextualised Multilingual EmbeddingsFindings (Findings), 2022 Katharina Hämmerl Jindrich Libovický Kangyang Luo 209 16 0 17 Mar 2022
A new approach to calculating BERTScore for automatic assessment of translation quality A. Vetrov E. Gorn 218 2 0 10 Mar 2022
Multinational Address Parsing: A Zero-Shot Evaluation Marouane Yassine David Beauchemin Franccois Laviolette Luc Lamontagne 123 2 0 07 Dec 2021
NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentation Kaustubh D. Dhole Varun Gangal Sebastian Gehrmann Aadesh Gupta Zhenhao Li ... Tianbao Xie Usama Yaseen Michael A. Yee J. Zhang Yue Zhang 390 95 0 06 Dec 2021
Substructure Distribution Projection for Zero-Shot Cross-Lingual Dependency Parsing Freda Shi Kevin Gimpel Karen Livescu 286 9 0 16 Oct 2021
On the Relation between Syntactic Divergence and Zero-Shot PerformanceConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Ofir Arviv Dmitry Nikolaev Taelin Karidi Omri Abend 133 4 0 09 Oct 2021
Using Optimal Transport as Alignment Objective for fine-tuning Multilingual Contextualized Embeddings Sawsan Alqahtani Garima Lalwani Yi Zhang Salvatore Romeo Saab Mansour OT 121 28 0 06 Oct 2021
Self-Attentive Constituency Parsing for UCCA-based Semantic Parsing Necva Bölücü Burcu Can 104 6 0 01 Oct 2021
Mitigating Language-Dependent Ethnic Bias in BERT Jaimeen Ahn Alice Oh 434 120 0 13 Sep 2021
Examining Cross-lingual Contextual Embeddings with Orthogonal Structural ProbesConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Tomasz Limisiewicz David Marevcek 120 3 0 10 Sep 2021
Transfer Learning for Multi-lingual Tasks -- a Survey A. Jafari Behnam Heidary R. Farahbakhsh Mostafa Salehi Mahdi Jalili LRM 162 5 0 28 Aug 2021
Contributions of Transformer Attention Heads in Multi- and Cross-lingual Tasks Weicheng Ma Kai Zhang Renze Lou Lili Wang Soroush Vosoughi 730 19 0 18 Aug 2021
A Primer on Pretrained Multilingual Language Models Sumanth Doddapaneni Gowtham Ramesh Mitesh M. Khapra Anoop Kunchukuttan Pratyush Kumar LRM 193 83 0 01 Jul 2021
It's All in the Heads: Using Attention Heads as a Baseline for Cross-Lingual Transfer in Commonsense ReasoningFindings (Findings), 2021 Alexey Tikhonov Max Ryabinin LRM 186 72 0 22 Jun 2021
Consistency Regularization for Cross-Lingual Fine-Tuning Bo Zheng Li Dong Shaohan Huang Wenhui Wang Zewen Chi Saksham Singhal Wanxiang Che Ting Liu Xia Song Furu Wei 128 59 0 15 Jun 2021
Unsupervised Multilingual Sentence Embeddings for Parallel Corpus MiningAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Ivana Kvapilíková Mikel Artetxe Gorka Labaka Eneko Agirre Ondrej Bojar SSL 142 40 0 21 May 2021
Improving Cross-Lingual Reading Comprehension with Self-Training Wei-Ping Huang Chien-yu Huang Hung-yi Lee LRM 140 1 0 08 May 2021
Goldilocks: Just-Right Tuning of BERT for Technology-Assisted ReviewEuropean Conference on Information Retrieval (ECIR), 2021 Eugene Yang Sean MacAvaney D. Lewis O. Frieder 188 29 0 03 May 2021
X-METRA-ADA: Cross-lingual Meta-Transfer Learning Adaptation to Natural Language Understanding and Question AnsweringNorth American Chapter of the Association for Computational Linguistics (NAACL), 2021 Meryem M'hamdi Doo Soon Kim Franck Dernoncourt Trung Bui Xiang Ren Jonathan May 124 20 0 20 Apr 2021
The NLP Cookbook: Modern Recipes for Transformer based Deep Learning ArchitecturesIEEE Access (IEEE Access), 2021 Sushant Singh A. Mahmood AI4TS 269 113 0 23 Mar 2021
Zero-Shot Cross-Lingual Dependency Parsing through Contextual Embedding Transformation Haoran Xu Philipp Koehn 151 7 0 03 Mar 2021
El Volumen Louder Por Favor: Code-switching in Task-oriented Semantic ParsingConference of the European Chapter of the Association for Computational Linguistics (EACL), 2021 Arash Einolghozati Abhinav Arora Lorena Sainz-Maza Lecanda Anuj Kumar Sonal Gupta 228 10 0 26 Jan 2021
Evaluating Cross-Lingual Transfer Learning Approaches in Multilingual Conversational Agent Models Lizhen Tan O. Yu. Golovneva 299 2 0 07 Dec 2020
IndoLEM and IndoBERT: A Benchmark Dataset and Pre-trained Language Model for Indonesian NLPInternational Conference on Computational Linguistics (COLING), 2020 Fajri Koto Afshin Rahimi Jey Han Lau Timothy Baldwin 167 315 0 02 Nov 2020
Multilingual BERT Post-Pretraining AlignmentNorth American Chapter of the Association for Computational Linguistics (NAACL), 2020 Lin Pan Chung-Wei Hang Haode Qi Abhishek Shah Saloni Potdar Mo Yu 279 49 0 23 Oct 2020
Cross-Lingual Transfer in Zero-Shot Cross-Language Entity LinkingFindings (Findings), 2020 Elliot Schumacher J. Mayfield Mark Dredze 141 6 0 19 Oct 2020
It's not Greek to mBERT: Inducing Word-Level Translations from Multilingual BERTBlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP), 2020 Hila Gonen Shauli Ravfogel Yanai Elazar Yoav Goldberg 178 57 0 16 Oct 2020
Explicit Alignment Objectives for Multilingual Bidirectional Encoders Junjie Hu Melvin Johnson Orhan Firat Aditya Siddhant Graham Neubig 202 63 0 15 Oct 2020
Probing Pretrained Language Models for Lexical Semantics Ivan Vulić Edoardo Ponti Robert Litschko Goran Glavaš Anna Korhonen KELM 194 269 0 12 Oct 2020