On the use of BERT for Neural Machine Translation

27 September 2019

Papers citing "On the use of BERT for Neural Machine Translation"

40 / 40 papers shown

Title
Encoder-Decoder Gemma: Improving the Quality-Efficiency Trade-Off via Adaptation Biao Zhang Fedor Moiseev Joshua Ainslie Paul Suganthan Min Ma Surya Bhupatiraju Fede Lebron Orhan Firat Armand Joulin Zhe Dong AI4CE 26 0 0 08 Apr 2025
From Idea to Implementation: Evaluating the Influence of Large Language Models in Software Development -- An Opinion Paper Sargam Yadav Asifa Mehmood Qureshi Abhishek Kaushik Shubham Sharma Roisin Loughran ... . Nikhil Singh Padraic O'Hara Pranay Jaiswal Roshan Chandru David Lillis 56 1 0 10 Mar 2025
FOCUS: Forging Originality through Contrastive Use in Self-Plagiarism for Language Models Kaixin Lan Tao Fang Derek F. Wong Yabo Xu Lidia S. Chao Cecilia G. Zhao 53 4 0 02 Jun 2024
Investigating Neural Machine Translation for Low-Resource Languages: Using Bavarian as a Case Study Wan-Hua Her Udo Kruschwitz 25 4 0 12 Apr 2024
Integrating Pre-trained Language Model into Neural Machine Translation Soon-Jae Hwang Chang-Sung Jeong 14 0 0 30 Oct 2023
Implementing BERT and fine-tuned RobertA to detect AI generated news by ChatGPT Zecong Wang Jiaxi Cheng Chen Cui Chenhao Yu DeLMO 10 15 0 09 Jun 2023
An Experimental Study on Pretraining Transformers from Scratch for IR Carlos Lassance Hervé Déjean S. Clinchant 18 11 0 25 Jan 2023
Optimizing Deep Transformers for Chinese-Thai Low-Resource Translation Wenjie Hao Hongfei Xu Lingling Mu Hongying Zan MoE 16 4 0 24 Dec 2022
Checks and Strategies for Enabling Code-Switched Machine Translation Thamme Gowda Mozhdeh Gheini Jonathan May 17 3 0 11 Oct 2022
Changing the Representation: Examining Language Representation for Neural Sign Language Production Harry Walsh Ben Saunders Richard Bowden SLR 14 25 0 16 Sep 2022
Artificial intelligence for topic modelling in Hindu philosophy: mapping themes between the Upanishads and the Bhagavad Gita Rohitash Chandra Mukul Ranjan AI4CE 11 12 0 23 May 2022
EdinSaar@WMT21: North-Germanic Low-Resource Multilingual NMT Svetlana Tchistiakova Jesujoba Oluwadara Alabi Koel Dutta Chowdhury Sourav Dutta Dana Ruiter VLM 28 6 0 29 Sep 2021
BERT, mBERT, or BiBERT? A Study on Contextualized Embeddings for Neural Machine Translation Haoran Xu Benjamin Van Durme Kenton W. Murray 42 57 0 09 Sep 2021
Masked Adversarial Generation for Neural Machine Translation Badr Youbi Idrissi S. Clinchant AAML 8 0 0 01 Sep 2021
Android Security using NLP Techniques: A Review Sevil Sen Burcu Can AAML 14 4 0 07 Jul 2021
BERTGEN: Multi-task Generation through BERT Faidon Mitzalis Ozan Caglayan Pranava Madhyastha Lucia Specia VLM 17 7 0 07 Jun 2021
BERTTune: Fine-Tuning Neural Machine Translation with BERTScore Inigo Jauregi Unanue Jacob Parnell Massimo Piccardi 13 32 0 04 Jun 2021
Prevent the Language Model from being Overconfident in Neural Machine Translation Mengqi Miao Fandong Meng Yijin Liu Xiao-Hua Zhou Jie Zhou 24 40 0 24 May 2021
From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understanding Rob van der Goot Ibrahim Sharaf Aizhan Imankulova A. Ustun Marija Stepanović Alan Ramponi Siti Oryza Khairunnisa Mamoru Komachi Barbara Plank 15 47 0 15 May 2021
Evaluating Pre-Trained Models for User Feedback Analysis in Software Engineering: A Study on Classification of App-Reviews M. Hadi Fatemeh H. Fard 11 30 0 12 Apr 2021
Better Neural Machine Translation by Extracting Linguistic Information from BERT Hassan S. Shavarani Anoop Sarkar 8 15 0 07 Apr 2021
Dynamic Curriculum Learning for Low-Resource Neural Machine Translation Chen Xu Bojie Hu Yufan Jiang Kai Feng Zeyang Wang Shen Huang Qi Ju Tong Xiao Jingbo Zhu 11 22 0 30 Nov 2020
BERT-JAM: Boosting BERT-Enhanced Neural Machine Translation with Joint Attention Zhebin Zhang Sai Wu Dawei Jiang Gang Chen 25 0 0 09 Nov 2020
Not all parameters are born equal: Attention is mostly what you need Nikolay Bogoychev MoE 14 7 0 22 Oct 2020
Multi-Style Transfer with Discriminative Feedback on Disjoint Corpus Navita Goyal Balaji Vasan Srinivasan Anandhavelu Natarajan Abhilasha Sancheti 20 20 0 22 Oct 2020
SJTU-NICT's Supervised and Unsupervised Neural Machine Translation Systems for the WMT20 News Translation Task Z. Li Hai Zhao Rui Wang Kehai Chen Masao Utiyama Eiichiro Sumita 29 15 0 11 Oct 2020
Energy-Based Reranking: Improving Neural Machine Translation Using Energy-Based Models Sumanta Bhattacharyya Pedram Rooshenas Subhajit Naskar Simeng Sun Mohit Iyyer Andrew McCallum 27 57 0 20 Sep 2020
Code-switching pre-training for neural machine translation Zhen Yang Bojie Hu Ambyera Han Shen Huang Qi Ju 17 71 0 17 Sep 2020
A Multilingual Neural Machine Translation Model for Biomedical Data Alexandre Berard Zae Myung Kim Vassilina Nikoulina Eunjeong Lucy Park Matthias Gallé 23 15 0 06 Aug 2020
HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training Linjie Li Yen-Chun Chen Yu Cheng Zhe Gan Licheng Yu Jingjing Liu MLLM VLM OffRL AI4TS 32 491 0 01 May 2020
Language Model Prior for Low-Resource Neural Machine Translation Christos Baziotis Barry Haddow Alexandra Birch 11 53 0 30 Apr 2020
An In-depth Walkthrough on Evolution of Neural Machine Translation Rohan Jagtap Sudhir N. Dhage 11 0 0 10 Apr 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 241 1,444 0 18 Mar 2020
BERT as a Teacher: Contextual Embeddings for Sequence-Level Reward Florian Schmidt Thomas Hofmann 32 8 0 05 Mar 2020
A Primer in BERTology: What we know about how BERT works Anna Rogers Olga Kovaleva Anna Rumshisky OffRL 25 1,450 0 27 Feb 2020
A Survey of Deep Learning Techniques for Neural Machine Translation Shu Yang Yuxin Wang X. Chu VLM AI4TS AI4CE 11 138 0 18 Feb 2020
Twitter Bot Detection Using Bidirectional Long Short-term Memory Neural Networks and Word Embeddings Feng Wei U. T. Nguyen 11 102 0 03 Feb 2020
A Survey on Document-level Neural Machine Translation: Methods and Evaluation Sameen Maruf Fahimeh Saleh Gholamreza Haffari AI4TS 12 23 0 18 Dec 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,943 0 20 Apr 2018
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Z. Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 716 6,724 0 26 Sep 2016