What does Attention in Neural Machine Translation Pay Attention to?

9 October 2017

Papers citing "What does Attention in Neural Machine Translation Pay Attention to?"

16 / 16 papers shown

Title
ReLU's Revival: On the Entropic Overload in Normalization-Free Large Language Models N. Jha Brandon Reagen OffRL AI4CE 33 0 0 12 Oct 2024
Training-free Diffusion Model Adaptation for Variable-Sized Text-to-Image Synthesis Zhiyu Jin Xuli Shen Bin Li Xiangyang Xue 24 36 0 14 Jun 2023
Word Alignment in the Era of Deep Learning: A Tutorial Bryan Li 29 5 0 30 Nov 2022
Understanding How Encoder-Decoder Architectures Attend Kyle Aitken V. Ramasesh Yuan Cao Niru Maheswaranathan 26 17 0 28 Oct 2021
Interpreting Deep Learning Models in Natural Language Processing: A Review Xiaofei Sun Diyi Yang Xiaoya Li Tianwei Zhang Yuxian Meng Han Qiu Guoyin Wang Eduard H. Hovy Jiwei Li 17 44 0 20 Oct 2021
What do End-to-End Speech Models Learn about Speaker, Language and Channel Information? A Layer-wise and Neuron-level Analysis Shammur A. Chowdhury Nadir Durrani Ahmed M. Ali 25 12 0 01 Jul 2021
Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment Zewen Chi Li Dong Bo Zheng Shaohan Huang Xian-Ling Mao Heyan Huang Furu Wei 45 67 0 11 Jun 2021
Accurate Word Alignment Induction from Neural Machine Translation Yun-Nung Chen Yang Liu Guanhua Chen Xin Jiang Qun Liu 26 60 0 30 Apr 2020
SimAlign: High Quality Word Alignments without Parallel Training Data using Static and Contextualized Embeddings Masoud Jalili Sabet Philipp Dufter François Yvon Hinrich Schütze 23 226 0 18 Apr 2020
Pointer-based Fusion of Bilingual Lexicons into Neural Machine Translation Jetic Gū Hassan S. Shavarani Anoop Sarkar 16 4 0 17 Sep 2019
Analyzing the Structure of Attention in a Transformer Language Model Jesse Vig Yonatan Belinkov 19 357 0 07 Jun 2019
An Analysis of Attention Mechanisms: The Case of Word Sense Disambiguation in Neural Machine Translation Gongbo Tang Rico Sennrich Joakim Nivre 11 84 0 17 Oct 2018
An Operation Sequence Model for Explainable Neural Machine Translation Felix Stahlberg Danielle Saunders Bill Byrne LRM MILM 29 29 0 29 Aug 2018
Six Challenges for Neural Machine Translation Philipp Koehn Rebecca Knowles AAML AIMat 210 1,207 0 12 Jun 2017
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Z. Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 716 6,743 0 26 Sep 2016
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 218 7,923 0 17 Aug 2015