The Curious Case of Hallucinations in Neural Machine Translation

14 April 2021

Papers citing "The Curious Case of Hallucinations in Neural Machine Translation"

50 / 129 papers shown

Title
SoK: Memorization in General-Purpose Large Language Models Valentin Hartmann Anshuman Suri Vincent Bindschaedler David E. Evans Shruti Tople Robert West KELM LLMAG 16 20 0 24 Oct 2023
Hallucination Detection for Grounded Instruction Generation Lingjun Zhao Khanh Nguyen Hal Daumé HILM 33 7 0 23 Oct 2023
Fidelity-Enriched Contrastive Search: Reconciling the Faithfulness-Diversity Trade-Off in Text Generation Wei-Lin Chen Cheng-Kuang Wu Hsin-Hsi Chen Chung-Chi Chen HILM 20 6 0 23 Oct 2023
LUNA: A Model-Based Universal Analysis Framework for Large Language Models Da Song Xuan Xie Jiayang Song Derui Zhu Yuheng Huang Felix Juefei Xu Lei Ma ALM 27 3 0 22 Oct 2023
Steering Large Language Models for Machine Translation with Finetuning and In-Context Learning Duarte M. Alves Nuno M. Guerreiro Joao Alves José P. Pombal Ricardo Rei José G. C. de Souza Pierre Colombo André F.T. Martins 45 49 0 20 Oct 2023
An Empirical Study of Translation Hypothesis Ensembling with Large Language Models António Farinhas José G. C. de Souza André F. T. Martins 28 8 0 17 Oct 2023
Who Are All The Stochastic Parrots Imitating? They Should Tell Us! Sagi Shaier Lawrence E Hunter K. Wense 34 3 0 16 Oct 2023
xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detection Nuno M. Guerreiro Ricardo Rei Daan van Stigt Luísa Coheur Pierre Colombo André F.T. Martins 40 111 0 16 Oct 2023
KCTS: Knowledge-Constrained Tree Search Decoding with Token-Level Hallucination Detection Sehyun Choi Tianqing Fang Zhaowei Wang Yangqiu Song 30 32 0 13 Oct 2023
A New Benchmark and Reverse Validation Method for Passage-level Hallucination Detection Shiping Yang Renliang Sun Xiao-Yi Wan HILM 32 41 0 10 Oct 2023
The Troubling Emergence of Hallucination in Large Language Models -- An Extensive Definition, Quantification, and Prescriptive Remediations Vipula Rawte Swagata Chakraborty Agnibh Pathak Anubhav Sarkar S.M. Towhidul Islam Tonmoy Aman Chadha Mikel Artetxe Punit Daniel Simig HILM 32 119 0 08 Oct 2023
Mitigating Hallucinations and Off-target Machine Translation with Source-Contrastive and Language-Contrastive Decoding Rico Sennrich Jannis Vamvas Alireza Mohammadshahi HILM 25 38 0 13 Sep 2023
Cognitive Mirage: A Review of Hallucinations in Large Language Models Hongbin Ye Tong Liu Aijia Zhang Wei Hua Weiqiang Jia HILM 37 76 0 13 Sep 2023
Knowledge Solver: Teaching LLMs to Search for Domain Knowledge from Knowledge Graphs Chao Feng Xinyu Zhang Zichu Fei KELM 25 44 0 06 Sep 2023
Donkii: Can Annotation Error Detection Methods Find Errors in Instruction-Tuning Datasets? Leon Weber-Genzel Robert Litschko Ekaterina Artemova Barbara Plank 16 2 0 04 Sep 2023
Benchmarking Large Language Models in Retrieval-Augmented Generation Jiawei Chen Hongyu Lin Xianpei Han Le Sun 3DV RALM 13 260 0 04 Sep 2023
Improving Translation Faithfulness of Large Language Models via Augmenting Instructions Yijie Chen Yanjun Liu Fandong Meng Yufeng Chen Jinan Xu Jie Zhou 28 25 0 24 Aug 2023
Generating Faithful Text From a Knowledge Graph with Noisy Reference Text Tahsina Hashem Weiqing Wang Derry Wijaya Mohammed Eunus Ali Yuan-Fang Li 24 3 0 12 Aug 2023
Tackling Hallucinations in Neural Chart Summarization Saad Obaid ul Islam Iza vSkrjanec Ondrej Dusek Vera Demberg HILM 29 7 0 01 Aug 2023
HAGRID: A Human-LLM Collaborative Dataset for Generative Information-Seeking with Attribution Ehsan Kamalloo A. Jafari Xinyu Crystina Zhang Nandan Thakur Jimmy J. Lin 24 41 0 31 Jul 2023
Neural Machine Translation Data Generation and Augmentation using ChatGPT Wayne Yang Garrett Nicolai 37 6 0 11 Jul 2023
BLEURT Has Universal Translations: An Analysis of Automatic Metrics by Minimum Risk Training Yiming Yan Tao Wang Chengqi Zhao Shujian Huang Jiajun Chen Mingxuan Wang 19 22 0 06 Jul 2023
The Two Word Test: A Semantic Benchmark for Large Language Models Nicholas Riccardi Rutvik H. Desai ELM 20 5 0 07 Jun 2023
Why Does Zero-Shot Cross-Lingual Generation Fail? An Explanation and a Solution Tianjian Li Kenton W. Murray 35 23 0 27 May 2023
Measuring and Mitigating Constraint Violations of In-Context Learning for Utterance-to-API Semantic Parsing Shufan Wang Sébastien Jean Sailik Sengupta James Gung Nikolaos Pappas Yi Zhang 31 6 0 24 May 2023
PURR: Efficiently Editing Language Model Hallucinations by Denoising Language Model Corruptions Anthony Chen Panupong Pasupat Sameer Singh Hongrae Lee Kelvin Guu 32 40 0 24 May 2023
Leveraging GPT-4 for Automatic Translation Post-Editing Vikas Raunak Amr Sharaf Yiren Wang H. Awadallah Arul Menezes 11 62 0 24 May 2023
How Language Model Hallucinations Can Snowball Muru Zhang Ofir Press William Merrill Alisa Liu Noah A. Smith HILM LRM 82 253 0 22 May 2023
Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Models Oana Ignat Zhijing Jin Artem Abzaliev Laura Biester Santiago Castro ... Verónica Pérez-Rosas Siqi Shen Zekun Wang Winston Wu Rada Mihalcea LRM 31 6 0 21 May 2023
HalOmi: A Manually Annotated Benchmark for Multilingual Hallucination and Omission Detection in Machine Translation David Dale Elena Voita Janice Lam Prangthip Hansanti C. Ropers Elahe Kalbassi Cynthia Gao Loïc Barrault Marta R. Costa-jussá HILM 32 27 0 19 May 2023
Progressive Translation: Improving Domain Robustness of Neural Machine Translation with Intermediate Sequences Chaojun Wang Y. Liu Wai Lam 31 2 0 16 May 2023
Evaluating Inter-Bilingual Semantic Parsing for Indian Languages Divyanshu Aggarwal V. Gupta Anoop Kunchukuttan 38 3 0 25 Apr 2023
An Evaluation on Large Language Model Outputs: Discourse and Memorization Adrian de Wynter Xun Wang Alex Sokolov Qilong Gu Si-Qing Chen ELM 79 32 0 17 Apr 2023
WebBrain: Learning to Generate Factually Correct Articles for Queries by Grounding on Large Web Corpus Hongjing Qian Yutao Zhu Zhicheng Dou Haoqi Gu Xinyu Zhang Zheng Liu Ruofei Lai Zhao Cao J. Nie Ji-Rong Wen 38 25 0 10 Apr 2023
Elastic Weight Removal for Faithful and Abstractive Dialogue Generation Nico Daheim Nouha Dziri Mrinmaya Sachan Iryna Gurevych E. Ponti MoMe 28 30 0 30 Mar 2023
Hallucinations in Large Multilingual Translation Models Nuno M. Guerreiro Duarte M. Alves Jonas Waldendorf Barry Haddow Alexandra Birch Pierre Colombo André F.T. Martins VLM HILM LRM 22 140 0 28 Mar 2023
Almanac: Retrieval-Augmented Language Models for Clinical Medicine C. Zakka Akash Chaurasia R. Shad Alex R. Dalal Jennifer L. Kim ... Kathleen Boyd Karen Hirsch C. Langlotz Joanna Nelson W. Hiesinger LM&MA 102 143 0 01 Mar 2023
How Good Are GPT Models at Machine Translation? A Comprehensive Evaluation Amr Hendy M. Abdelrehim Amr Sharaf Vikas Raunak Mohamed Gabr Hitokazu Matsushita Young Jin Kim Mohamed Afify Hany Awadalla ELM LM&MA AI4CE 29 412 0 18 Feb 2023
Learning with Rejection for Abstractive Text Summarization Mengyao Cao Yue Dong Jingyi He Jackie C.K. Cheung 23 8 0 16 Feb 2023
Understanding and Detecting Hallucinations in Neural Machine Translation via Model Introspection Weijia Xu Sweta Agrawal Eleftheria Briakou Marianna J. Martindale Marine Carpuat HILM 21 46 0 18 Jan 2023
Optimal Transport for Unsupervised Hallucination Detection in Neural Machine Translation Nuno M. Guerreiro Pierre Colombo Pablo Piantanida André F.T. Martins 25 10 0 19 Dec 2022
Detecting and Mitigating Hallucinations in Machine Translation: Model Internal Workings Alone Do Well, Sentence Similarity Even Better David Dale Elena Voita Loïc Barrault Marta R. Costa-jussá HILM 30 67 0 16 Dec 2022
Harnessing Knowledge and Reasoning for Human-Like Natural Language Generation: A Brief Review Jiangjie Chen Yanghua Xiao 44 4 0 07 Dec 2022
Rank-One Editing of Encoder-Decoder Models Vikas Raunak Arul Menezes KELM 21 10 0 23 Nov 2022
Converge to the Truth: Factual Error Correction via Iterative Constrained Editing Jiangjie Chen Rui Xu Wenyuan Zeng Changzhi Sun Lei Li Yanghua Xiao KELM 38 9 0 22 Nov 2022
Reducing Hallucinations in Neural Machine Translation with Feature Attribution Joel Tang M. Fomicheva Lucia Specia HILM 9 7 0 17 Nov 2022
Finding Memo: Extractive Memorization in Constrained Sequence Generation Tasks Vikas Raunak Arul Menezes 30 13 0 24 Oct 2022
RuCoLA: Russian Corpus of Linguistic Acceptability Vladislav Mikhailov T. Shamardina Max Ryabinin A. Pestova I. Smurov Ekaterina Artemova 25 28 0 23 Oct 2022
N-Best Hypotheses Reranking for Text-To-SQL Systems Lu Zeng S. Parthasarathi Dilek Z. Hakkani-Tür 13 21 0 19 Oct 2022
Understanding Transformer Memorization Recall Through Idioms Adi Haviv Ido Cohen Jacob Gidron R. Schuster Yoav Goldberg Mor Geva 28 48 0 07 Oct 2022