Understanding and Detecting Hallucinations in Neural Machine Translation via Model Introspection

18 January 2023

Weijia Xu

Sweta Agrawal

Eleftheria Briakou

Marianna J. Martindale

Marine Carpuat

HILM

ArXiv PDF HTML

Papers citing "Understanding and Detecting Hallucinations in Neural Machine Translation via Model Introspection"

31 / 31 papers shown

Title
Controlling Large Language Model with Latent Actions Chengxing Jia Ziniu Li Pengyuan Wang Yi-Chen Li Zhenyu Hou Yuxiao Dong Y. Yu 56 0 0 27 Mar 2025
QE4PE: Word-level Quality Estimation for Human Post-Editing Gabriele Sarti Vilém Zouhar Grzegorz Chrupała Ana Guerberof Arenas Malvina Nissim Arianna Bisazza 41 0 0 04 Mar 2025
Evaluating the Accuracy of Chatbots in Financial Literature Orhan Erdem Kristi Hassett Feyzullah Egriboyun 34 0 0 11 Nov 2024
Machine Translation Hallucination Detection for Low and High Resource Languages using Large Language Models Kenza Benkirane Laura Gongas Shahar Pelles Naomi Fuchs Joshua Darmon Pontus Stenetorp David Ifeoluwa Adelani Eduardo Sánchez HILM 38 4 0 23 Jul 2024
Teaching LLMs to Abstain across Languages via Multilingual Feedback Shangbin Feng Weijia Shi Yike Wang Wenxuan Ding Orevaoghene Ahia Shuyue Stella Li Vidhisha Balachandran Sunayana Sitaram Yulia Tsvetkov 67 4 0 22 Jun 2024
Benchmarking Uncertainty Quantification Methods for Large Language Models with LM-Polygraph Roman Vashurin Ekaterina Fadeeva Artem Vazhentsev Akim Tsvigun Daniil Vasilev ... Timothy Baldwin Timothy Baldwin Maxim Panov Artem Shelmanov Artem Shelmanov HILM 66 8 0 21 Jun 2024
Towards Detecting LLMs Hallucination via Markov Chain-based Multi-agent Debate Framework Xiaoxi Sun Jinpeng Li Yan Zhong Dongyan Zhao Rui Yan LLMAG HILM 29 5 0 05 Jun 2024
What Have We Achieved on Non-autoregressive Translation? Yafu Li Huajian Zhang Jianhao Yan Yongjing Yin Yue Zhang 31 1 0 21 May 2024
Low-resource neural machine translation with morphological modeling Antoine Nzeyimana 27 3 0 03 Apr 2024
Unfamiliar Finetuning Examples Control How Language Models Hallucinate Katie Kang Eric Wallace Claire Tomlin Aviral Kumar Sergey Levine HILM LRM 35 49 0 08 Mar 2024
Generative AI for Synthetic Data Generation: Methods, Challenges and the Future Xu Guo Yiqiang Chen SyDa 21 30 0 07 Mar 2024
Successfully Guiding Humans with Imperfect Instructions by Highlighting Potential Errors and Suggesting Corrections Lingjun Zhao Khanh Nguyen Hal Daumé 33 1 0 26 Feb 2024
Structured Chain-of-Thought Prompting for Few-Shot Generation of Content-Grounded QA Conversations M. Sultan Jatin Ganhotra Ramón Fernández Astudillo LRM 24 3 0 19 Feb 2024
Comparing Hallucination Detection Metrics for Multilingual Generation Haoqiang Kang Terra Blevins Luke Zettlemoyer HILM 32 16 0 16 Feb 2024
Non-Fluent Synthetic Target-Language Data Improve Neural Machine Translation Víctor M. Sánchez-Cartagena Miquel Espla-Gomis J. A. Pérez-Ortiz F. Sánchez-Martínez 24 4 0 29 Jan 2024
Large Legal Fictions: Profiling Legal Hallucinations in Large Language Models Matthew Dahl Varun Magesh Mirac Suzgun Daniel E. Ho HILM AILaw 25 73 0 02 Jan 2024
Do Androids Know They're Only Dreaming of Electric Sheep? Sky CH-Wang Benjamin Van Durme Jason Eisner Chris Kedzie HILM 22 27 0 28 Dec 2023
Calibrated Language Models Must Hallucinate Adam Tauman Kalai Santosh Vempala HILM 22 75 0 24 Nov 2023
Enhancing Uncertainty-Based Hallucination Detection with Stronger Focus Tianhang Zhang Lin Qiu Qipeng Guo Cheng Deng Yue Zhang Zheng-Wei Zhang Cheng Zhou Xinbing Wang Luoyi Fu HILM 75 48 0 22 Nov 2023
Think While You Write: Hypothesis Verification Promotes Faithful Knowledge-to-Text Generation Yifu Qiu Varun R. Embar Shay B. Cohen Benjamin Han 21 4 0 16 Nov 2023
Investigating Hallucinations in Pruned Large Language Models for Abstractive Summarization G. Chrysostomou Zhixue Zhao Miles Williams Nikolaos Aletras HILM 34 10 0 15 Nov 2023
Fine-tuning Language Models for Factuality Katherine Tian Eric Mitchell Huaxiu Yao Christopher D. Manning Chelsea Finn KELM HILM SyDa 17 166 0 14 Nov 2023
LM-Polygraph: Uncertainty Estimation for Language Models Ekaterina Fadeeva Roman Vashurin Akim Tsvigun Artem Vazhentsev Sergey Petrakov ... Elizaveta Goncharova Alexander Panchenko Maxim Panov Timothy Baldwin Artem Shelmanov 17 47 0 13 Nov 2023
Hallucination Detection for Grounded Instruction Generation Lingjun Zhao Khanh Nguyen Hal Daumé HILM 33 7 0 23 Oct 2023
An Empirical Study of Translation Hypothesis Ensembling with Large Language Models António Farinhas José G. C. de Souza André F. T. Martins 28 8 0 17 Oct 2023
Two Approaches to Supervised Image Segmentation Alexandre Benatti L. D. F. Costa 20 2 0 19 Jul 2023
Leveraging GPT-4 for Automatic Translation Post-Editing Vikas Raunak Amr Sharaf Yiren Wang H. Awadallah Arul Menezes 11 62 0 24 May 2023
HalOmi: A Manually Annotated Benchmark for Multilingual Hallucination and Omission Detection in Machine Translation David Dale Elena Voita Janice Lam Prangthip Hansanti C. Ropers Elahe Kalbassi Cynthia Gao Loïc Barrault Marta R. Costa-jussá HILM 32 27 0 19 May 2023
Hallucinations in Large Multilingual Translation Models Nuno M. Guerreiro Duarte M. Alves Jonas Waldendorf Barry Haddow Alexandra Birch Pierre Colombo André F.T. Martins VLM HILM LRM 20 140 0 28 Mar 2023
Inseq: An Interpretability Toolkit for Sequence Generation Models Gabriele Sarti Nils Feldhus Ludwig Sickert Oskar van der Wal Malvina Nissim Arianna Bisazza 30 64 0 27 Feb 2023
A causal framework for explaining the predictions of black-box sequence-to-sequence models David Alvarez-Melis Tommi Jaakkola CML 224 201 0 06 Jul 2017