v1v2 (latest)

Looking for a Needle in a Haystack: A Comprehensive Study of Hallucinations in Neural Machine Translation

Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2022

10 August 2022

Nuno M. Guerreiro

Elena Voita

André F. T. Martins

HILM

ArXiv (abs)PDF HTML HuggingFace (1 upvotes)

Papers citing "Looking for a Needle in a Haystack: A Comprehensive Study of Hallucinations in Neural Machine Translation"

45 / 45 papers shown

Title
Large Language Models Hallucination: A Comprehensive Survey Aisha Alansari Hamzah Luqman HILM LRM 393 1 0 05 Oct 2025
Beyond Token Probes: Hallucination Detection via Activation Tensors with ACT-ViT Guy Bar-Shalom Fabrizio Frasca Yaniv Galron Yftah Ziser Haggai Maron MLLM 115 0 0 30 Sep 2025
Neural Message-Passing on Attention Graphs for Hallucination Detection Fabrizio Frasca Guy Bar-Shalom Yftah Ziser Haggai Maron 100 0 0 29 Sep 2025
Control the Temperature: Selective Sampling for Diverse and High-Quality LLM Outputs S. Troshin Wafaa Mohammed Yan Meng Christof Monz Antske Fokkens Vlad Niculae 88 2 0 20 Sep 2025
Real-Time Detection of Hallucinated Entities in Long-Form Generation Oscar Obeso Andy Arditi Javier Ferrando Joshua Freeman Cameron Holmes Neel Nanda HILM 149 5 0 26 Aug 2025
SECOND: Mitigating Perceptual Hallucination in Vision-Language Models via Selective and Contrastive Decoding Woohyeon Park Woojin Kim Jaeik Kim Jaeyoung Do VLM 119 6 0 10 Jun 2025
Shaking to Reveal: Perturbation-Based Detection of LLM Hallucinations Jinyuan Luo Zhen Fang Shouqing Yang Seongheon Park Ling Chen AAML HILM 197 0 0 03 Jun 2025
Uncertainty Quantification for Language Models: A Suite of Black-Box, White-Box, LLM Judge, and Ensemble Scorers Dylan Bouchard Mohit Singh Chauhan HILM 482 4 0 27 Apr 2025
TRA: Better Length Generalisation with Threshold Relative Attention Mattia Opper Roland Fernandez P. Smolensky Jianfeng Gao 468 1 0 29 Mar 2025
Beyond Next Token Probabilities: Learnable, Fast Detection of Hallucinations and Data Contamination on LLM Output Distributions Guy Bar-Shalom Fabrizio Frasca Derek Lim Yoav Gelberg Yftah Ziser Ran El-Yaniv Gal Chechik Haggai Maron 374 2 0 18 Mar 2025
Beyond Decoder-only: Large Language Models Can be Good Encoders for Machine TranslationAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Yingfeng Luo Tong Zheng Yongyu Mu Yangqiu Song Qinghong Zhang ... Ziqiang Xu Peinan Feng Xiaoqian Liu Tong Xiao Jingbo Zhu AI4CE 998 9 0 09 Mar 2025
HalluEntity: Benchmarking and Understanding Entity-Level Hallucination Detection Min-Hsuan Yeh Max Kamachee Seongheon Park Yixuan Li HILM 385 7 0 17 Feb 2025
Investigating Factuality in Long-Form Text Generation: The Roles of Self-Known and Self-Unknown Lifu Tu Rui Meng Shafiq Joty Yingbo Zhou Semih Yavuz HILM 248 1 0 24 Nov 2024
LLMs Know More Than They Show: On the Intrinsic Representation of LLM HallucinationsInternational Conference on Learning Representations (ICLR), 2024 Hadas Orgad Michael Toker Zorik Gekhman Roi Reichart Idan Szpektor Hadas Kotek Yonatan Belinkov HILM AIFin 595 106 0 03 Oct 2024
Locret: Enhancing Eviction in Long-Context LLM Inference with Trained Retaining Heads on Consumer-Grade Devices Yuxiang Huang Binhang Yuan Xu Han Chaojun Xiao Zhiyuan Liu RALM 388 10 0 02 Oct 2024
HaloScope: Harnessing Unlabeled LLM Generations for Hallucination DetectionNeural Information Processing Systems (NeurIPS), 2024 Xuefeng Du Chaowei Xiao Yixuan Li HILM 220 56 0 26 Sep 2024
Model Tells You Where to Merge: Adaptive KV Cache Merging for LLMs on Long-Context Tasks Zheng Wang Boxiao Jin Zhongzhi Yu Minjia Zhang MoMe 240 56 0 11 Jul 2024
A Probabilistic Framework for LLM Hallucination Detection via Belief Tree Propagation Bairu Hou Yang Zhang Jacob Andreas Shiyu Chang 258 16 0 11 Jun 2024
2M-NER: Contrastive Learning for Multilingual and Multimodal NER with Language and Modal Fusion Dongsheng Wang Xiaoqin Feng Zeming Liu Chuan Wang 130 8 0 26 Apr 2024
ERBench: An Entity-Relationship based Automatically Verifiable Hallucination Benchmark for Large Language ModelsNeural Information Processing Systems (NeurIPS), 2024 Jio Oh Soyeon Kim Junseok Seo Yongfeng Zhang Ruochen Xu Xing Xie Steven Euijong Whang 164 11 0 08 Mar 2024
Non-Fluent Synthetic Target-Language Data Improve Neural Machine TranslationIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023 Víctor M. Sánchez-Cartagena Miquel Espla-Gomis J. A. Pérez-Ortiz F. Sánchez-Martínez 137 8 0 29 Jan 2024
Contrastive Learning and Mixture of Experts Enables Precise Vector Embeddings Logan Hallee Rohan Kapur Arjun Patel Jason P. Gleghorn Bohdan B. Khomtchouk MoE 117 4 0 28 Jan 2024
Hallucination is Inevitable: An Innate Limitation of Large Language Models Ziwei Xu Sanjay Jain Mohan S. Kankanhalli HILM LRM 545 436 0 22 Jan 2024
On Early Detection of Hallucinations in Factual Question Answering Ben Snyder Marius Moisescu Muhammad Bilal Zafar HILM 314 50 0 19 Dec 2023
xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error DetectionTransactions of the Association for Computational Linguistics (TACL), 2023 Nuno M. Guerreiro Ricardo Rei Daan van Stigt Luísa Coheur Pierre Colombo André F.T. Martins 353 228 0 16 Oct 2023
Teaching Language Models to Hallucinate Less with Synthetic TasksInternational Conference on Learning Representations (ICLR), 2023 Erik Jones Hamid Palangi Clarisse Simoes Varun Chandrasekaran Subhabrata Mukherjee Arindam Mitra Ahmed Hassan Awadallah Ece Kamar HILM 320 38 0 10 Oct 2023
Mitigating Hallucinations and Off-target Machine Translation with Source-Contrastive and Language-Contrastive DecodingConference of the European Chapter of the Association for Computational Linguistics (EACL), 2023 Rico Sennrich Jannis Vamvas Alireza Mohammadshahi HILM 421 51 0 13 Sep 2023
Cognitive Mirage: A Review of Hallucinations in Large Language Models Hongbin Ye Tong Liu Aijia Zhang Wei Hua Weiqiang Jia HILM 329 110 0 13 Sep 2023
Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language ModelsComputational Linguistics (CL), 2023 Yue Zhang Yafu Li Leyang Cui Deng Cai Lemao Liu ... Longyue Wang Anh Tuan Luu Freda Shi Shuming Shi Shuming Shi LRM RALM HILM 622 780 0 03 Sep 2023
Uncertainty in Natural Language Generation: From Theory to Applications Joris Baan Nico Daheim Evgenia Ilia Dennis Ulmer Haau-Sing Li Raquel Fernández Barbara Plank Rico Sennrich Chrysoula Zerva Wilker Aziz UQLM 440 63 0 28 Jul 2023
Towards Explainable Evaluation Metrics for Machine TranslationJournal of machine learning research (JMLR), 2023 Christoph Leiter Piyawat Lertvittayakumjorn M. Fomicheva Wei Zhao Yang Gao Steffen Eger ELM 264 23 0 22 Jun 2023
Explicit Syntactic Guidance for Neural Text GenerationAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Yafu Li Leyang Cui Jianhao Yan Yongjng Yin Wei Bi Shuming Shi Yue Zhang 171 10 0 20 Jun 2023
On Evaluating Multilingual Compositional Generalization with Translated DatasetsAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Zi Wang Daniel Hershcovich 297 8 0 20 Jun 2023
Leveraging GPT-4 for Automatic Translation Post-EditingConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Vikas Raunak Amr Sharaf Yiren Wang H. Awadallah Arul Menezes 176 86 0 24 May 2023
The Inside Story: Towards Better Understanding of Machine Translation Neural Evaluation MetricsAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Ricardo Rei Nuno M. Guerreiro Marcos Vinícius Treviso Luísa Coheur A. Lavie André F.T. Martins 188 16 0 19 May 2023
HalOmi: A Manually Annotated Benchmark for Multilingual Hallucination and Omission Detection in Machine TranslationConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 David Dale Elena Voita Janice Lam Prangthip Hansanti C. Ropers Elahe Kalbassi Cynthia Gao Loïc Barrault Marta R. Costa-jussá HILM 326 35 0 19 May 2023
Progressive Translation: Improving Domain Robustness of Neural Machine Translation with Intermediate SequencesAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Chaojun Wang Zehua Wang Wai Lam 156 2 0 16 May 2023
Simple Token-Level Confidence Improves Caption CorrectnessIEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2023 Suzanne Petryk Spencer Whitehead Joseph E. Gonzalez Trevor Darrell Anna Rohrbach Marcus Rohrbach 212 10 0 11 May 2023
Hallucinations in Large Multilingual Translation ModelsTransactions of the Association for Computational Linguistics (TACL), 2023 Nuno M. Guerreiro Duarte M. Alves Jonas Waldendorf Barry Haddow Alexandra Birch Pierre Colombo André F.T. Martins VLM HILM LRM 344 190 0 28 Mar 2023
Translate your gibberish: black-box adversarial attack on machine translation systemsJournal of Mathematical Sciences (J. Math. Sci.), 2023 Andrei Chertkov Olga Tsymboi Mikhail Aleksandrovich Pautov Ivan Oseledets AAML 129 6 0 20 Mar 2023
Understanding and Detecting Hallucinations in Neural Machine Translation via Model IntrospectionTransactions of the Association for Computational Linguistics (TACL), 2023 Weijia Xu Sweta Agrawal Eleftheria Briakou Marianna J. Martindale Marine Carpuat HILM 157 60 0 18 Jan 2023
ChatGPT Makes Medicine Easy to Swallow: An Exploratory Case Study on Simplified Radiology ReportsEuropean Radiology (Eur Radiol), 2022 Katharina Jeblick B. Schachtner Jakob Dexl Andreas Mittermeier Anna Theresa Stüber ... Tobias Weber Philipp Wesp B. Sabel J. Ricke Michael Ingrisch LM&MA MedIm 284 467 0 30 Dec 2022
Optimal Transport for Unsupervised Hallucination Detection in Neural Machine TranslationAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Nuno M. Guerreiro Pierre Colombo Pablo Piantanida André F.T. Martins 254 11 0 19 Dec 2022
Detecting and Mitigating Hallucinations in Machine Translation: Model Internal Workings Alone Do Well, Sentence Similarity Even BetterAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 David Dale Elena Voita Loïc Barrault Marta R. Costa-jussá HILM 416 87 0 16 Dec 2022
Rare but Severe Neural Machine Translation Errors Induced by Minimal Deletion: An Empirical Study on Chinese and EnglishInternational Conference on Computational Linguistics (COLING), 2022 Ruikang Shi Alvin Grissom II D. Trinh 149 3 0 05 Sep 2022