On the Origin of Hallucinations in Conversational Models: Is it the Datasets or the Models?

North American Chapter of the Association for Computational Linguistics (NAACL), 2022

17 April 2022

Nouha Dziri

Sivan Milton

Mo Yu

Osmar Zaiane

Siva Reddy

HILM

ArXiv (abs)PDF HTML

Papers citing "On the Origin of Hallucinations in Conversational Models: Is it the Datasets or the Models?"

50 / 126 papers shown

Title
Explainability of Large Language Models: Opportunities and Challenges toward Generating Trustworthy Explanations Shahin Atakishiyev H. Babiker Jiayi Dai Nawshad Farruque Teruaki Hayashi ... Md Abed Rahman Iain Smith Mi-Young Kim Osmar R. Zaïane Randy Goebel LRM 137 0 0 20 Oct 2025
Beyond Correctness: Rewarding Faithful Reasoning in Retrieval-Augmented Generation Zhichao Xu Zongyu Wu Yun Zhou Aosong Feng Kang Zhou ... Yijun Tian Xuan Qi Weikang Qiu Lin Lee Cheong Haibo Ding OffRL RALM LRM 124 0 0 15 Oct 2025
Multi-stage Prompt Refinement for Mitigating Hallucinations in Large Language Models Jung-Woo Shim Yeong-Joon Ju Ji-Hoon Park Seong-Whan Lee LRM 88 0 0 14 Oct 2025
Distributional Semantics Tracing: A Framework for Explaining Hallucinations in Large Language Models Gagan Bhatia Somayajulu G Sripada Kevin Allan Jacobo Azcona HILM LRM 262 0 0 07 Oct 2025
When Models Lie, We Learn: Multilingual Span-Level Hallucination Detection with PsiloQA Elisei Rykov Kseniia Petrushina Maksim Savkin Valerii Olisov Artem Vazhentsev Kseniia Titova Ilseyar Alimova Vasily Konovalov Julia Belikova HILM 157 2 0 06 Oct 2025
We Think, Therefore We Align LLMs to Helpful, Harmless and Honest Before They Go Wrong Gautam Siddharth Kashyap Mark Dras Usman Naseem LLMSV 171 1 0 26 Sep 2025
LongRecall: A Structured Approach for Robust Recall Evaluation in Long-Form Text MohamamdJavad Ardestani Ehsan Kamalloo Davood Rafiei 92 1 0 20 Aug 2025
Can LLMs Generate High-Quality Task-Specific Conversations? Shengqi Li Amarnath Gupta LM&MA 146 0 0 04 Aug 2025
Counterfactual Probing for Hallucination Detection and Mitigation in Large Language Models Yijun Feng HILM 78 3 0 03 Aug 2025
Trust the Model: Compact VLMs as In-Context Judges for Image-Text Data Quality Daulet Toibazar Kesen Wang Sherif Mohamed Abdulaziz Al-Badawi Abdulrahman Alfulayt Pedro J. Moreno VLM 175 0 0 27 Jul 2025
Retrieval Augmented Generation-based Large Language Models for Bridging Transportation Cybersecurity Legal Knowledge Gaps Khandakar Ashrafi Akbar Md Nahiyan Uddin Latifur Khan Trayce Hockstad Mizanur Rahman M. Chowdhury B. Thuraisingham AILaw RALM 365 0 0 23 May 2025
SAFE: Improving LLM Systems using Sentence-Level In-generation Attribution João Eduardo Batista Emil Vatai Mohamed Wahib 418 0 0 19 May 2025
Invoke Interfaces Only When Needed: Adaptive Invocation for Large Language Models in Question AnsweringConference on Empirical Methods in Natural Language Processing (EMNLP), 2025 Jihao Zhao Chunlai Zhou Daixuan Li Shuaishuai Zu Biao Qin 295 0 0 05 May 2025
Why and How LLMs Hallucinate: Connecting the Dots with Subsequence Associations Yiyou Sun Y. Gai Lijie Chen Abhilasha Ravichander Yejin Choi Basel Alomair HILM 324 10 0 17 Apr 2025
Bián: A Bilingual Benchmark and Model for Hallucination Detection in Retrieval-Augmented Generation Zhouyu Jiang Mengshu Sun Qing Cui Lei Liang RALM 3DV 650 1 0 26 Feb 2025
ATEB: Evaluating and Improving Advanced NLP Tasks for Text Embedding Models Simeng Han Frank Palma Gomez Tu Vu Zefei Li Daniel Cer Hansi Zeng Chris Tar Arman Cohan Gustavo Hernández Ábrego 259 5 0 24 Feb 2025
VERITAS: A Unified Approach to Reliability Evaluation Rajkumar Ramamurthy Meghana Arakkal Rajeev Oliver Molenschot James Zou Nazneen Rajani HILM 228 1 0 05 Nov 2024
Exploring the Knowledge Mismatch Hypothesis: Hallucination Propensity in Small Models Fine-tuned on Data from Larger Models Phil Wee Riyadh Baghdadi HILM 194 1 0 31 Oct 2024
No Free Lunch: Fundamental Limits of Learning Non-Hallucinating Generative ModelsInternational Conference on Learning Representations (ICLR), 2024 Changlong Wu A. Grama Wojciech Szpankowski 164 3 0 24 Oct 2024
Do Robot Snakes Dream like Electric Sheep? Investigating the Effects of Architectural Inductive Biases on HallucinationAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Jerry Huang Prasanna Parthasarathi Mehdi Rezagholizadeh Boxing Chen Sarath Chandar 502 3 0 22 Oct 2024
Adaptive Question Answering: Enhancing Language Model Proficiency for Addressing Knowledge Conflicts with Source CitationsConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Sagi Shaier Ari Kobren Philip Ogren HILM 303 16 0 05 Oct 2024
Decoding Hate: Exploring Language Models' Reactions to Hate SpeechNorth American Chapter of the Association for Computational Linguistics (NAACL), 2024 Paloma Piot Javier Parapar 243 5 0 01 Oct 2024
SAC-KG: Exploiting Large Language Models as Skilled Automatic Constructors for Domain Knowledge GraphsAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Hanzhu Chen Xu Shen Qitan Lv Jie Wang Xiaoqi Ni Jieping Ye 173 25 0 22 Sep 2024
VERA: Validation and Enhancement for Retrieval Augmented systems Nitin Aravind Birur Tanay Baswa Divyanshu Kumar Jatan Loya Sahil Agarwal P. Harshangi VLM RALM 164 1 0 18 Sep 2024
ProSLM : A Prolog Synergized Language Model for explainable Domain Specific Knowledge Based Question AnsweringInternational Workshop on Neural-Symbolic Learning and Reasoning (NeSy), 2024 Priyesh Vakharia Abigail Kufeldt Max Meyers Ian Lane Leilani H. Gilpin 160 4 0 17 Sep 2024
Training Language Models on the Knowledge Graph: Insights on Hallucinations and Their Detectability Jiri Hron Laura J. Culp Gamaleldin F. Elsayed Rosanne Liu Ben Adlam ... T. Warkentin Lechao Xiao Kelvin Xu Jasper Snoek Simon Kornblith 141 3 0 14 Aug 2024
Development of REGAI: Rubric Enabled Generative Artificial Intelligence Zach Johnson Jeremy Straub 159 1 0 05 Aug 2024
Dancing in Chains: Reconciling Instruction Following and Faithfulness in Language Models Zhengxuan Wu Yuhao Zhang Linquan Wei Yumo Xu Rujun Han Yi Liu Jifan Chen Bonan Min Zhiheng Huang 251 0 0 31 Jul 2024
Enhancing Agent Learning through World Dynamics Modeling Zhiyuan Sun Haochen Shi Marc-Alexandre Côté Glen Berseth Xingdi Yuan Bang Liu 318 6 0 25 Jul 2024
From Sands to Mansions: Towards Automated Cyberattack Emulation with Classical Planning and Large Language Models Lingzhi Wang Zhenyuan Li Zonghan Guo Yi Jiang Kyle Jung Kedar Thiagarajan Jiahui Wang Zhengkai Wang Emily Wei Xiangmin Shen 257 0 0 24 Jul 2024
Multilingual Fine-Grained News Headline Hallucination Detection Jiaming Shen Tianqi Liu Jialu Liu Zhen Qin Jay Pavagadhi Simon Baumgartner Michael Bendersky 165 0 0 22 Jul 2024
Questionable practices in machine learning Gavin Leech Juan J. Vazquez Misha Yagudin Niclas Kupper Laurence Aitchison 244 6 0 17 Jul 2024
Look Within, Why LLMs Hallucinate: A Causal Perspective He Li Haoang Chi Mingyu Liu Wenjing Yang LRM 161 10 0 14 Jul 2024
Good Intentions, Risky Inventions: A Method for Assessing the Risks and Benefits of AI in Mobile and Wearable Uses Marios Constantinides Edyta Bogucka S. Šćepanović Daniele Quercia 316 13 0 12 Jul 2024
Lynx: An Open Source Hallucination Evaluation Model Selvan Sunitha Ravi B. Mielczarek Anand Kannappan Douwe Kiela Rebecca Qian VLM RALM HILM 262 41 0 11 Jul 2024
Knowledge Overshadowing Causes Amalgamated Hallucination in Large Language Models Yuji Zhang Sha Li Jiateng Liu Pengfei Yu Yi R. Fung Jing Li Pengfei Yu Heng Ji 326 27 0 10 Jul 2024
PFME: A Modular Approach for Fine-grained Hallucination Detection and Editing of Large Language Models Kunquan Deng Zeyu Huang Chen Li Chenghua Lin Min Gao Wenge Rong KELM 165 2 0 29 Jun 2024
Benchmarking Uncertainty Quantification Methods for Large Language Models with LM-Polygraph Roman Vashurin Ekaterina Fadeeva Artem Vazhentsev Akim Tsvigun Daniil Vasilev ... Timothy Baldwin Timothy Baldwin Preslav Nakov Maxim Panov Artem Shelmanov HILM 617 59 0 21 Jun 2024
Mitigating Large Language Model Hallucination with Faithful Finetuning Minda Hu Bowei He Yufei Wang Liangyou Li Chen Ma Irwin King HILM 251 20 0 17 Jun 2024
Detecting Response Generation Not Requiring Factual JudgmentNorth American Chapter of the Association for Computational Linguistics (NAACL), 2024 Ryohei Kamei Daiki Shiono Reina Akama Jun Suzuki HILM 127 0 0 14 Jun 2024
Post-Hoc Answer Attribution for Grounded and Trustworthy Long Document Comprehension: Task, Insights, and Challenges Abhilasha Sancheti Koustava Goswami Balaji Vasan Srinivasan RALM 222 4 0 11 Jun 2024
Confabulation: The Surprising Value of Large Language Model HallucinationsAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Peiqi Sui Eamon Duede Sophie Wu Richard Jean So HILM LLMAG 213 37 0 06 Jun 2024
Position: Cracking the Code of Cascading Disparity Towards Marginalized Communities G. Farnadi Mohammad Havaei Negar Rostamzadeh 292 3 0 03 Jun 2024
Luna: An Evaluation Foundation Model to Catch Language Model Hallucinations with High Accuracy and Low Cost Masha Belyi Robert Friel Shuai Shao Atindriyo Sanyal HILM RALM 385 8 0 03 Jun 2024
SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales Tianyang Xu Shujin Wu Shizhe Diao Xiaoze Liu Xingyao Wang Yangyi Chen Jing Gao LRM 352 72 0 31 May 2024
ANAH: Analytical Annotation of Hallucinations in Large Language Models Ziwei Ji Yuzhe Gu Wenwei Zhang Chengqi Lyu Dahua Lin Kai-xiang Chen HILM 192 8 0 30 May 2024
CHARP: Conversation History AwaReness Probing for Knowledge-grounded Dialogue Systems Abbas Ghaddar David Alfonso-Hermelo Philippe Langlais Mehdi Rezagholizadeh Boxing Chen Prasanna Parthasarathi 176 1 0 24 May 2024
Retrieval-Augmented Language Model for Extreme Multi-Label Knowledge Graph Link Prediction Yu-Hsiang Lin Huang-Ting Shieh Chih-Yu Liu Kuang-Ting Lee Hsiao-Cheng Chang Jing-Lun Yang Yu-Sheng Lin LRM KELM RALM 222 2 0 21 May 2024
Attribute First, then Generate: Locally-attributable Grounded Text Generation Aviv Slobodkin Eran Hirsch Arie Cattan Tal Schuster Ido Dagan 358 44 0 25 Mar 2024
AI on AI: Exploring the Utility of GPT as an Expert Annotator of AI Publications Autumn Toney-Wails C. Schoeberl James Dunham 173 5 0 14 Mar 2024