SemEval-2024 Shared Task 6: SHROOM, a Shared-task on Hallucinations and
Related Observable Overgeneration Mistakes

SemEval-2024 Shared Task 6: SHROOM, a Shared-task on Hallucinations and Related Observable Overgeneration Mistakes

12 March 2024

Timothee Mickus

Jörg Tiedemann

Vincent Segonne

Alessandro Raganato

Marianna Apidianaki

Papers citing "SemEval-2024 Shared Task 6: SHROOM, a Shared-task on Hallucinations and Related Observable Overgeneration Mistakes"

7 / 7 papers shown

Title
Can LLMs Detect Intrinsic Hallucinations in Paraphrasing and Machine Translation? Evangelia Gogoulou Shorouq Zahra Liane Guillou Luise Dürlich Joakim Nivre HILM LRM 100 0 0 29 Apr 2025
SemEval-2025 Task 3: Mu-SHROOM, the Multilingual Shared Task on Hallucinations and Related Observable Overgeneration Mistakes Raúl Vázquez Timothee Mickus Elaine Zosa Teemu Vahtola Jörg Tiedemann ... Liane Guillou Ona de Gibert Jaione Bengoetxea Joseph Attieh Marianna Apidianaki HILM VLM LRM 85 0 0 16 Apr 2025
SmurfCat at SemEval-2024 Task 6: Leveraging Synthetic Data for Hallucination Detection Elisei Rykov Yana Shishkina Kseniia Petrushina Kseniia Titova Sergey Petrakov Alexander Panchenko 19 1 0 09 Apr 2024
SLPL SHROOM at SemEval2024 Task 06: A comprehensive study on models ability to detect hallucination Pouya Fallah S. Gooran Mohammad Jafarinasab Pouya Sadeghi Reza Farnia Amirreza Tarabkhah Zainab Sadat Taghavi Hossein Sameti HILM 34 3 0 07 Apr 2024
MALTO at SemEval-2024 Task 6: Leveraging Synthetic Data for LLM Hallucination Detection Federico Borra Claudio Savelli Giacomo Rosso Alkis Koudounas F. Giobergia HILM 21 3 0 01 Mar 2024
Evaluating Attribution in Dialogue Systems: The BEGIN Benchmark Nouha Dziri Hannah Rashkin Tal Linzen David Reitter ALM 185 79 0 30 Apr 2021
A Token-level Reference-free Hallucination Detection Benchmark for Free-form Text Generation Tianyu Liu Yizhe Zhang Chris Brockett Yi Mao Zhifang Sui Weizhu Chen W. Dolan HILM 217 143 0 18 Apr 2021