Analyzing Dataset Annotation Quality Management in the Wild

16 July 2023

Papers citing "Analyzing Dataset Annotation Quality Management in the Wild"

12 / 12 papers shown

Title
Hands-On Tutorial: Labeling with LLM and Human-in-the-Loop Ekaterina Artemova Akim Tsvigun Dominik Schlechtweg Natalia Fedorova Konstantin Chernyshev Sergei Tilga Boris Obmoroshev SyDa VLM 119 0 0 28 Jan 2025
LLM Teacher-Student Framework for Text Classification With No Manually Annotated Data: A Case Study in IPTC News Topic Classification Taja Kuzman Nikola Ljubesic 72 0 0 29 Nov 2024
The Nature of NLP: Analyzing Contributions in NLP Papers Aniket Pramanick Yufang Hou Saif M. Mohammad Iryna Gurevych 23 1 0 29 Sep 2024
Let Guidelines Guide You: A Prescriptive Guideline-Centered Data Annotation Methodology Federico Ruggeri Eleonora Misino Arianna Muti Katerina Korre Paolo Torroni Alberto Barrón-Cedeño 34 0 0 20 Jun 2024
Missci: Reconstructing Fallacies in Misrepresented Science Max Glockner Yufang Hou Preslav Nakov Iryna Gurevych 40 4 0 05 Jun 2024
On Efficient and Statistical Quality Estimation for Data Annotation Jan-Christoph Klie Juan Haladjian Marc Kirchner Rahul Nair 17 1 0 20 May 2024
Natural Language Processing RELIES on Linguistics Juri Opitz Shira Wein Nathan Schneider AI4CE 44 7 0 09 May 2024
Toxic language detection: a systematic review of Arabic datasets Imene Bensalem Paolo Rosso Hanane Zitouni 25 4 0 12 Dec 2023
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 308 11,915 0 04 Mar 2022
Hatemoji: A Test Suite and Adversarially-Generated Dataset for Benchmarking and Detecting Emoji-based Hate Hannah Rose Kirk B. Vidgen Paul Röttger Tristan Thrush Scott A. Hale 65 57 0 12 Aug 2021
Beyond Fair Pay: Ethical Implications of NLP Crowdsourcing Boaz Shmueli Jan Fell Soumya Ray Lun-Wei Ku 103 86 0 20 Apr 2021
Are We Modeling the Task or the Annotator? An Investigation of Annotator Bias in Natural Language Understanding Datasets Mor Geva Yoav Goldberg Jonathan Berant 237 319 0 21 Aug 2019