The Perspectivist Paradigm Shift: Assumptions and Challenges of Capturing Human Labels

9 May 2024

Papers citing "The Perspectivist Paradigm Shift: Assumptions and Challenges of Capturing Human Labels"

6 / 6 papers shown

Title
Correcting Annotator Bias in Training Data: Population-Aligned Instance Replication (PAIR) Stephanie Eckman Bolei Ma Christoph Kern Rob Chew Barbara Plank Frauke Kreuter 41 0 0 12 Jan 2025
Incorporating Worker Perspectives into MTurk Annotation Practices for NLP Olivia Huang Eve Fleisig Dan Klein 25 10 0 06 Nov 2023
The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practice Fernando Delgado Stephen Yang Michael A. Madaio Qian Yang 56 98 0 02 Oct 2023
Stop Measuring Calibration When Humans Disagree Joris Baan Wilker Aziz Barbara Plank Raquel Fernández 16 53 0 28 Oct 2022
Disembodied Machine Learning: On the Illusion of Objectivity in NLP Zeerak Talat Smarika Lulz Joachim Bingel Isabelle Augenstein 88 47 0 28 Jan 2021
Are We Modeling the Task or the Annotator? An Investigation of Annotator Bias in Natural Language Understanding Datasets Mor Geva Yoav Goldberg Jonathan Berant 232 319 0 21 Aug 2019