Goldilocks: Consistent Crowdsourced Scalar Annotations with Relative Uncertainty

4 August 2021

Papers citing "Goldilocks: Consistent Crowdsourced Scalar Annotations with Relative Uncertainty"

5 / 5 papers shown

Title
Negotiative Alignment: Embracing Disagreement to Achieve Fairer Outcomes -- Insights from Urban Studies Rashid Mushkani Hugo Berard Shin Koseki 134 1 0 16 Mar 2025
Are Human Explanations Always Helpful? Towards Objective Evaluation of Human Natural Language Explanations Bingsheng Yao Prithviraj Sen Lucian Popa James A. Hendler Dakuo Wang XAI ELM FAtt 23 10 0 04 May 2023
DeepShovel: An Online Collaborative Platform for Data Extraction in Geoscience Literature with AI Assistance Shao Zhang Yuting Jia Hui Xu Ying Wen Dakuo Wang Xinbing Wang 16 2 0 21 Feb 2022
Are We Modeling the Task or the Annotator? An Investigation of Annotator Bias in Natural Language Understanding Datasets Mor Geva Yoav Goldberg Jonathan Berant 242 320 0 21 Aug 2019
Capturing Ambiguity in Crowdsourcing Frame Disambiguation Anca Dumitrache Lora Aroyo Chris Welty FedML 28 31 0 01 May 2018