Crowd-Calibrator: Can Annotator Disagreement Inform Calibration in Subjective Tasks?

26 August 2024

Papers citing "Crowd-Calibrator: Can Annotator Disagreement Inform Calibration in Subjective Tasks?"

4 / 4 papers shown

Title
Neither Valid nor Reliable? Investigating the Use of LLMs as Judges Khaoula Chehbouni Mohammed Haddou Jackie CK Cheung G. Farnadi LLMAG 257 5 0 25 Aug 2025
Diversity-Enhanced Reasoning for Subjective Questions Yumeng Wang Zhiyuan Fan Jiayu Liu J. Huang Yi R. Fung LRM 406 5 0 27 Jul 2025
Efficient Annotator Reliability Assessment and Sample Weighting for Knowledge-Based Misinformation Detection on Social MediaNorth American Chapter of the Association for Computational Linguistics (NAACL), 2024 Owen Cook Charlie Grimshaw Ben Wu Sophie Dillon Jack Hicks Luke Jones Thomas Smith Matyas Szert Xingyi Song 139 2 0 18 Oct 2024
Annotator-Centric Active Learning for Subjective NLP Tasks Michiel van der Meer Neele Falk P. Murukannaiah Enrico Liscio 393 17 0 24 Apr 2024