Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2307.02191
Cited By
Evaluating AI systems under uncertain ground truth: a case study in dermatology
5 July 2023
David Stutz
A. Cemgil
Abhijit Guha Roy
Tatiana Matejovicova
Melih Barsbey
Patricia Strachan
M. Schaekermann
Jan Freyberg
R. Rikhye
Beverly Freeman
J. P. Matos
Umesh Telang
D. Webster
Yuan Liu
G. Corrado
Yossi Matias
Pushmeet Kohli
Yun-hui Liu
Arnaud Doucet
Alan Karthikesalingam
Re-assign community
ArXiv
PDF
HTML
Papers citing
"Evaluating AI systems under uncertain ground truth: a case study in dermatology"
7 / 7 papers shown
Title
Missing Information, Unresponsive Authors, Experimental Flaws: The Impossibility of Assessing the Reproducibility of Previous Human Evaluations in NLP
Anya Belz
Craig Thomson
Ehud Reiter
Gavin Abercrombie
J. Alonso-Moral
...
Antonio Toral
Xiao-Yi Wan
Leo Wanner
Lewis J. Watson
Diyi Yang
66
35
0
02 May 2023
SemEval-2023 Task 11: Learning With Disagreements (LeWiDi)
Elisa Leonardelli
Alexandra Uma
Gavin Abercrombie
Dina Almanea
Valerio Basile
Tommaso Fornaciari
Barbara Plank
Verena Rieser
Massimo Poesio
35
41
0
28 Apr 2023
Stop Measuring Calibration When Humans Disagree
Joris Baan
Wilker Aziz
Barbara Plank
Raquel Fernández
14
53
0
28 Oct 2022
Robust and Efficient Medical Imaging with Self-Supervision
Shekoofeh Azizi
Laura J. Culp
Jan Freyberg
Basil Mustafa
Sebastien Baur
...
Geoffrey E. Hinton
N. Houlsby
Alan Karthikesalingam
Mohammad Norouzi
Vivek Natarajan
OOD
57
57
0
19 May 2022
Agreeing to Disagree: Annotating Offensive Language Datasets with Annotators' Disagreement
Elisa Leonardelli
Stefano Menini
Alessio Palmero Aprosio
Marco Guerini
Sara Tonelli
36
97
0
28 Sep 2021
Robustness of Accuracy Metric and its Inspirations in Learning with Noisy Labels
Pengfei Chen
Junjie Ye
Guangyong Chen
Jingwei Zhao
Pheng-Ann Heng
NoLa
72
33
0
08 Dec 2020
ImageNet Large Scale Visual Recognition Challenge
Olga Russakovsky
Jia Deng
Hao Su
J. Krause
S. Satheesh
...
A. Karpathy
A. Khosla
Michael S. Bernstein
Alexander C. Berg
Li Fei-Fei
VLM
ObjD
279
39,083
0
01 Sep 2014
1