v1v2 (latest)

Deep learning from crowds

6 September 2017

Filipe Rodrigues

Francisco Câmara Pereira

FedML

NoLa

ArXiv (abs)PDF HTML

Papers citing "Deep learning from crowds"

50 / 112 papers shown

Title
Hypernetworks for Perspectivist Adaptation Daniil Ignatev Denis Paperno Massimo Poesio 64 0 0 15 Oct 2025
LeWiDi-2025 at NLPerspectives: The Third Edition of the Learning with Disagreements Shared Task Elisa Leonardelli Silvia Casola Siyao Peng Giulia Rizzi Valerio Basile ... Diego Frassinelli Hyewon Jang Maja Pavlovic Barbara Plank Massimo Poesio 90 5 0 09 Oct 2025
Active Query Selection for Crowd-Based Reinforcement Learning Jonathan Erskine Taku Yamagata Raúl Santos-Rodríguez 100 0 0 26 Aug 2025
Learning an Efficient Multi-Turn Dialogue Evaluator from Multiple Judges Yuqi Tang Kehua Feng Yunfeng Wang Zhiwen Chen Chengfei Lv Gang Yu Qiang Zhang Keyan Ding ELM 151 0 0 01 Aug 2025
Learning from Hard Labels with Additional Supervision on Non-Hard-Labeled Classes Kosuke Sugiyama Masato Uchida 113 0 0 24 Jul 2025
QuMAB: Query-based Multi-Annotator Behavior Modeling with Reliability under Sparse Labels Liyun Zhang Zheng Lian Hong Liu Takanori Takebe Yuta Nakashima 166 0 0 23 Jul 2025
Improving Recommendation Fairness without Sensitive Attributes Using Multi-Persona LLMs Haoran Xin Ying Sun Chao Wang Yanke Yu Weijia Zhang Hui Xiong FaML 137 1 0 26 May 2025
Minority Reports: Balancing Cost and Quality in Ground Truth Data Annotation Hsuan Wei Liao Christopher Klugmann Daniel Kondermann Rafid Mahmood 171 0 0 12 Apr 2025
crowd-hpo: Realistic Hyperparameter Optimization and Benchmarking for Learning from Crowds with Noisy Labels M. Herde Lukas Lührs Denis Huseljic Bernhard Sick 292 0 0 12 Apr 2025
Improving User Behavior Prediction: Leveraging Annotator Metadata in Supervised Machine Learning ModelsProceedings of the ACM on Human-Computer Interaction (PACMHCI), 2025 Lynnette Ng Kokil Jaidka Kaiyuan Tay Hansin Ahuja Niyati Chhaya 263 2 0 26 Mar 2025
Learning from Noisy Labels via Conditional Distributionally Robust OptimizationNeural Information Processing Systems (NeurIPS), 2024 Hui Guo Grace Y. Yi Boyu Wang NoLa 243 1 0 26 Nov 2024
SkillAggregation: Reference-free LLM-Dependent Aggregation Guangzhi Sun Anmol Kagrecha Potsawee Manakul Phil Woodland Mark Gales 157 2 0 14 Oct 2024
Crowd-Calibrator: Can Annotator Disagreement Inform Calibration in Subjective Tasks? Urja Khurana Eric T. Nalisnick Antske Fokkens Swabha Swayamdipta 338 7 0 26 Aug 2024
No Need to Sacrifice Data Quality for Quantity: Crowd-Informed Machine Annotation for Cost-Effective Understanding of Visual Data Christopher Klugmann Rafid Mahmood Guruprasad Hegde Amit Kale Daniel Kondermann 179 3 0 19 Aug 2024
A Multi-Task and Multi-Label Classification Model for Implicit Discourse Relation Recognition Nelson Filipe Costa Leila Kosseim 259 4 0 16 Aug 2024
dopanim: A Dataset of Doppelganger Animals with Noisy Annotations from Multiple Humans M. Herde Denis Huseljic Lukas Rauch Bernhard Sick 226 3 0 30 Jul 2024
Mixture of Experts based Multi-task Supervise Learning from Crowds Tao Han Huaixuan Shi Xinyi Ding Xiao Ma Huamao Gu Yili Fang 179 3 0 18 Jul 2024
Bayesian Detector Combination for Object Detection with Crowdsourced Annotations Zhi Qin Tan Olga Isupova Gustavo Carneiro Xiatian Zhu Yunpeng Li ObjD 154 1 0 10 Jul 2024
Learning to Complement and to Defer to Multiple Users Zheng Zhang Wenjie Ai Kevin Wells David Rosewarne Thanh-Toan Do Gustavo Carneiro 196 6 0 09 Jul 2024
Learning From Crowdsourced Noisy Labels: A Signal Processing Perspective Shahana Ibrahim Panagiotis A. Traganitis Xiao Fu G. Giannakis NoLa 205 6 0 09 Jul 2024
Cooperative learning of Pl@ntNet's Artificial Intelligence algorithm: how does it work and how can we improve it? Tanguy Lefort Antoine Affouard Benjamin Charlier J. Lombardo Mathias Chouet Hervé Goëau Joseph Salmon P. Bonnet Alexis Joly 202 2 0 05 Jun 2024
Annot-Mix: Learning with Noisy Class Labels from Multiple Annotators via a Mixup ExtensionEuropean Conference on Artificial Intelligence (ECAI), 2024 M. Herde Lukas Lührs Denis Huseljic Bernhard Sick 284 3 0 06 May 2024
Active Learning with Task Adaptation Pre-training for Speech Emotion Recognition Dongyuan Li Ying Zhang Yusong Wang Funakoshi Kataro Manabu Okumura 245 3 0 01 May 2024
Understanding Subjectivity through the Lens of Motivational Context in Model-Generated Image Satisfaction Senjuti Dutta Sherol Chen Sunny Mak Amnah Ahmad Katherine M. Collins Alena Butryna Deepak Ramachandran Krishnamurthy Dvijotham Ellie Pavlick Ravi Rajakumar EGVM 179 1 0 27 Feb 2024
Personalized Language Modeling from Personalized Human Feedback Xinyu Li Zachary C. Lipton Liu Leqi ALM 326 103 0 06 Feb 2024
Adaptive Crowdsourcing Via Self-Supervised Learning Anmol Kagrecha Henrik Marklund Benjamin Van Roy Hong Jun Jeon Richard Zeckhauser FedML 267 0 0 24 Jan 2024
Coupled Confusion Correction: Learning from Crowds with Sparse AnnotationsAAAI Conference on Artificial Intelligence (AAAI), 2023 Hansong Zhang Shikun Li Dan Zeng Chenggang Yan Shiming Ge 198 21 0 12 Dec 2023
Learning to Complement with Multiple HumansPattern Recognition (Pattern Recogn.), 2023 Zheng Zhang Cuong C. Nguyen Kevin Wells Thanh-Toan Do Gustavo Carneiro 245 1 0 22 Nov 2023
Capturing Perspectives of Crowdsourced Annotators in Subjective Learning Tasks Negar Mokhberian Myrl G. Marmarelis F. R. Hopp Valerio Basile Fred Morstatter Kristina Lerman 247 20 0 16 Nov 2023
Don't Waste a Single Annotation: Improving Single-Label Classifiers Through Soft Labels Ben Wu Yue Li Yida Mu Carolina Scarton Kalina Bontcheva Xingyi Song 169 15 0 09 Nov 2023
Architectural Sweet Spots for Modeling Human Label Variation by the Example of Argument Quality: It's Best to Relate Perspectives!Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Philipp Heinisch Matthias Orlikowski Julia Romberg Philipp Cimiano 177 10 0 06 Nov 2023
Improving a Named Entity Recognizer Trained on Noisy Data with a Few Clean Instances Zhendong Chu Ruiyi Zhang Tong Yu R. Jain Vlad I. Morariu Jiuxiang Gu A. Nenkova NoLa 217 2 0 25 Oct 2023
ACTOR: Active Learning with Annotator-specific Classification Heads to Embrace Human Label VariationConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Xinpeng Wang Barbara Plank 196 13 0 23 Oct 2023
Drawing the Same Bounding Box Twice? Coping Noisy Annotations in Object Detection with Repeated Labels David Tschirschwitz C. Benz Morris Florek Henrik Norderhus Benno Stein Volker Rodehorst 135 1 0 18 Sep 2023
Neural-Hidden-CRF: A Robust Weakly-Supervised Sequence LabelerKnowledge Discovery and Data Mining (KDD), 2023 Zhijun Chen Hailong Sun Wanhao Zhang Chunyi Xu Qianren Mao Pengpeng Chen BDL 209 6 0 10 Sep 2023
Label Selection Approach to Learning from CrowdsInternational Conference on Neural Information Processing (ICONIP), 2023 Kosuke Yoshimura H. Kashima NoLa 61 0 0 21 Aug 2023
Subjective Crowd Disagreements for Subjective Data: Uncovering Meaningful CrowdOpinion with Population-level LearningAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Tharindu Cyril Weerasooriya Sarah K. K. Luger Saloni Poddar Ashiqur R. KhudaBukhsh Christopher Homan 188 7 0 07 Jul 2023
Evaluating AI systems under uncertain ground truth: a case study in dermatology David Stutz A. Cemgil Abhijit Guha Roy Tatiana Matejovicova Melih Barsbey ... Yossi Matias Pushmeet Kohli Yao Xiao Arnaud Doucet Alan Karthikesalingam 217 3 0 05 Jul 2023
Handwritten Text Recognition from Crowdsourced Annotations Solène Tarride Tristan Faine Mélodie Boillet Harold Mouchère Christopher Kermorvant 255 8 0 19 Jun 2023
Deep Learning From Crowdsourced Labels: Coupled Cross-entropy Minimization, Identifiability, and RegularizationInternational Conference on Learning Representations (ICLR), 2023 Shahana Ibrahim Tri Nguyen Xiao Fu 162 24 0 05 Jun 2023
Transferring Annotator- and Instance-dependent Transition Matrix for Learning from CrowdsIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023 Shikun Li Xiaobo Xia Jiankang Deng Shiming Ge Tongliang Liu 208 18 0 05 Jun 2023
Deep Clustering with Incomplete Noisy Pairwise Annotations: A Geometric Regularization ApproachInternational Conference on Machine Learning (ICML), 2023 Tri Nguyen Shahana Ibrahim Xiao Fu 144 8 0 30 May 2023
Cost-efficient Crowdsourcing for Span-based Sequence Labeling: Worker Selection and Data AugmentationChina National Conference on Chinese Computational Linguistics (CNCCL), 2023 Yujie Wang Chaorui Huang Liner Yang Zhixuan Fang Yaping Huang Yang Liu Erhong Yang 106 0 0 11 May 2023
iLab at SemEval-2023 Task 11 Le-Wi-Di: Modelling Disagreement or Modelling Perspectives?International Workshop on Semantic Evaluation (SemEval), 2023 Nikolas Vitsakis Amit Parekh Tanvi Dinkar Gavin Abercrombie Ioannis Konstas Verena Rieser 192 12 0 10 May 2023
SemEval-2023 Task 11: Learning With Disagreements (LeWiDi)International Workshop on Semantic Evaluation (SemEval), 2023 Elisa Leonardelli Alexandra Uma Gavin Abercrombie Dina Almanea Valerio Basile Tommaso Fornaciari Barbara Plank Verena Rieser Massimo Poesio 138 74 0 28 Apr 2023
Multi-annotator Deep Learning: A Probabilistic Framework for Classification M. Herde Denis Huseljic Bernhard Sick 174 13 0 05 Apr 2023
Improving Object Detection in Medical Image Analysis through Multiple Expert Annotators: An Empirical Investigation Hieu H. Pham Khiem H. Le Tuan V. Tran H. Nguyen 105 2 0 29 Mar 2023
Learning from Noisy Crowd Labels with LogicsIEEE International Conference on Data Engineering (ICDE), 2023 Zhijun Chen Hailong Sun Haoqian He Pengpeng Chen NoLa NAI 218 9 0 13 Feb 2023
Multiview Representation Learning from Crowdsourced Triplet ComparisonsThe Web Conference (WWW), 2023 Xiaotian Lu Jiyi Li Koh Takeuchi H. Kashima SSL 122 2 0 08 Feb 2023
A Survey of Face Recognition Xinyi Wang Jianteng Peng Sufang Zhang Bihui Chen Yi Wang Yan-Hua Guo CVBM 253 0 0 26 Dec 2022