Combining Human Predictions with Model Probabilities via Confusion Matrices and Calibration

29 September 2021

Papers citing "Combining Human Predictions with Model Probabilities via Confusion Matrices and Calibration"

25 / 25 papers shown

Title
From Text to Trust: Empowering AI-assisted Decision Making with Adaptive LLM-powered Analysis Zhuoyan Li Hangxiao Zhu Zhuoran Lu Ziang Xiao Ming Yin 47 0 0 17 Feb 2025
Utilizing Human Behavior Modeling to Manipulate Explanations in AI-Assisted Decision Making: The Good, the Bad, and the Scary Zhuoyan Li Ming Yin 25 3 0 02 Nov 2024
Human-AI Collaborative Multi-modal Multi-rater Learning for Endometriosis Diagnosis Hu Wang David Butler Yuan Zhang Jodie C Avery Steven Knox Congbo Ma Louise Hull Gustavo Carneiro 20 2 0 03 Sep 2024
Crowd-Calibrator: Can Annotator Disagreement Inform Calibration in Subjective Tasks? Urja Khurana Eric T. Nalisnick Antske Fokkens Swabha Swayamdipta 35 3 0 26 Aug 2024
A Decision-driven Methodology for Designing Uncertainty-aware AI Self-Assessment Charles Oredola Vladimir Leung Adnan Ashraf Eric Heim I-Jeng Wang 38 1 0 02 Aug 2024
Realizable $H$ -Consistent and Bayes-Consistent Loss Functions for Learning to Defer Anqi Mao M. Mohri Yutao Zhong 38 8 0 18 Jul 2024
Learning to Complement and to Defer to Multiple Users Zheng Zhang Wenjie Ai Kevin Wells David Rosewarne Thanh-Toan Do Gustavo Carneiro 41 0 0 09 Jul 2024
Co-Matching: Towards Human-Machine Collaborative Legal Case Matching Chen Huang Xinwei Yang Yang Deng Wenqiang Lei Jiancheng Lv Tat-Seng Chua AILaw 39 2 0 16 May 2024
Regression with Multi-Expert Deferral Anqi Mao M. Mohri Yutao Zhong 21 10 0 28 Mar 2024
AI, Meet Human: Learning Paradigms for Hybrid Decision Making Systems Clara Punzi Roberto Pellungrini Mattia Setzu F. Giannotti D. Pedreschi 17 5 0 09 Feb 2024
Bayesian Online Learning for Consensus Prediction Sam Showalter Alex Boyd Padhraic Smyth M. Steyvers 21 1 0 12 Dec 2023
Learning to Complement with Multiple Humans Zheng Zhang Cuong C. Nguyen Kevin Wells Thanh-Toan Do Gustavo Carneiro 19 0 0 22 Nov 2023
In Defense of Softmax Parametrization for Calibrated and Consistent Learning to Defer Yuzhou Cao Hussein Mozannar Lei Feng Hongxin Wei Bo An 31 16 0 02 Nov 2023
Principled Approaches for Learning to Defer with Multiple Experts Anqi Mao M. Mohri Yutao Zhong 19 20 0 23 Oct 2023
Human Uncertainty in Concept-Based AI Systems Katherine M. Collins Matthew Barker M. Zarlenga Naveen Raman Umang Bhatt M. Jamnik Ilia Sucholutsky Adrian Weller Krishnamurthy Dvijotham 58 39 0 22 Mar 2023
Human-AI Collaboration: The Effect of AI Delegation on Human Task Performance and Task Satisfaction Patrick Hemmer Monika Westphal Max Schemmer S. Vetter Michael Vossing G. Satzger 39 42 0 16 Mar 2023
Who Should Predict? Exact Algorithms For Learning to Defer to Humans Hussein Mozannar Hunter Lang Dennis L. Wei P. Sattigeri Subhro Das David Sontag 27 40 0 15 Jan 2023
Uncertainty Estimation based on Geometric Separation Gabriella Chouraqui L. Cohen Gil Einziger Liel Leman 13 0 0 11 Jan 2023
Learning to Defer to Multiple Experts: Consistent Surrogate Losses, Confidence Calibration, and Conformal Ensembles Rajeev Verma Daniel Barrejón Eric Nalisnick UQCV 23 28 0 30 Oct 2022
Sample Efficient Learning of Predictors that Complement Humans Mohammad-Amin Charusaie Hussein Mozannar David Sontag Samira Samadi 23 31 0 19 Jul 2022
Factors that influence the adoption of human-AI collaboration in clinical decision-making Patrick Hemmer Max Schemmer Lara Riefle Nico Rosellen Michael Vossing Niklas Kühl 26 11 0 19 Apr 2022
Counterfactual Inference of Second Opinions N. C. Benz Manuel Gomez Rodriguez CML 14 10 0 16 Mar 2022
Human-Algorithm Collaboration: Achieving Complementarity and Avoiding Unfairness Kate Donahue Alexandra Chouldechova K. Kenthapadi FaML FedML 26 49 0 17 Feb 2022
Improving Expert Predictions with Conformal Prediction Eleni Straitouri Lequn Wang Nastaran Okati Manuel Gomez Rodriguez 30 30 0 28 Jan 2022
MCMC using Hamiltonian dynamics Radford M. Neal 176 3,260 0 09 Jun 2012