Calibrating Structured Output Predictors for Natural Language Processing

9 April 2020

Papers citing "Calibrating Structured Output Predictors for Natural Language Processing"

18 / 18 papers shown

Title
Uncertainty Quantification and Confidence Calibration in Large Language Models: A Survey Xiaoou Liu Tiejin Chen Longchao Da Chacha Chen Zhen Lin Hua Wei HILM 64 3 0 20 Mar 2025
Defining and Evaluating Decision and Composite Risk in Language Models Applied to Natural Language Inference Ke Shen M. Kejriwal 35 0 0 04 Aug 2024
Rel-A.I.: An Interaction-Centered Approach To Measuring Human-LM Reliance Kaitlyn Zhou Jena D. Hwang Xiang Ren Nouha Dziri Dan Jurafsky Maarten Sap 40 3 0 10 Jul 2024
Teaching LLMs to Abstain across Languages via Multilingual Feedback Shangbin Feng Weijia Shi Yike Wang Wenxuan Ding Orevaoghene Ahia Shuyue Stella Li Vidhisha Balachandran Sunayana Sitaram Yulia Tsvetkov 69 4 0 22 Jun 2024
A Formalism and Approach for Improving Robustness of Large Language Models Using Risk-Adjusted Confidence Scores Ke Shen M. Kejriwal 14 2 0 05 Oct 2023
Unsupervised Calibration through Prior Adaptation for Text Classification using Large Language Models Lautaro Estienne Luciana Ferrer Matías Vera Pablo Piantanida VLM 29 1 0 13 Jul 2023
Selectively Answering Ambiguous Questions Jeremy R. Cole Michael J.Q. Zhang D. Gillick Julian Martin Eisenschlos Bhuwan Dhingra Jacob Eisenstein UQLM 18 26 0 24 May 2023
Calibrated Interpretation: Confidence Estimation in Semantic Parsing Elias Stengel-Eskin Benjamin Van Durme UQLM 37 24 0 14 Nov 2022
Exploring Predictive Uncertainty and Calibration in NLP: A Study on the Impact of Method & Data Scarcity Dennis Ulmer J. Frellsen Christian Hardmeier 185 22 0 20 Oct 2022
Calibration of Machine Reading Systems at Scale S. Dhuliawala Leonard Adolphs Rajarshi Das Mrinmaya Sachan 25 11 0 20 Mar 2022
On the Calibration of Pre-trained Language Models using Mixup Guided by Area Under the Margin and Saliency Seohong Park Cornelia Caragea UQCV 6 34 0 14 Mar 2022
Uncertainty Estimation for Language Reward Models Adam Gleave G. Irving UQLM 29 31 0 14 Mar 2022
Making Heads and Tails of Models with Marginal Calibration for Sparse Tagsets Michael Kranzlein Nelson F. Liu Nathan Schneider 14 3 0 15 Sep 2021
Knowing More About Questions Can Help: Improving Calibration in Question Answering Shujian Zhang Chengyue Gong Eunsol Choi UQLM 25 58 0 02 Jun 2021
Reducing conversational agents' overconfidence through linguistic calibration Sabrina J. Mielke Arthur Szlam Emily Dinan Y-Lan Boureau 209 154 0 30 Dec 2020
How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answering Zhengbao Jiang Jun Araki Haibo Ding Graham Neubig UQCV 17 409 0 02 Dec 2020
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles Balaji Lakshminarayanan Alexander Pritzel Charles Blundell UQCV BDL 276 5,660 0 05 Dec 2016
Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning Y. Gal Zoubin Ghahramani UQCV BDL 285 9,136 0 06 Jun 2015