Investigating Uncertainty Calibration of Aligned Language Models under
the Multiple-Choice Setting

Investigating Uncertainty Calibration of Aligned Language Models under the Multiple-Choice Setting

18 October 2023

Peng Cui

Jianfei Chen

Jun Zhu

Papers citing "Investigating Uncertainty Calibration of Aligned Language Models under the Multiple-Choice Setting"

7 / 7 papers shown

Title
Specializing Large Language Models to Simulate Survey Response Distributions for Global Populations Yong Cao Haijiang Liu Arnav Arora Isabelle Augenstein Paul Röttger Daniel Hershcovich 49 1 0 20 Feb 2025
Enhancing Healthcare LLM Trust with Atypical Presentations Recalibration Jeremy Qin Bang Liu Quoc Dinh Nguyen 25 2 0 05 Sep 2024
Teaching LLMs to Abstain across Languages via Multilingual Feedback Shangbin Feng Weijia Shi Yike Wang Wenxuan Ding Orevaoghene Ahia Shuyue Stella Li Vidhisha Balachandran Sunayana Sitaram Yulia Tsvetkov 53 4 0 22 Jun 2024
Uncertainty Calibration for Counterfactual Propensity Estimation in Recommendation Wenbo Hu Xin Sun Qiang liu Wenbo Hu Shu Wu 26 0 0 23 Mar 2023
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022
PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts Stephen H. Bach Victor Sanh Zheng-Xin Yong Albert Webson Colin Raffel ... Khalid Almubarak Xiangru Tang Dragomir R. Radev Mike Tian-Jian Jiang Alexander M. Rush VLM 212 335 0 02 Feb 2022
Fine-Tuning Language Models from Human Preferences Daniel M. Ziegler Nisan Stiennon Jeff Wu Tom B. Brown Alec Radford Dario Amodei Paul Christiano G. Irving ALM 273 1,561 0 18 Sep 2019