Monte Carlo Temperature: a robust sampling strategy for LLM's uncertainty quantification methods

v1v2 (latest)

Monte Carlo Temperature: a robust sampling strategy for LLM's uncertainty quantification methods

25 February 2025

Ignacio Fernández Tobías

ArXiv (abs)PDF HTML

Papers citing "Monte Carlo Temperature: a robust sampling strategy for LLM's uncertainty quantification methods"

16 / 16 papers shown

Title
Learned Hallucination Detection in Black-Box LLMs using Token-level Entropy Production Rate Charles Moslonka Hicham Randrianarivo Arthur Garnier Emmanuel Malherbe HILM 161 2 0 01 Sep 2025
Group Fairness Meets the Black Box: Enabling Fair Algorithms on Closed LLMs via Post-Processing Ruicheng Xian Yuxuan Wan Han Zhao FaML 177 0 0 15 Aug 2025
SCOPE: Stochastic and Counterbiased Option Placement for Evaluating Large Language Models Wonjun Jeong Dongseok Kim Taegkeun Whangbo 199 1 0 24 Jul 2025
Estimating LLM Consistency: A User Baseline vs Surrogate Metrics Xiaoyuan Wu Weiran Lin Omer Akgul Lujo Bauer HILM 302 3 0 26 May 2025
Handling Ontology Gaps in Semantic Parsing Andrea Bacciu Marco Damonte Marco Basaldella Emilio Monti 177 2 0 27 Jun 2024
The Falcon Series of Open Language Models Ebtesam Almazrouei Hamza Alobeidli Abdulaziz Alshamsi Alessandro Cappelli Ruxandra-Aimée Cojocaru ... Quentin Malartic Daniele Mazzotta Badreddine Noune B. Pannier Guilherme Penedo AI4TS ALM 428 598 0 28 Nov 2023
Judging LLM-as-a-Judge with MT-Bench and Chatbot ArenaNeural Information Processing Systems (NeurIPS), 2023 Lianmin Zheng Wei-Lin Chiang Ying Sheng Siyuan Zhuang Zhanghao Wu ... Dacheng Li Eric Xing Haotong Zhang Joseph E. Gonzalez Ion Stoica ALM OSLM ELM 2.7K 6,383 0 09 Jun 2023
Generating with Confidence: Uncertainty Quantification for Black-box Large Language Models Zhen Lin Shubhendu Trivedi Jimeng Sun HILM 505 227 0 30 May 2023
GPT-4 Technical Report OpenAI OpenAI OpenAI Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad ... Shengjia Zhao Tianhao Zheng Juntang Zhuang William Zhuk Barret Zoph LLMAG MLLM 4.0K 20,494 0 15 Mar 2023
Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language GenerationInternational Conference on Learning Representations (ICLR), 2023 Lorenz Kuhn Y. Gal Sebastian Farquhar UQLM 569 465 0 19 Feb 2023
Language Models (Mostly) Know What They Know Saurav Kadavath Tom Conerly Amanda Askell T. Henighan Dawn Drain ... Nicholas Joseph Benjamin Mann Sam McCandlish C. Olah Jared Kaplan ELM 546 1,114 0 11 Jul 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsNeural Information Processing Systems (NeurIPS), 2022 Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 2.2K 14,255 0 28 Jan 2022
On Hallucination and Predictive Uncertainty in Conditional Language GenerationConference of the European Chapter of the Association for Computational Linguistics (EACL), 2021 Yijun Xiao Wenjie Wang HILM 336 227 0 28 Mar 2021
Are NLP Models really able to Solve Simple Math Word Problems?North American Chapter of the Association for Computational Linguistics (NAACL), 2021 Arkil Patel S. Bhattamishra Navin Goyal ReLM LRM 342 1,051 0 12 Mar 2021
Language Models are Few-Shot LearnersNeural Information Processing Systems (NeurIPS), 2020 Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 2.0K 51,682 0 28 May 2020
TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension Mandar Joshi Eunsol Choi Daniel S. Weld Luke Zettlemoyer RALM 1.5K 3,277 0 09 May 2017