Conformal Autoregressive Generation: Beam Search with Coverage
Guarantees

Conformal Autoregressive Generation: Beam Search with Coverage Guarantees

7 September 2023

Nicolas Deutschmann

María Rodríguez Martínez

Papers citing "Conformal Autoregressive Generation: Beam Search with Coverage Guarantees"

12 / 12 papers shown

Title
Do Not Design, Learn: A Trainable Scoring Function for Uncertainty Estimation in Generative LLMs D. Yaldiz Yavuz Faruk Bakman Baturalp Buyukates Chenyang Tao Anil Ramakrishna Dimitrios Dimitriadis Jieyu Zhao Salman Avestimehr 32 1 0 17 Jun 2024
Conditional Shift-Robust Conformal Prediction for Graph Neural Network Akansha Agrawal UQCV 43 1 0 20 May 2024
Multicalibration for Confidence Scoring in LLMs Gianluca Detommaso Martín Bertrán Riccardo Fogliato Aaron Roth 19 12 0 06 Apr 2024
Conformal Language Modeling Victor Quach Adam Fisch Tal Schuster Adam Yala J. Sohn Tommi Jaakkola Regina Barzilay 74 55 0 16 Jun 2023
Inference-time Stochastic Ranking with Risk Control Ruocheng Guo Jean-François Ton Yang Liu Hang Li 10 2 0 12 Jun 2023
Conformal Nucleus Sampling Shauli Ravfogel Carlos Wert Carvajal M.F. Eggl UQLM 59 20 0 04 May 2023
Uncertainty Quantification with Pre-trained Language Models: A Large-Scale Empirical Analysis Yuxin Xiao Paul Pu Liang Umang Bhatt W. Neiswanger Ruslan Salakhutdinov Louis-Philippe Morency 164 86 0 10 Oct 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022
Learn then Test: Calibrating Predictive Algorithms to Achieve Risk Control Anastasios Nikolas Angelopoulos Stephen Bates Emmanuel J. Candès Michael I. Jordan Lihua Lei 86 125 0 03 Oct 2021
Few-shot Conformal Prediction with Auxiliary Tasks Adam Fisch Tal Schuster Tommi Jaakkola Regina Barzilay 176 53 0 17 Feb 2021
Reducing conversational agents' overconfidence through linguistic calibration Sabrina J. Mielke Arthur Szlam Emily Dinan Y-Lan Boureau 195 108 0 30 Dec 2020
Calibration of Pre-trained Transformers Shrey Desai Greg Durrett UQLM 231 288 0 17 Mar 2020