Conformal Alignment: Knowing When to Trust Foundation Models with
Guarantees

Conformal Alignment: Knowing When to Trust Foundation Models with Guarantees

16 May 2024

Papers citing "Conformal Alignment: Knowing When to Trust Foundation Models with Guarantees"

15 / 15 papers shown

Title
Mapping User Trust in Vision Language Models: Research Landscape, Challenges, and Prospects Agnese Chiatti Sara Bernardini Lara Shibelski Godoy Piccolo Viola Schiaffonati Matteo Matteucci 44 0 0 08 May 2025
Multivariate Conformal Selection Tian Bai Yue Zhao Xiang Yu Archer Y. Yang BDL 51 0 0 01 May 2025
Conformal Linguistic Calibration: Trading-off between Factuality and Specificity Zhengping Jiang Anqi Liu Benjamin Van Durme 78 1 0 26 Feb 2025
Conformal Prediction: A Data Perspective Xiaofan Zhou Baiting Chen Yu Gui Lu Cheng 40 2 0 09 Oct 2024
Streamlining Conformal Information Retrieval via Score Refinement Yotam Intrator Ori Kelner Regev Cohen Roman Goldenberg Ehud Rivlin Daniel Freedman 14 0 0 03 Oct 2024
Conformal Generative Modeling with Improved Sample Efficiency through Sequential Greedy Filtering K. K. Bernhard Schölkopf Michael Muehlebach 19 0 0 02 Oct 2024
Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement Jaehun Jung Faeze Brahman Yejin Choi ALM 32 11 0 25 Jul 2024
Do LLMs Know When to NOT Answer? Investigating Abstention Abilities of Large Language Models Nishanth Madhusudhan Sathwik Tejaswi Madhusudhan Vikas Yadav Masoud Hashemi 14 4 0 23 Jul 2024
MetaToken: Detecting Hallucination in Image Descriptions by Meta Classification Laura Fieback Jakob Spiegelberg Hanno Gottschalk MLLM 46 5 0 29 May 2024
Confidence on the Focal: Conformal Prediction with Selection-Conditional Coverage Ying Jin Zhimei Ren 24 7 0 06 Mar 2024
API Is Enough: Conformal Prediction for Large Language Models Without Logit-Access Jiayuan Su Jing Luo Hongwei Wang Lu Cheng 59 16 0 02 Mar 2024
Non-Exchangeable Conformal Language Generation with Nearest Neighbors Dennis Ulmer Chrysoula Zerva André F. T. Martins 26 11 0 01 Feb 2024
Conformal Language Modeling Victor Quach Adam Fisch Tal Schuster Adam Yala J. Sohn Tommi Jaakkola Regina Barzilay 74 55 0 16 Jun 2023
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022
Learn then Test: Calibrating Predictive Algorithms to Achieve Risk Control Anastasios Nikolas Angelopoulos Stephen Bates Emmanuel J. Candès Michael I. Jordan Lihua Lei 83 125 0 03 Oct 2021