Forcing Diffuse Distributions out of Language Models

Forcing Diffuse Distributions out of Language Models

16 April 2024

Avi Schwarzschild

Nicholas Carlini

Daphne Ippolito

Papers citing "Forcing Diffuse Distributions out of Language Models"

15 / 15 papers shown

Title
Always Tell Me The Odds: Fine-grained Conditional Probability Estimation Liaoyaqi Wang Zhengping Jiang Anqi Liu Benjamin Van Durme 52 0 0 02 May 2025
Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction Vaishnavh Nagarajan Chen Henry Wu Charles Ding Aditi Raghunathan 28 0 0 21 Apr 2025
Weight Ensembling Improves Reasoning in Language Models Xingyu Dang Christina Baek Kaiyue Wen Zico Kolter Aditi Raghunathan MoMe LRM 60 1 0 14 Apr 2025
NoveltyBench: Evaluating Language Models for Humanlike Diversity Yiming Zhang Harshita Diddee Susan Holm Hanchen Liu Xinyue Liu Vinay Samuel Barry Wang Daphne Ippolito 29 1 0 07 Apr 2025
Conversational User-AI Intervention: A Study on Prompt Rewriting for Improved LLM Response Generation Rupak Sarkar Bahareh Sarrafzadeh N. Chandrasekaran Nagu Rangan Philip Resnik Longqi Yang S. Jauhar 45 1 0 21 Mar 2025
Position: Model Collapse Does Not Mean What You Think Rylan Schaeffer Joshua Kazdan Alvan Caleb Arulandu Sanmi Koyejo 51 0 0 05 Mar 2025
Diverse Preference Optimization Jack Lanchantin Angelica Chen S. Dhuliawala Ping Yu Jason Weston Sainbayar Sukhbaatar Ilia Kulikov 86 3 0 30 Jan 2025
Preference Optimization with Multi-Sample Comparisons Chaoqi Wang Zhuokai Zhao Chen Zhu Karthik Abinav Sankararaman Michal Valko ... Zhaorun Chen Madian Khabsa Yuxin Chen Hao Ma Sinong Wang 53 10 0 16 Oct 2024
Towards Fair RAG: On the Impact of Fair Ranking in Retrieval-Augmented Generation To Eun Kim Fernando Diaz 49 2 0 17 Sep 2024
Benchmarking Language Model Creativity: A Case Study on Code Generation Yining Lu Dixuan Wang Tianjian Li Dongwei Jiang Daniel Khashabi Meng Jiang Daniel Khashabi LRM 49 10 0 12 Jul 2024
GenQA: Generating Millions of Instructions from a Handful of Prompts Jiuhai Chen Rifaa Qadri Yuxin Wen Neel Jain John Kirchenbauer Tianyi Zhou Tom Goldstein ALM 27 13 0 14 Jun 2024
Guiding and Diversifying LLM-Based Story Generation via Answer Set Programming Phoebe J. Wang Max Kreminski 28 4 0 01 Jun 2024
ProGen: Progressive Zero-shot Dataset Generation via In-context Feedback Jiacheng Ye Jiahui Gao Jiangtao Feng Zhiyong Wu Tao Yu Lingpeng Kong SyDa VLM 71 69 0 22 Oct 2022
A Kernel-Based View of Language Model Fine-Tuning Sadhika Malladi Alexander Wettig Dingli Yu Danqi Chen Sanjeev Arora VLM 66 60 0 11 Oct 2022
Classical Structured Prediction Losses for Sequence to Sequence Learning Sergey Edunov Myle Ott Michael Auli David Grangier MarcÁurelio Ranzato AIMat 43 185 0 14 Nov 2017