Truncation Sampling as Language Model Desmoothing

27 October 2022

Papers citing "Truncation Sampling as Language Model Desmoothing"

8 / 58 papers shown

Title
The Stable Entropy Hypothesis and Entropy-Aware Decoding: An Analysis and Algorithm for Robust Natural Language Generation Kushal Arora Timothy J. O'Donnell Doina Precup Jason Weston Jackie C.K.Cheung 10 1 0 14 Feb 2023
MAUVE Scores for Generative Models: Theory and Practice Krishna Pillutla Lang Liu John Thickstun Sean Welleck Swabha Swayamdipta Rowan Zellers Sewoong Oh Yejin Choi Zaïd Harchaoui EGVM 23 21 0 30 Dec 2022
DC-MBR: Distributional Cooling for Minimum Bayesian Risk Decoding Jianhao Yan Jin Xu Fandong Meng Jie Zhou Yue Zhang 16 3 0 08 Dec 2022
An Analysis of the Effects of Decoding Algorithms on Fairness in Open-Ended Language Generation Jwala Dhamala Varun Kumar Rahul Gupta Kai-Wei Chang Aram Galstyan 27 7 0 07 Oct 2022
RankGen: Improving Text Generation with Large Ranking Models Kalpesh Krishna Yapei Chang John Wieting Mohit Iyyer AIMat 16 68 0 19 May 2022
Conditional Poisson Stochastic Beam Search Clara Meister Afra Amini Tim Vieira Ryan Cotterell 24 10 0 22 Sep 2021
The Pile: An 800GB Dataset of Diverse Text for Language Modeling Leo Gao Stella Biderman Sid Black Laurence Golding Travis Hoppe ... Horace He Anish Thite Noa Nabeshima Shawn Presser Connor Leahy AIMat 245 1,986 0 31 Dec 2020
Text Summarization with Pretrained Encoders Yang Liu Mirella Lapata MILM 254 1,428 0 22 Aug 2019