On the probability-quality paradox in language generation

On the probability-quality paradox in language generation

31 March 2022

Papers citing "On the probability-quality paradox in language generation"

13 / 13 papers shown

Title
Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads Tianle Cai Yuhong Li Zhengyang Geng Hongwu Peng Jason D. Lee De-huai Chen Tri Dao 29 246 0 19 Jan 2024
Probing the Creativity of Large Language Models: Can models produce divergent semantic association? Honghua Chen Nai Ding LRM 16 19 0 17 Oct 2023
On the Efficacy of Sampling Adapters Clara Meister Tiago Pimentel Luca Malagutti Ethan Gotlieb Wilcox Ryan Cotterell 23 12 0 07 Jul 2023
Quantifying the perceptual value of lexical and non-lexical channels in speech Sarenne Wallbridge P. Bell Catherine Lai 15 1 0 07 Jul 2023
The Stable Entropy Hypothesis and Entropy-Aware Decoding: An Analysis and Algorithm for Robust Natural Language Generation Kushal Arora Timothy J. O'Donnell Doina Precup Jason Weston Jackie C.K.Cheung 10 1 0 14 Feb 2023
On the Typicality of Musical Sequences Mathias Rose Bjare Stefan Lattner 13 3 0 23 Nov 2022
Best- $k$ Search Algorithm for Neural Text Generation Jiacheng Xu Caiming Xiong Silvio Savarese Yingbo Zhou 30 5 0 22 Nov 2022
Truncation Sampling as Language Model Desmoothing John Hewitt Christopher D. Manning Percy Liang BDL 21 75 0 27 Oct 2022
IFDID: Information Filter upon Diversity-Improved Decoding for Diversity-Faithfulness Tradeoff in NLG Han Meng Xiaosong He Zexing Chen F. Zhou 28 0 0 25 Oct 2022
Language Model Decoding as Likelihood-Utility Alignment Martin Josifoski Maxime Peyrard Frano Rajic Jiheng Wei Debjit Paul ... Barun Patra Vishrav Chaudhary Emre Kıcıman Boi Faltings Robert West 27 4 0 13 Oct 2022
Learning to Break the Loop: Analyzing and Mitigating Repetitions for Neural Text Generation Jin Xu Xiaojiang Liu Jianhao Yan Deng Cai Huayang Li Jian Li 17 69 0 06 Jun 2022
Locally Typical Sampling Clara Meister Tiago Pimentel Gian Wiher Ryan Cotterell 138 86 0 01 Feb 2022
A surprisal--duration trade-off across and within the world's languages Tiago Pimentel Clara Meister Elizabeth Salesky Simone Teufel Damián E. Blasi Ryan Cotterell LRM 109 29 0 30 Sep 2021