Evaluating the Evaluation of Diversity in Natural Language Generation

6 April 2020

Papers citing "Evaluating the Evaluation of Diversity in Natural Language Generation"

32 / 32 papers shown

Title
JaccDiv: A Metric and Benchmark for Quantifying Diversity of Generated Marketing Text in the Music Industry Anum Afzal Alexandre Mercier Florian Matthes 60 0 0 29 Apr 2025
NoveltyBench: Evaluating Language Models for Humanlike Diversity Yiming Zhang Harshita Diddee Susan Holm Hanchen Liu Xinyue Liu Vinay Samuel Barry Wang Daphne Ippolito 29 1 0 07 Apr 2025
How Diversely Can Language Models Solve Problems? Exploring the Algorithmic Diversity of Model-Generated Code Seonghyeon Lee Heejae Chon Joonwon Jang Dongha Lee Hwanjo Yu ALM 39 0 0 02 Mar 2025
Diversity-Oriented Data Augmentation with Large Language Models Zaitian Wang Jinghan Zhang Xinhao Zhang Kunpeng Liu Pengfei Wang Yuanchun Zhou 78 1 0 17 Feb 2025
Measuring Diversity in Synthetic Datasets Yuchang Zhu Huizhe Zhang Bingzhe Wu Jintang Li Zibin Zheng Peilin Zhao Liang Chen Yatao Bian 95 0 0 12 Feb 2025
Diverse Preference Optimization Jack Lanchantin Angelica Chen S. Dhuliawala Ping Yu Jason Weston Sainbayar Sukhbaatar Ilia Kulikov 90 4 0 30 Jan 2025
Unleashing the Power of Data Tsunami: A Comprehensive Survey on Data Assessment and Selection for Instruction Tuning of Language Models Yulei Qin Yuncheng Yang Pengcheng Guo Gang Li Hang Shao Yuchen Shi Zihan Xu Yun Gu Ke Li Xing Sun ALM 88 12 0 31 Dec 2024
LLM-based multi-agent poetry generation in non-cooperative environments Ran Zhang Steffen Eger LLMAG 31 5 0 05 Sep 2024
Benchmarking Language Model Creativity: A Case Study on Code Generation Yining Lu Dixuan Wang Tianjian Li Dongwei Jiang Daniel Khashabi Meng Jiang Daniel Khashabi LRM 54 10 0 12 Jul 2024
Progress or Regress? Self-Improvement Reversal in Post-training Ting Wu Xuefeng Li Pengfei Liu LRM 30 9 0 06 Jul 2024
From Distributional to Overton Pluralism: Investigating Large Language Model Alignment Thom Lake Eunsol Choi Greg Durrett 37 9 0 25 Jun 2024
Promoting Constructive Deliberation: Reframing for Receptiveness Gauri Kambhatla Matthew Lease Ashwin Rajadesingan 38 2 0 23 May 2024
Improving Diversity of Commonsense Generation by Large Language Models via In-Context Learning Tianhui Zhang Bei Peng Danushka Bollegala LRM 27 7 0 25 Apr 2024
MAD Speech: Measures of Acoustic Diversity of Speech Matthieu Futeral A. Agostinelli Marco Tagliasacchi Neil Zeghidour Eugene Kharitonov 46 1 0 16 Apr 2024
Standardizing the Measurement of Text Diversity: A Tool and a Comparative Analysis of Scores Chantal Shaib Joe Barrow Jiuding Sun Alexa F. Siu Byron C. Wallace A. Nenkova 66 31 0 01 Mar 2024
On the Challenges and Opportunities in Generative AI Laura Manduchi Kushagra Pandey Robert Bamler Ryan Cotterell Sina Daubener ... F. Wenzel Frank Wood Stephan Mandt Vincent Fortuin Vincent Fortuin 56 17 0 28 Feb 2024
Generating Diverse and High-Quality Texts by Minimum Bayes Risk Decoding Yuu Jinnai Ukyo Honda Tetsuro Morimura Peinan Zhang 26 6 0 10 Jan 2024
Metric Space Magnitude for Evaluating the Diversity of Latent Representations K. Limbeck R. Andreeva Rik Sarkar Bastian Alexander Rieck 22 3 0 27 Nov 2023
Interpretation modeling: Social grounding of sentences by reasoning over their implicit moral judgments Liesbeth Allein Maria Mihaela Trucscva Marie-Francine Moens 20 1 0 27 Nov 2023
Partially Randomizing Transformer Weights for Dialogue Response Diversity Jing Yang Lee Kong Aik Lee Woon-Seng Gan 12 0 0 18 Nov 2023
How Far Can We Extract Diverse Perspectives from Large Language Models? Shirley Anugrah Hayati Minhwa Lee Dheeraj Rajagopal Dongyeop Kang 38 10 0 16 Nov 2023
A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target Training Nitay Calderon Subhabrata Mukherjee Roi Reichart Amir Kantor 31 17 0 03 May 2023
Pragmatically Appropriate Diversity for Dialogue Evaluation Katherine Stasaski Marti A. Hearst 19 1 0 06 Apr 2023
Music Playlist Title Generation Using Artist Information Haven Kim Seungheon Doh Junwon Lee Juhan Nam 24 3 0 14 Jan 2023
Paraphrase Identification with Deep Learning: A Review of Datasets and Methods Chao Zhou Cheng Qiu Daniel Ernesto Acuna 26 25 0 13 Dec 2022
DeepGen: Diverse Search Ad Generation and Real-Time Customization Konstantin Golobokov Junyi Chai Victor Ye Dong Mandy Gu Bingyu Chi Jie Cao Yulan Yan Yi Liu 23 7 0 06 Aug 2022
Exploring Diversity in Back Translation for Low-Resource Machine Translation Laurie Burchell Alexandra Birch Kenneth Heafield 27 15 0 01 Jun 2022
Masked Summarization to Generate Factually Inconsistent Summaries for Improved Factual Consistency Checking Hwanhee Lee Kang Min Yoo Joonsuk Park Hwaran Lee Kyomin Jung HILM 11 10 0 04 May 2022
CTRLEval: An Unsupervised Reference-Free Metric for Evaluating Controlled Text Generation Pei Ke Hao Zhou Yankai Lin Peng Li Jie Zhou Xiaoyan Zhu Minlie Huang 21 37 0 02 Apr 2022
Diversifying Content Generation for Commonsense Reasoning with Mixture of Knowledge Graph Experts W. Yu Chenguang Zhu Lianhui Qin Zhihan Zhang Tong Zhao Meng-Long Jiang LRM 20 30 0 14 Mar 2022
Are Some Words Worth More than Others? Shiran Dudy Steven Bedrick 13 14 0 12 Oct 2020
Language GANs Falling Short Massimo Caccia Lucas Page-Caccia W. Fedus Hugo Larochelle Joelle Pineau Laurent Charlin 119 215 0 06 Nov 2018