InfoLM: A New Metric to Evaluate Summarization & Data2Text Generation

2 December 2021

Papers citing "InfoLM: A New Metric to Evaluate Summarization & Data2Text Generation"

29 / 29 papers shown

Title
TAGExplainer: Narrating Graph Explanations for Text-Attributed Graph Learning Models Bo Pan Zhen Xiong Guanchen Wu Zheng Zhang Yifei Zhang Liang Zhao FAtt 19 1 0 20 Oct 2024
What Makes a Good Story and How Can We Measure It? A Comprehensive Survey of Story Evaluation Dingyi Yang Qin Jin 36 5 0 26 Aug 2024
A Guide to Similarity Measures Avivit Levy B. R. Shalom Michal Chalamish 23 2 0 07 Aug 2024
PerSEval: Assessing Personalization in Text Summarizers Sourish Dasgupta Ankush Chander Parth Borad Isha Motiyani Tanmoy Chakraborty 27 0 0 29 Jun 2024
Inherent Trade-Offs between Diversity and Stability in Multi-Task Benchmarks Guanhua Zhang Moritz Hardt 35 7 0 02 May 2024
From Variability to Stability: Advancing RecSys Benchmarking Practices Valeriy Shevchenko Nikita Belousov Alexey Vasilev Vladimir Zholobov Artyom Sosedka Natalia Semenova Anna Volodkevich Andrey Savchenko Alexey Zaytsev 13 6 0 15 Feb 2024
LUNA: A Framework for Language Understanding and Naturalness Assessment Marat Saidov A. Bakalova Ekaterina Taktasheva Vladislav Mikhailov Ekaterina Artemova ELM 20 1 0 09 Jan 2024
Hyperparameter-Free Approach for Faster Minimum Bayes Risk Decoding Yuu Jinnai Kaito Ariu 21 8 0 05 Jan 2024
CritiqueLLM: Towards an Informative Critique Generation Model for Evaluation of Large Language Model Generation Pei Ke Bosi Wen Andrew Feng Xiao-Yang Liu Xuanyu Lei ... Aohan Zeng Yuxiao Dong Hongning Wang Jie Tang Minlie Huang ELM ALM 35 22 0 30 Nov 2023
Language Models Hallucinate, but May Excel at Fact Verification Jian-Yu Guan Jesse Dodge David Wadden Minlie Huang Hao Peng LRM HILM 17 28 0 23 Oct 2023
Revisiting Instruction Fine-tuned Model Evaluation to Guide Industrial Applications Manuel Faysse Gautier Viaud C´eline Hudelot Pierre Colombo 25 9 0 21 Oct 2023
MuseChat: A Conversational Music Recommendation System for Videos Zhikang Dong Bin Chen Xiulong Liu Paweł Polak Peng Zhang LRM 37 26 0 10 Oct 2023
DecompEval: Evaluating Generated Texts as Unsupervised Decomposed Question Answering Pei Ke Fei Huang Fei Mi Yasheng Wang Qun Liu Xiaoyan Zhu Minlie Huang ReLM ELM 29 10 0 13 Jul 2023
Towards More Robust NLP System Evaluation: Handling Missing Scores in Benchmarks Anas Himmi Ekhine Irurozki Nathan Noiry Stéphan Clémençon Pierre Colombo 14 5 0 17 May 2023
NLG Evaluation Metrics Beyond Correlation Analysis: An Empirical Metric Preference Checklist Iftitahu Ni'mah Meng Fang Vlado Menkovski Mykola Pechenizkiy 20 12 0 15 May 2023
Unsupervised Layer-wise Score Aggregation for Textual OOD Detection Maxime Darrin Guillaume Staerman Eduardo Dadalto Camara Gomes Jackie CK Cheung Pablo Piantanida Pierre Colombo OODD 33 11 0 20 Feb 2023
Rainproof: An Umbrella To Shield Text Generators From Out-Of-Distribution Data Maxime Darrin Pablo Piantanida Pierre Colombo OODD 24 12 0 18 Dec 2022
Beyond Mahalanobis-Based Scores for Textual OOD Detection Pierre Colombo Eduardo Dadalto Camara Gomes Guillaume Staerman Nathan Noiry Pablo Piantanida OODD 17 5 0 24 Nov 2022
Voteñ'Rank: Revision of Benchmarking with Social Choice Theory Mark Rofin Vladislav Mikhailov Mikhail Florinskiy A. Kravchenko E. Tutubalina Tatiana Shavrina Daniel Karabekyan Ekaterina Artemova 17 6 0 11 Oct 2022
WikiDes: A Wikipedia-Based Dataset for Generating Short Descriptions from Paragraphs Hoang Thang Ta Abu Bakar Siddiqur Rahman Navonil Majumder Amir Hussain Lotfollah Najjar N. Howard Soujanya Poria Alexander Gelbukh 27 11 0 27 Sep 2022
The Glass Ceiling of Automatic Evaluation in Natural Language Generation Pierre Colombo Maxime Peyrard Nathan Noiry Robert West Pablo Piantanida 20 11 0 31 Aug 2022
Of Human Criteria and Automatic Metrics: A Benchmark of the Evaluation of Story Generation Cyril Chhun Pierre Colombo Chloé Clavel Fabian M. Suchanek 44 50 0 24 Aug 2022
Learning Disentangled Textual Representations via Statistical Measures of Similarity Pierre Colombo Guillaume Staerman Nathan Noiry Pablo Piantanida FaML DRL 23 21 0 07 May 2022
Repro: An Open-Source Library for Improving the Reproducibility and Usability of Publicly Available Research Code Daniel Deutsch Dan Roth AI4CE 32 2 0 29 Apr 2022
Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Text Sebastian Gehrmann Elizabeth Clark Thibault Sellam ELM AI4CE 53 181 0 14 Feb 2022
What are the best systems? New perspectives on NLP Benchmarking Pierre Colombo Nathan Noiry Ekhine Irurozki Stéphan Clémençon 11 28 0 08 Feb 2022
Beam Search with Bidirectional Strategies for Neural Response Generation Pierre Colombo Chouchang Yang Giovanna Varni Chloé Clavel 30 13 0 07 Oct 2021
Text Summarization with Pretrained Encoders Yang Liu Mirella Lapata MILM 254 1,428 0 22 Aug 2019
Efficient Estimation of Word Representations in Vector Space Tomáš Mikolov Kai Chen G. Corrado J. Dean 3DV 228 31,150 0 16 Jan 2013