Fill in the BLANC: Human-free quality estimation of document summaries

Fill in the BLANC: Human-free quality estimation of document summaries

23 February 2020

Oleg V. Vasilyev

Vedant Dharnidharka

Papers citing "Fill in the BLANC: Human-free quality estimation of document summaries"

19 / 69 papers shown

Title
Repro: An Open-Source Library for Improving the Reproducibility and Usability of Publicly Available Research Code Daniel Deutsch Dan Roth AI4CE 37 2 0 29 Apr 2022
Survey of Hallucination in Natural Language Generation Ziwei Ji Nayeon Lee Rita Frieske Tiezheng Yu D. Su ... Delong Chen Wenliang Dai Ho Shu Chan Andrea Madotto Pascale Fung HILM LRM 36 2,230 0 08 Feb 2022
Consistency and Coherence from Points of Contextual Similarity Oleg V. Vasilyev John Bohannon HILM 17 1 0 22 Dec 2021
QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarization Alexander R. Fabbri C. Wu Wenhao Liu Caiming Xiong HILM 12 206 0 16 Dec 2021
Robust Deep Reinforcement Learning for Extractive Legal Summarization Duy-Hung Nguyen Bao-Sinh Nguyen Nguyen-Viet-Dung Nghiem Dung Tien Le Mim Amina Khatun Minh Le Nguyen Hung Le ELM AILaw AI4TS 72 18 0 13 Nov 2021
Finding a Balanced Degree of Automation for Summary Evaluation Shiyue Zhang Mohit Bansal 47 43 0 23 Sep 2021
Does Summary Evaluation Survive Translation to Other Languages? Neslihan Iskender Oleg V. Vasilyev Neslihan Iskender John Bohannon 10 3 0 16 Sep 2021
Perturbation CheckLists for Evaluating NLG Evaluation Metrics Ananya B. Sai Tanay Dixit D. Y. Sheth S. Mohan Mitesh M. Khapra AAML 97 55 0 13 Sep 2021
Towards Human-Free Automatic Quality Evaluation of German Summarization Neslihan Iskender Oleg V. Vasilyev Tim Polzehl John Bohannon Sebastian Möller 10 1 0 13 May 2021
What's in a Summary? Laying the Groundwork for Advances in Hospital-Course Summarization Griffin Adams Emily Alsentzer Mert Ketenci Jason Zucker Noémie Elhadad 33 46 0 12 Apr 2021
Estimation of Summary-to-Text Inconsistency by Mismatched Embeddings Oleg V. Vasilyev John Bohannon HILM 15 7 0 12 Apr 2021
Play the Shannon Game With Language Models: A Human-Free Approach to Summary Evaluation Nicholas Egan Oleg V. Vasilyev John Bohannon HILM 11 18 0 19 Mar 2021
Is human scoring the best criteria for summary evaluation? Oleg V. Vasilyev John Bohannon 8 11 0 29 Dec 2020
GO FIGURE: A Meta Evaluation of Factuality in Summarization Saadia Gabriel Asli Celikyilmaz Rahul Jha Yejin Choi Jianfeng Gao HILM 233 96 0 24 Oct 2020
Sensitivity of BLANC to human-scored qualities of text summaries Oleg V. Vasilyev Vedant Dharnidharka Nicholas Egan Charlene Chambliss John Bohannon 22 7 0 13 Oct 2020
SummEval: Re-evaluating Summarization Evaluation Alexander R. Fabbri Wojciech Kry'sciñski Bryan McCann Caiming Xiong R. Socher Dragomir R. Radev HILM 29 684 0 24 Jul 2020
SueNes: A Weakly Supervised Approach to Evaluating Single-Document Summarization via Negative Sampling F. S. Bao Hebi Li Ge Luo Minghui Qiu Yinfei Yang Youbiao He Cen Chen 16 4 0 13 May 2020
TuringAdvice: A Generative and Dynamic Evaluation of Language Use Rowan Zellers Ari Holtzman Elizabeth Clark Lianhui Qin Ali Farhadi Yejin Choi ELM LRM 14 14 0 07 Apr 2020
Fine-Tuning Language Models from Human Preferences Daniel M. Ziegler Nisan Stiennon Jeff Wu Tom B. Brown Alec Radford Dario Amodei Paul Christiano G. Irving ALM 275 1,583 0 18 Sep 2019