Evaluating the Factual Consistency of Abstractive Text Summarization

Conference on Empirical Methods in Natural Language Processing (EMNLP), 2019

28 October 2019

Papers citing "Evaluating the Factual Consistency of Abstractive Text Summarization"

50 / 491 papers shown

Title
QRelScore: Better Evaluating Generated Questions with Deeper Understanding of Context-aware RelevanceConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Xiaoqiang Wang Bang Liu Siliang Tang Lingfei Wu 140 11 0 29 Apr 2022
Faithful to the Document or to the World? Mitigating Hallucinations via Entity-linked Knowledge in Abstractive SummarizationConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Yue Dong John Wieting Pat Verga HILM 143 28 0 28 Apr 2022
An End-to-End Dialogue Summarization System for Sales CallsNorth American Chapter of the Association for Computational Linguistics (NAACL), 2022 Abedelkadir Asi Song Wang Roy Eisenstadt Dean Geckt Yarin Kuper Yi Mao Royi Ronen 122 18 0 27 Apr 2022
Benchmarking Answer Verification Methods for Question Answering-Based Summarization Evaluation MetricsFindings (Findings), 2022 Daniel Deutsch Dan Roth 188 5 0 21 Apr 2022
Spurious Correlations in Reference-Free Evaluation of Text GenerationAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Esin Durmus Faisal Ladhak Tatsunori Hashimoto 118 35 0 21 Apr 2022
A Survey on Neural Abstractive Summarization Methods and Factual Consistency of Summarization Meng Cao 88 8 0 20 Apr 2022
Table-based Fact Verification with Self-adaptive Mixture of ExpertsFindings (Findings), 2022 Yuxuan Zhou Xien Liu Kaiyin Zhou Ji Wu MoE 199 17 0 19 Apr 2022
Factual Error Correction for Abstractive Summaries Using Entity RetrievalIEEE Games Entertainment Media Conference (GEM), 2022 Hwanhee Lee Cheoneum Park Seunghyun Yoon Trung Bui Franck Dernoncourt Juae Kim Kyomin Jung KELM 108 15 0 18 Apr 2022
Evaluating Factuality in Text SimplificationAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Ashwin Devaraj William Sheffield Byron C. Wallace Junyi Jessy Li HILM 122 48 0 15 Apr 2022
Stretching Sentence-pair NLI Models to Reason over Long Documents and ClustersConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Tal Schuster Sihao Chen S. Buthpitiya Alex Fabrikant Donald Metzler 159 46 0 15 Apr 2022
Learning to Revise References for Faithful SummarizationConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Griffin Adams Han-Chin Shing Q. Sun C. Winestock Kathleen McKeown Noémie Elhadad 166 35 0 13 Apr 2022
TRUE: Re-evaluating Factual Consistency EvaluationWorkshop on Document-grounded Dialogue and Conversational Question Answering (DialDoc), 2022 Or Honovich Roee Aharoni Jonathan Herzig Hagai Taitelbaum Doron Kukliansy Vered Cohen Thomas Scialom Idan Szpektor Avinatan Hassidim Yossi Matias HILM 157 4 0 11 Apr 2022
Evaluation of Automatic Text Summarization using Synthetic Facts J. Ahn Foaad Khosmood HILM 80 1 0 11 Apr 2022
Entity-driven Fact-aware Abstractive Summarization of Biomedical LiteratureInternational Conference on Pattern Recognition (ICPR), 2022 Amanuel Alambo Tanvi Banerjee K. Thirunarayan M. Raymer MedIm 108 10 0 30 Mar 2022
A Well-Composed Text is Half Done! Composition Sampling for Diverse Conditional GenerationAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Shashi Narayan Gonccalo Simoes Yao-Min Zhao Joshua Maynez Dipanjan Das Michael Collins Mirella Lapata 149 32 0 28 Mar 2022
Affective Feedback Synthesis Towards Multimodal Text and Image Data Puneet Kumar Gaurav Bhatt Omkar Ingle Daksh Goyal Balasubramanian Raman EGVM 145 5 0 23 Mar 2022
Towards Abstractive Grounded Summarization of Podcast TranscriptsAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Kaiqiang Song Chen Li Xiaoyang Wang Dong Yu Fei Liu 114 9 0 22 Mar 2022
HIBRIDS: Attention with Hierarchical Biases for Structure-aware Long Document SummarizationAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Shuyang Cao Lu Wang 180 40 0 21 Mar 2022
Probing Factually Grounded Content Transfer with Factual AblationFindings (Findings), 2022 Peter West Chris Quirk Michel Galley Yejin Choi HILM 160 9 0 18 Mar 2022
Don't Say What You Don't Know: Improving the Consistency of Abstractive Summarization by Constraining Beam SearchIEEE Games Entertainment Media Conference (GEM), 2022 Daniel King Zejiang Shen Nishant Subramani Daniel S. Weld Iz Beltagy Doug Downey HILM 148 32 0 16 Mar 2022
Faithfulness in Natural Language Generation: A Systematic Survey of Analysis, Evaluation and Optimization Methods Wei Li Wenhao Wu Moye Chen Jiachen Liu Xinyan Xiao Hua Wu HILM 219 35 0 10 Mar 2022
Automatic Text Summarization Methods: A Comprehensive Review Divakar Yadav Jalpa J Desai A. Yadav 84 66 0 03 Mar 2022
Paper Plain: Making Medical Research Papers Approachable to Healthcare Consumers with Natural Language Processing Tal August Lucy Lu Wang Jonathan Bragg Marti A. Hearst Andrew Head Kyle Lo 183 55 0 28 Feb 2022
Learning Cluster Patterns for Abstractive SummarizationIEEE Access (IEEE Access), 2022 Sung-Guk Jo Jeong-Jae Kim Byung-Won On 155 4 0 22 Feb 2022
Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated TextJournal of Artificial Intelligence Research (JAIR), 2022 Sebastian Gehrmann Elizabeth Clark Thibault Sellam ELM AI4CE 396 213 0 14 Feb 2022
Differentiable N-gram Objective on Abstractive Summarization Yunqi Zhu Xuebing Yang Yuanyuan Wu Mingjing Zhu Wensheng Zhang 163 8 0 08 Feb 2022
Survey of Hallucination in Natural Language GenerationACM Computing Surveys (ACM CSUR), 2022 Ziwei Ji Nayeon Lee Rita Frieske Tiezheng Yu D. Su ... Delong Chen Wenliang Dai Ho Shu Chan Andrea Madotto Pascale Fung HILM LRM 546 3,122 0 08 Feb 2022
Submodularity In Machine Learning and Artificial Intelligence J. Bilmes 167 65 0 31 Jan 2022
Consistency and Coherence from Points of Contextual Similarity Oleg V. Vasilyev John Bohannon HILM 107 1 0 22 Dec 2021
May the Force Be with Your Copy Mechanism: Enhanced Supervised-Copy Method for Natural Language Generation Sanghyuk Choi J. Hwang Hyungjong Noh Yeonsoo Lee 86 3 0 20 Dec 2021
CONFIT: Toward Faithful Dialogue Summarization with Linguistically-Informed Contrastive Fine-tuning Xiangru Tang Arjun Nair Borui Wang Bingyao Wang Jai Desai Aaron Wade Haoran Li Asli Celikyilmaz Yashar Mehdad Dragomir R. Radev HILM 118 69 0 16 Dec 2021
QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarization Alexander R. Fabbri Chien-Sheng Wu Wenhao Liu Caiming Xiong HILM 152 244 0 16 Dec 2021
Massive-scale Decoding for Text Generation using Lattices Jiacheng Xu Siddhartha Reddy Jonnalagadda Greg Durrett AI4CE 154 8 0 14 Dec 2021
SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarization Philippe Laban Tobias Schnabel Paul N. Bennett Marti A. Hearst HILM 255 430 0 18 Nov 2021
How much do language models copy from their training data? Evaluating linguistic novelty in text generation using RAVEN R. Thomas McCoy P. Smolensky Tal Linzen Jianfeng Gao Asli Celikyilmaz SyDa 138 151 0 18 Nov 2021
Template Filling for Controllable Commonsense ReasoningInternational Joint Conference on Natural Language Processing (IJCNLP), 2021 Dheeraj Rajagopal Vivek Khetan Bogdan Sacaleanu A. Gershman Andy E. Fano Eduard H. Hovy BDL LRM 124 6 0 31 Oct 2021
TODSum: Task-Oriented Dialogue Summarization with State Tracking Lulu Zhao Fujia Zheng Keqing He Weihao Zeng Yuejie Lei Huixing Jiang Wei Wu Weiran Xu Jun Guo Fanyu Meng 145 25 0 25 Oct 2021
Knowledge Enhanced Pretrained Language Models: A Compreshensive Survey Xiaokai Wei Shen Wang Dejiao Zhang Parminder Bhatia Andrew O. Arnold KELM 121 53 0 16 Oct 2021
Training Dynamics for Text Summarization Models Tanya Goyal Jiacheng Xu Junjie Li Greg Durrett 211 33 0 15 Oct 2021
CaPE: Contrastive Parameter Ensembling for Reducing Hallucination in Abstractive Summarization Prafulla Kumar Choubey Alexander R. Fabbri Jesse Vig Chien-Sheng Wu Wenhao Liu Nazneen Rajani HILM 189 20 0 14 Oct 2021
Rome was built in 1776: A Case Study on Factual Correctness in Knowledge-Grounded Response Generation Sashank Santhanam Behnam Hedayatnia Spandana Gella Aishwarya Padmakumar Seokhwan Kim Yang Liu Dilek Z. Hakkani-Tür 151 36 0 11 Oct 2021
Explainable Fact-checking through Question AnsweringIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2021 Jing Yang D. Vega-Oliveros Taís Seibt Anderson de Rezende Rocha HILM 113 15 0 11 Oct 2021
Controllable Neural Dialogue Summarization with Personal Named Entity PlanningConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Zhengyuan Liu Nancy F. Chen 98 67 0 27 Sep 2021
Exploring Decomposition for Table-based Fact VerificationConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Xiaoyu Yang Xiao-Dan Zhu ReLM 131 25 0 22 Sep 2021
CLIFF: Contrastive Learning for Improving Faithfulness and Factuality in Abstractive Summarization Shuyang Cao Lu Wang HILM 137 192 0 19 Sep 2021
Investigating Crowdsourcing Protocols for Evaluating the Factual Consistency of Summaries Xiangru Tang Alexander R. Fabbri Haoran Li Ziming Mao Griffin Adams Borui Wang Asli Celikyilmaz Yashar Mehdad Dragomir R. Radev HILM 167 24 0 19 Sep 2021
Does Summary Evaluation Survive Translation to Other Languages? Neslihan Iskender Oleg V. Vasilyev Neslihan Iskender John Bohannon 116 5 0 16 Sep 2021
RetrievalSum: A Retrieval Enhanced Framework for Abstractive Summarization Chen An Ming Zhong Zhichao Geng Jianqiang Yang Xipeng Qiu RALM 133 26 0 16 Sep 2021
Compression, Transduction, and Creation: A Unified Framework for Evaluating Natural Language Generation Mingkai Deng Bowen Tan Zhengzhong Liu Eric Xing Zhiting Hu 116 76 0 14 Sep 2021
Medically Aware GPT-3 as a Data Generator for Medical Dialogue Summarization Bharath Chintagunta Namit Katariya X. Amatriain Anitha Kannan LM&MA MedIm 271 165 0 09 Sep 2021