Evaluating the Factual Consistency of Abstractive Text Summarization

Conference on Empirical Methods in Natural Language Processing (EMNLP), 2019

28 October 2019

Papers citing "Evaluating the Factual Consistency of Abstractive Text Summarization"

50 / 491 papers shown

Title
Faithful or Extractive? On Mitigating the Faithfulness-Abstractiveness Trade-off in Abstractive SummarizationAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Faisal Ladhak Esin Durmus He He Claire Cardie Kathleen McKeown 134 69 0 31 Aug 2021
Hallucinated but Factual! Inspecting the Factuality of Hallucinations in Abstractive SummarizationAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Mengyao Cao Yue Dong Jackie C.K. Cheung HILM 387 170 0 30 Aug 2021
Factual Consistency Evaluation for Text Summarization via Counterfactual EstimationConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Yuexiang Xie Fei Sun Yang Deng Yaliang Li Bolin Ding HILM 160 55 0 30 Aug 2021
ComSum: Commit Messages Summarization and Meaning Preservation Leshem Choshen Idan Amit 109 5 0 23 Aug 2021
Accurate, yet inconsistent? Consistency Analysis on Language Understanding Models Myeongjun Jang D. Kwon Thomas Lukasiewicz 102 14 0 15 Aug 2021
MeetSum: Transforming Meeting Transcript Summarization using Transformers! Nima Sadri Bohan Zhang Bihan Liu 49 1 0 13 Aug 2021
Evaluating the Tradeoff Between Abstractiveness and Factuality in Abstractive SummarizationFindings (Findings), 2021 Markus Dreyer Mengwen Liu Feng Nan Sandeep Atluri Sujith Ravi HILM 123 18 0 05 Aug 2021
Summary Explorer: Visualizing the State of the Art in Text Summarization S. Syed Tariq Yousef Khalid Al Khatib S. Jänicke Martin Potthast ELM 92 10 0 04 Aug 2021
Logic-Consistency Text Generation from Semantic Parses Chang Shu Yusen Zhang Xiangyu Dong Peng Shi Tao Yu Rui Zhang 176 34 0 02 Aug 2021
Keep it Simple: Unsupervised Simplification of Multi-Paragraph TextAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Philippe Laban Tobias Schnabel Paul N. Bennett Marti A. Hearst 116 68 0 07 Jul 2021
Improving Factual Consistency of Abstractive Summarization on Customer Feedback Yang Liu Yifei Sun Vincent Gao HILM 78 8 0 30 Jun 2021
BARTScore: Evaluating Generated Text as Text GenerationNeural Information Processing Systems (NeurIPS), 2021 Weizhe Yuan Graham Neubig Pengfei Liu 306 931 0 22 Jun 2021
How well do you know your summarization datasets?Findings (Findings), 2021 Priyam Tejaswin Dhruv Naik Peng Liu 142 29 0 21 Jun 2021
DocNLI: A Large-scale Dataset for Document-level Natural Language InferenceFindings (Findings), 2021 Wenpeng Yin Dragomir R. Radev Caiming Xiong HILM 156 102 0 17 Jun 2021
Synthesizing Adversarial Negative Responses for Robust Response Ranking and EvaluationFindings (Findings), 2021 Prakhar Gupta Yulia Tsvetkov Jeffrey P. Bigham 128 24 0 10 Jun 2021
AgreeSum: Agreement-Oriented Multi-Document SummarizationFindings (Findings), 2021 Richard Yuanzhe Pang Á. Lelkes Vinh Q. Tran Cong Yu 111 18 0 04 Jun 2021
To Point or Not to Point: Understanding How Abstractive Summarizers Paraphrase TextFindings (Findings), 2021 Matthew Wilber William Timkey Marten van Schijndel 164 8 0 03 Jun 2021
Dissecting Generation Modes for Abstractive Summarization Models via Ablation and AttributionAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Jiacheng Xu Greg Durrett 119 17 0 03 Jun 2021
Question-aware Transformer Models for Consumer Health Question SummarizationJournal of Biomedical Informatics (JBI), 2021 S. Yadav D. Gupta Asma Ben Abacha Dina Demner-Fushman ELM MedIm 136 32 0 01 Jun 2021
Focus Attention: Promoting Faithfulness and Diversity in SummarizationAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Rahul Aralikatte Shashi Narayan Joshua Maynez S. Rothe Ryan T. McDonald 169 49 0 25 May 2021
Should We Trust This Summary? Bayesian Abstractive Summarization to The RescueFindings (Findings), 2021 Alexios Gidiotis Grigorios Tsoumakas UQCV UD BDL 142 10 0 21 May 2021
DialogSum: A Real-Life Scenario Dialogue Summarization DatasetFindings (Findings), 2021 Yulong Chen Yang Liu Liang Chen Yue Zhang 255 272 0 14 May 2021
Improving Factual Consistency of Abstractive Summarization via Question AnsweringAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Feng Nan Cicero Nogueira dos Santos Henghui Zhu Patrick Ng Kathleen McKeown Ramesh Nallapati Dejiao Zhang Zhiguo Wang Andrew O. Arnold Bing Xiang HILM 117 90 0 10 May 2021
Evaluating Attribution in Dialogue Systems: The BEGIN BenchmarkTransactions of the Association for Computational Linguistics (TACL), 2021 Nouha Dziri Hannah Rashkin Tal Linzen David Reitter ALM 405 90 0 30 Apr 2021
The Factual Inconsistency Problem in Abstractive Text Summarization: A Survey Yi-Chong Huang Xiachong Feng Xiaocheng Feng Bing Qin HILM 265 115 0 30 Apr 2021
Towards Clinical Encounter Summarization: Learning to Compose Discharge Summaries from Prior Notes Han-Chin Shing Chaitanya P. Shivade Nima Pourdamghani Feng Nan Philip Resnik Douglas W. Oard Parminder Bhatia 115 29 0 27 Apr 2021
Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality MetricsNorth American Chapter of the Association for Computational Linguistics (NAACL), 2021 Artidoro Pagnoni Vidhisha Balachandran Yulia Tsvetkov HILM 436 337 0 27 Apr 2021
Improving Faithfulness in Abstractive Summarization with Contrast Candidate Generation and SelectionNorth American Chapter of the Association for Computational Linguistics (NAACL), 2021 Sihao Chen Fan Zhang Kazoo Sone Dan Roth HILM 173 112 0 19 Apr 2021
Learning with Instance Bundles for Reading ComprehensionConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Dheeru Dua Pradeep Dasigi Sameer Singh Matt Gardner 92 11 0 18 Apr 2021
Can NLI Models Verify QA Systems' Predictions?Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Jifan Chen Eunsol Choi Greg Durrett 190 57 0 18 Apr 2021
A Token-level Reference-free Hallucination Detection Benchmark for Free-form Text GenerationAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Tianyu Liu Yizhe Zhang Chris Brockett Yi Mao Zhifang Sui Weizhu Chen W. Dolan HILM 372 173 0 18 Apr 2021
Transductive Learning for Abstractive News Summarization Arthur Bravzinskas Mengwen Liu Ramesh Nallapati Sujith Ravi Markus Dreyer AI4TS 113 1 0 17 Apr 2021
Multi-Perspective Abstractive Answer Summarization Alexander R. Fabbri Xiaojian Wu Srini Iyer Mona T. Diab 108 7 0 17 Apr 2021
Neural Path Hunter: Reducing Hallucination in Dialogue Systems via Path GroundingConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Nouha Dziri Andrea Madotto Osmar Zaiane A. Bose HILM 122 151 0 17 Apr 2021
$$Q^{2}$: Evaluating Factual Consistency in Knowledge-Grounded Dialogues via Question Generation and Question Answering$ $Q^{2}$ : Evaluating Factual Consistency in Knowledge-Grounded Dialogues via Question Generation and Question AnsweringConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Or Honovich Leshem Choshen Roee Aharoni Ella Neeman Idan Szpektor Omri Abend HILM 258 149 0 16 Apr 2021
Sometimes We Want Translationese Prasanna Parthasarathi Koustuv Sinha J. Pineau Adina Williams AAML 129 4 0 15 Apr 2021
Planning with Learned Entity Prompts for Abstractive SummarizationTransactions of the Association for Computational Linguistics (TACL), 2021 Shashi Narayan Yao-Min Zhao Joshua Maynez Gonçalo Simões Vitaly Nikolaev Ryan T. McDonald LRM 170 128 0 15 Apr 2021
SummVis: Interactive Visual Analysis of Models, Data, and Evaluation for Text SummarizationAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Jesse Vig Wojciech Kry'sciñski Karan Goel Nazneen Rajani 149 24 0 15 Apr 2021
Estimation of Summary-to-Text Inconsistency by Mismatched Embeddings Oleg V. Vasilyev John Bohannon HILM 94 7 0 12 Apr 2021
Towards objectively evaluating the quality of generated medical summaries Francesco Moramarco Damir Juric Aleksandar Savkov Ehud Reiter 70 9 0 09 Apr 2021
Annotating and Modeling Fine-grained Factuality in SummarizationNorth American Chapter of the Association for Computational Linguistics (NAACL), 2021 Tanya Goyal Greg Durrett HILM 136 162 0 09 Apr 2021
Nutribullets Hybrid: Multi-document Health Summarization Darsh J. Shah L. Yu Tao Lei Regina Barzilay 119 3 0 08 Apr 2021
Efficient Attentions for Long Document SummarizationNorth American Chapter of the Association for Computational Linguistics (NAACL), 2021 L. Huang Shuyang Cao Nikolaus Nova Parulian Heng Ji Lu Wang 206 338 0 05 Apr 2021
A New Approach to Overgenerating and Scoring Abstractive SummariesNorth American Chapter of the Association for Computational Linguistics (NAACL), 2021 Kaiqiang Song Bingqing Wang Z. Feng Fei Liu 152 18 0 05 Apr 2021
Mitigating Media Bias through Neutral Article Generation Nayeon Lee Yejin Bang Andrea Madotto Pascale Fung 95 8 0 01 Apr 2021
QuestEval: Summarization Asks for Fact-based EvaluationConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Thomas Scialom Paul-Alexis Dray Patrick Gallinari Sylvain Lamprier Benjamin Piwowarski Jacopo Staiano Alex Jinpeng Wang HILM 186 306 0 23 Mar 2021
Nutri-bullets: Summarizing Health Studies by Composing SegmentsAAAI Conference on Artificial Intelligence (AAAI), 2021 Darsh J. Shah L. Yu Tao Lei Regina Barzilay 134 10 0 22 Mar 2021
Play the Shannon Game With Language Models: A Human-Free Approach to Summary EvaluationAAAI Conference on Artificial Intelligence (AAAI), 2021 Nicholas Egan Oleg V. Vasilyev John Bohannon HILM 115 20 0 19 Mar 2021
Get Your Vitamin C! Robust Fact Verification with Contrastive EvidenceNorth American Chapter of the Association for Computational Linguistics (NAACL), 2021 Tal Schuster Adam Fisch Regina Barzilay 158 252 0 15 Mar 2021
WebRED: Effective Pretraining And Finetuning For Relation Extraction On The Web Róbert Ormándi Mohammad Saleh Erin Winter Vinay Rao 63 11 0 18 Feb 2021