Evaluating the Factual Consistency of Abstractive Text Summarization

Conference on Empirical Methods in Natural Language Processing (EMNLP), 2019

28 October 2019

Papers citing "Evaluating the Factual Consistency of Abstractive Text Summarization"

50 / 491 papers shown

Title
HistAlign: Improving Context Dependency in Language Generation by Aligning with HistoryConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 David Wan Shiyue Zhang Joey Tianyi Zhou AI4TS 140 7 0 08 May 2023
Expository Text Generation: Imitate, Retrieve, ParaphraseConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Nishant Balepur Jie Huang Kevin Chen-Chuan Chang 151 10 0 05 May 2023
Entity-Based Evaluation of Political Bias in Automatic SummarizationConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Karen Zhou Chenhao Tan 181 2 0 03 May 2023
Can LMs Generalize to Future Data? An Empirical Analysis on Text SummarizationConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 C. Cheang Hou Pong Chan Derek F. Wong Xuebo Liu Zhao Li Yanming Sun Shudong Liu Lidia S. Chao 369 9 0 03 May 2023
DiffuSum: Generation Enhanced Extractive Summarization with DiffusionAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Haopeng Zhang Xiao Liu Jiawei Zhang DiffM 184 47 0 02 May 2023
Text-Blueprint: An Interactive Platform for Plan-based Conditional GenerationConference of the European Chapter of the Association for Computational Linguistics (EACL), 2023 Fantine Huot Joshua Maynez Shashi Narayan Reinald Kim Amplayo Kuzman Ganchev Annie Louis Anders Sandholm Dipanjan Das Mirella Lapata 168 9 0 28 Apr 2023
Learning Human-Human Interactions in Images from Weak Textual SupervisionIEEE International Conference on Computer Vision (ICCV), 2023 Morris Alper Hadar Averbuch-Elor VLM 227 4 0 27 Apr 2023
A Survey for Biomedical Text Summarization: From Pre-trained to Large Language Models Qianqian Xie Zheheng Luo Benyou Wang Sophia Ananiadou LM&MA VLM 114 13 0 18 Apr 2023
OpenAssistant Conversations -- Democratizing Large Language Model AlignmentNeural Information Processing Systems (NeurIPS), 2023 Andreas Kopf Yannic Kilcher Dimitri von Rutte Sotiris Anagnostidis Zhi Rui Tam ... Arnav Dantuluri Andrew Maguire Christoph Schuhmann Huu Nguyen A. Mattick ALM LM&MA 256 744 0 14 Apr 2023
Extractive Summarization via ChatGPT for Faithful Summary GenerationConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Haopeng Zhang Xiao Liu Jiawei Zhang 159 98 0 09 Apr 2023
Human-like Summarization Evaluation with ChatGPT Mingqi Gao Jie Ruan Renliang Sun Xunjian Yin Shiping Yang Xiaojun Wan ALM AI4MH 136 159 0 05 Apr 2023
G-Eval: NLG Evaluation using GPT-4 with Better Human AlignmentConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Yang Liu Dan Iter Yichong Xu Shuohang Wang Ruochen Xu Chenguang Zhu ELM ALM LM&MA 377 1,600 0 29 Mar 2023
ChatGPT as a Factual Inconsistency Evaluator for Text Summarization Zheheng Luo Qianqian Xie Sophia Ananiadou ELM HILM ALM 136 93 0 27 Mar 2023
SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Potsawee Manakul Adian Liusie Mark Gales HILM LRM 341 591 0 15 Mar 2023
Automatically Summarizing Evidence from Clinical Trials: A Prototype Highlighting Current ChallengesConference of the European Chapter of the Association for Computational Linguistics (EACL), 2023 S. Ramprasad Denis Jered McInerney Iain J. Marshal Byron C. Wallace 158 13 0 07 Mar 2023
A Meta-Evaluation of Faithfulness Metrics for Long-Form Hospital-Course SummarizationMachine Learning in Health Care (MLHC), 2023 Griffin Adams Jason Zucker Noémie Elhadad 139 26 0 07 Mar 2023
Faithfulness-Aware Decoding Strategies for Abstractive SummarizationConference of the European Chapter of the Association for Computational Linguistics (EACL), 2023 David Wan Mengwen Liu Kathleen McKeown Markus Dreyer Joey Tianyi Zhou HILM 200 39 0 06 Mar 2023
Models See Hallucinations: Evaluating the Factuality in Video CaptioningConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Hui Liu Xiaojun Wan HILM 114 16 0 06 Mar 2023
Factual Consistency Oriented Speech RecognitionInterspeech (Interspeech), 2023 Naoyuki Kanda Takuya Yoshioka Yang Liu 130 1 0 24 Feb 2023
Learning with Rejection for Abstractive Text SummarizationConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Mengyao Cao Yue Dong Jingyi He Jackie C.K. Cheung 144 9 0 16 Feb 2023
Leveraging Summary Guidance on Medical Report SummarizationIEEE journal of biomedical and health informatics (IEEE JBHI), 2023 Yunqi Zhu Xuebing Yang Yuanyuan Wu Wensheng Zhang 148 15 0 08 Feb 2023
Do Multi-Document Summarization Models Synthesize?Transactions of the Association for Computational Linguistics (TACL), 2023 Jay DeYoung Stephanie C. Martinez Iain J. Marshall Byron C. Wallace 163 9 0 31 Jan 2023
LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form SummarizationConference of the European Chapter of the Association for Computational Linguistics (EACL), 2023 Kalpesh Krishna Erin Bransom Bailey Kuehl Mohit Iyyer Pradeep Dasigi Arman Cohan Kyle Lo 156 109 0 30 Jan 2023
MQAG: Multiple-choice Question Answering and Generation for Assessing Information Consistency in SummarizationInternational Joint Conference on Natural Language Processing (IJCNLP), 2023 Potsawee Manakul Adian Liusie Mark Gales HILM 143 41 0 28 Jan 2023
SWING: Balancing Coverage and Faithfulness for Dialogue SummarizationFindings (Findings), 2023 Kung-Hsiang Huang Siffi Singh Xiaofei Ma Wei Xiao Wei Xiao Nicholas Dingwall William Yang Wang Kathleen McKeown HILM 138 14 0 25 Jan 2023
On the State of German (Abstractive) Text SummarizationDatenbanksysteme für Business, Technologie und Web (BTW), 2023 Dennis Aumiller Jing Fan Michael Gertz 123 1 0 17 Jan 2023
Active Learning for Abstractive Text SummarizationConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Akim Tsvigun Ivan Lysenko Danila Sedashov Ivan Lazichny Eldar Damirov ... Leonid Sanochkin Maxim Panov Sergey Petrakov Andrey Kravchenko Artem Shelmanov 123 12 0 09 Jan 2023
A Survey on Knowledge-Enhanced Pre-trained Language Models Chaoqi Zhen Yanlei Shang Xiangyu Liu Yifei Li Yong Chen Dell Zhang VLM KELM 140 3 0 27 Dec 2022
PropSegmEnt: A Large-Scale Corpus for Proposition-Level Segmentation and Entailment RecognitionAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Sihao Chen S. Buthpitiya Alex Fabrikant Dan Roth Tal Schuster 112 28 0 21 Dec 2022
mFACE: Multilingual Summarization with Factual Consistency EvaluationAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Roee Aharoni Shashi Narayan Joshua Maynez Jonathan Herzig Elizabeth Clark Mirella Lapata HILM 180 49 0 20 Dec 2022
Toward Human-Like Evaluation for Natural Language Generation with Error AnalysisAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Qingyu Lu Liang Ding Liping Xie Kanjian Zhang Derek F. Wong Dacheng Tao ELM ALM 138 19 0 20 Dec 2022
WeCheck: Strong Factual Consistency Checker via Weakly Supervised LearningAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Wenhao Wu Wei Li Xinyan Xiao Jiachen Liu Sujian Li Yajuan Lv HILM 177 8 0 20 Dec 2022
On the Blind Spots of Model-Based Evaluation Metrics for Text GenerationAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Tianxing He Jingyu Zhang Tianle Wang Sachin Kumar Kyunghyun Cho James R. Glass Yulia Tsvetkov 219 55 0 20 Dec 2022
On Improving Summarization Factual Consistency from Natural Language FeedbackAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Yixin Liu Budhaditya Deb Milagro Teruel Aaron L Halfaker Dragomir R. Radev Ahmed Hassan Awadallah HILM 137 43 0 20 Dec 2022
BUMP: A Benchmark of Unfaithful Minimal Pairs for Meta-Evaluation of Faithfulness MetricsAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Liang Ma Shuyang Cao IV RobertL.Logan Di Lu Shihao Ran Kecheng Zhang Joel R. Tetreault A. Jaimes 112 7 0 20 Dec 2022
Inverse Reinforcement Learning for Text SummarizationConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Yujiao Fu Deyi Xiong Yue Dong 163 4 0 19 Dec 2022
Improving Faithfulness of Abstractive Summarization by Controlling Confounding Effect of Irrelevant Sentences Asish Ghoshal Arash Einolghozati A. Arun Haoran Li L. Yu Vera Gor Yashar Mehdad Scott Yih Asli Celikyilmaz HILM 110 1 0 19 Dec 2022
SESCORE2: Learning Text Generation Evaluation via Synthesizing Realistic MistakesAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Wenda Xu Xian Qian Mingxuan Wang Lei Li William Yang Wang 110 13 0 19 Dec 2022
Saved You A Click: Automatically Answering Clickbait Titles Andrey Kurenkov TA Mentor Yian Zhang O. Johnson 78 7 0 15 Dec 2022
Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human EvaluationAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Yixin Liu Alexander R. Fabbri Pengfei Liu Yilun Zhao Linyong Nan ... Simeng Han Shafiq Joty Chien-Sheng Wu Caiming Xiong Dragomir R. Radev ALM 176 150 0 15 Dec 2022
KATSum: Knowledge-aware Abstractive Text Summarization Guan-Hua Wang Weihua Li E. Lai Jianhua Jiang 110 2 0 06 Dec 2022
Improved Beam Search for Hallucination Mitigation in Abstractive Summarization A. Sridhar Erik M. Visser HILM 179 16 0 06 Dec 2022
CoP: Factual Inconsistency Detection by Controlling the PreferenceAAAI Conference on Artificial Intelligence (AAAI), 2022 Shuaijie She Xiang Geng Shujian Huang Jiajun Chen 163 5 0 03 Dec 2022
SumREN: Summarizing Reported Speech about Events in NewsAAAI Conference on Artificial Intelligence (AAAI), 2022 R. Reddy Heba Elfardy Hou Pong Chan Kevin Small Chenhui Xu 149 5 0 02 Dec 2022
Revisiting text decomposition methods for NLI-based factuality scoring of summariesIEEE Games Entertainment Media Conference (GEM), 2022 John Glover Federico Fancellu V. Jagannathan Matthew R. Gormley Thomas Schaaf HILM 150 17 0 30 Nov 2022
Prompted Opinion Summarization with GPT-3.5Annual Meeting of the Association for Computational Linguistics (ACL), 2022 Adithya Bhaskar Alexander R. Fabbri Greg Durrett ELM 170 67 0 29 Nov 2022
HaRiM $^+$ : Evaluating Summary Quality with Hallucination Risk Seonil Son Junsoo Park J. Hwang Junghwa Lee Hyungjong Noh Yeonsoo Lee HILM 162 11 0 22 Nov 2022
Best- $k$ Search Algorithm for Neural Text GenerationAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Jiacheng Xu Caiming Xiong Silvio Savarese Yingbo Zhou 128 7 0 22 Nov 2022
GoSum: Extractive Summarization of Long Documents by Reinforcement Learning and Graph Organized discourse stateKnowledge and Information Systems (KAIS), 2022 Junyi Bian Xiaodi Huang Hong Zhou Shanfeng Zhu 121 14 0 18 Nov 2022
UniSumm and SummZoo: Unified Model and Diverse Benchmark for Few-Shot SummarizationAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Yulong Chen Yang Liu Ruochen Xu Ziyi Yang Chenguang Zhu Michael Zeng Yue Zhang 135 21 0 17 Nov 2022

All Papers

Evaluating the Factual Consistency of Abstractive Text Summarization

Papers citing "Evaluating the Factual Consistency of Abstractive Text Summarization"