Better Summarization Evaluation with Word Embeddings for ROUGE

25 August 2015

Papers citing "Better Summarization Evaluation with Word Embeddings for ROUGE"

31 / 81 papers shown

Title
FrugalScore: Learning Cheaper, Lighter and Faster Evaluation Metricsfor Automatic Text Generation Moussa Kamal Eddine Guokan Shang A. Tixier Michalis Vazirgiannis 77 28 0 16 Oct 2021
A Survey on Multi-modal Summarization Anubhav Jangra Sourajit Mukherjee Adam Jatowt S. Saha M. Hasanuzzaman 73 63 0 11 Sep 2021
SummerTime: Text Summarization Toolkit for Non-experts Ansong Ni Zhangir Azerbayev Mutethia Mutuma Troy Feng Yusen Zhang Tao Yu Ahmed Hassan Awadallah Dragomir R. Radev 103 10 0 29 Aug 2021
Attacks against Ranking Algorithms with Text Embeddings: a Case Study on Recruitment Algorithms A. Samadi Debapriya Banerjee Shirin Nilizadeh 63 1 0 12 Aug 2021
Summary Explorer: Visualizing the State of the Art in Text Summarization S. Syed Tariq Yousef Khalid Al Khatib S. Jänicke Martin Potthast ELM 76 9 0 04 Aug 2021
Controllable Abstractive Dialogue Summarization with Sketch Supervision Chien-Sheng Wu Linqing Liu Wenhao Liu Pontus Stenetorp Caiming Xiong 83 52 0 28 May 2021
The statistical advantage of automatic NLG metrics at the system level Johnny Tian-Zheng Wei Robin Jia 97 23 0 26 May 2021
Towards Human-Free Automatic Quality Evaluation of German Summarization Neslihan Iskender Oleg V. Vasilyev Tim Polzehl John Bohannon Sebastian Möller 58 1 0 13 May 2021
Play the Shannon Game With Language Models: A Human-Free Approach to Summary Evaluation Nicholas Egan Oleg V. Vasilyev John Bohannon HILM 52 20 0 19 Mar 2021
FFCI: A Framework for Interpretable Automatic Evaluation of Summarization Fajri Koto Timothy Baldwin Jey Han Lau HILM 113 37 0 27 Nov 2020
Multi-document Summarization via Deep Learning Techniques: A Survey Congbo Ma W. Zhang Mingyu Guo Hu Wang Quan Z. Sheng 125 129 0 10 Nov 2020
Metrics also Disagree in the Low Scoring Range: Revisiting Summarization Evaluation Metrics Manik Bhandari Pranav Narayan Gour A. Ashfaq Pengfei Liu 72 17 0 08 Nov 2020
Re-evaluating Evaluation in Text Summarization Manik Bhandari Pranav Narayan Gour A. Ashfaq Pengfei Liu Graham Neubig 189 178 0 14 Oct 2020
GRUEN for Evaluating Linguistic Quality of Generated Text Wanzheng Zhu S. Bhat 125 61 0 06 Oct 2020
A critical analysis of metrics used for measuring progress in artificial intelligence Kathrin Blagec Georg Dorffner M. Moradi Matthias Samwald 78 34 0 06 Aug 2020
Neural Language Generation: Formulation, Methods, and Evaluation Cristina Garbacea Qiaozhu Mei 165 30 0 31 Jul 2020
SummEval: Re-evaluating Summarization Evaluation Alexander R. Fabbri Wojciech Kry'sciñski Bryan McCann Caiming Xiong R. Socher Dragomir R. Radev HILM 157 725 0 24 Jul 2020
SueNes: A Weakly Supervised Approach to Evaluating Single-Document Summarization via Negative Sampling F. S. Bao Hebi Li Ge Luo Minghui Qiu Yinfei Yang Youbiao He Cen Chen 62 4 0 13 May 2020
SUPERT: Towards New Frontiers in Unsupervised Evaluation Metrics for Multi-Document Summarization Yang Gao Wei Zhao Steffen Eger ELM 128 126 0 07 May 2020
Reference and Document Aware Semantic Evaluation Methods for Korean Language Summarization Dongyub Lee M. Shin Taesun Whang Seung Woo Cho Byeongil Ko Daniel Lee EungGyun Kim Jaechoon Jo 95 13 0 29 Apr 2020
Extending Text Informativeness Measures to Passage Interestingness Evaluation (Language Model vs. Word Embedding) Carlos-Emiliano González-Gallardo Eric SanJuan Juan-Manuel Torres-Moreno 9 0 0 14 Apr 2020
Fill in the BLANC: Human-free quality estimation of document summaries Oleg V. Vasilyev Vedant Dharnidharka John Bohannon 3DH 122 119 0 23 Feb 2020
Controlling the Amount of Verbatim Copying in Abstractive Summarization Kaiqiang Song Bingqing Wang Z. Feng Liu Ren Fei Liu 80 51 0 23 Nov 2019
On Extractive and Abstractive Neural Document Summarization with Transformer Language Models Sandeep Subramanian Raymond Li Jonathan Pilault C. Pal 299 222 0 07 Sep 2019
MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance Wei Zhao Maxime Peyrard Fei Liu Yang Gao Christian M. Meyer Steffen Eger 274 602 0 05 Sep 2019
Answers Unite! Unsupervised Metrics for Reinforced Summarization Models Thomas Scialom Sylvain Lamprier Benjamin Piwowarski Jacopo Staiano 90 150 0 04 Sep 2019
Facet-Aware Evaluation for Extractive Summarization Yuning Mao Liyuan Liu Qi Zhu Xiang Ren Jiawei Han CVBM 83 20 0 27 Aug 2019
Neural Text Summarization: A Critical Evaluation Wojciech Kry'sciñski N. Keskar Bryan McCann Caiming Xiong R. Socher 126 368 0 23 Aug 2019
A Semantically Motivated Approach to Compute ROUGE Scores Elaheh Shafieibavani M. Ebrahimi R. Wong Fang Chen 21 4 0 20 Oct 2017
A Semantic QA-Based Approach for Text Summarization Evaluation Ping Chen Fei Wu Tong Wang Wei Ding 60 42 0 21 Apr 2017
Word2Vec vs DBnary: Augmenting METEOR using Vector Representations or Lexical Resources? Christophe Servan Alexandre Berard Z. Elloumi H. Blanchon Laurent Besacier 43 17 0 05 Oct 2016