Revisiting Summarization Evaluation for Scientific Articles

1 April 2016

Arman Cohan

Papers citing "Revisiting Summarization Evaluation for Scientific Articles"

35 / 35 papers shown

Title
Revisiting Uncertainty Quantification Evaluation in Language Models: Spurious Interactions with Response Length Bias Results Andrea Santilli Adam Goliñski Michael Kirchhof Federico Danieli Arno Blaas Miao Xiong Luca Zappella Sinead Williamson 69 3 0 18 Apr 2025
CaseSumm: A Large-Scale Dataset for Long-Context Summarization from U.S. Supreme Court Opinions Mourad Heddaya Kyle MacMillan Anup Malani Hongyuan Mei Chenhao Tan AILaw ELM 74 2 0 03 Jan 2025
RiTeK: A Dataset for Large Language Models Complex Reasoning over Textual Knowledge Graphs Jiatan Huang Mingchen Li Zonghai Yao Zhichao Yang Yongkang Xiao Feiyun Ouyang Xiaohan Li Shuo Han Hong-ye Yu RALM 140 3 0 17 Oct 2024
LLMs4Synthesis: Leveraging Large Language Models for Scientific Synthesis Hamed Babaei Giglou Jennifer D'Souza Sören Auer 75 5 0 27 Sep 2024
Evaluation of Large Language Models for Summarization Tasks in the Medical Domain: A Narrative Review Emma Croxford Yanjun Gao Nicholas Pellegrino Karen K. Wong Graham Wills Elliot First Frank J. Liao Cherodeep Goswami Brian Patterson Majid Afshar HILM ELM LM&MA 129 1 0 26 Sep 2024
Large Language Models as Evaluators for Scientific Synthesis Julia Evans Jennifer D'Souza Sören Auer ELM 97 4 0 03 Jul 2024
CancerLLM: A Large Language Model in Cancer Domain Mingchen Li Jiatan Huang Jeremy Yeung A. Blaes Steven Johnson Hongfang Liu Hua Xu Rui Zhang ELM LM&MA 150 5 0 15 Jun 2024
LocalRQA: From Generating Data to Locally Training, Testing, and Deploying Retrieval-Augmented QA Systems Xiao Yu Yunan Lu Zhou Yu RALM 73 7 0 01 Mar 2024
Rethinking Scientific Summarization Evaluation: Grounding Explainable Metrics on Facet-aware Benchmark Preslav Nakov Tairan Wang Qingqing Zhu Taicheng Guo Shen Gao Zhiyong Lu Xin Gao Xiangliang Zhang 214 4 0 22 Feb 2024
Revisiting Zero-Shot Abstractive Summarization in the Era of Large Language Models from the Perspective of Position Bias Anshuman Chhabra Hadi Askari Prasant Mohapatra 73 21 0 03 Jan 2024
Redundancy Aware Multi-Reference Based Gainwise Evaluation of Extractive Summarization Mousumi Akter Shubhra (Santu) Karmaker 58 1 0 04 Aug 2023
USB: A Unified Summarization Benchmark Across Tasks and Domains Kundan Krishna Prakhar Gupta S. Ramprasad Byron C. Wallace Jeffrey P. Bigham Zachary Chase Lipton HILM 91 8 0 23 May 2023
Understand the Dynamic World: An End-to-End Knowledge Informed Framework for Open Domain Entity State Tracking Mingchen Li Lifu Huang 110 10 0 26 Apr 2023
Curriculum-Guided Abstractive Summarization Sajad Sotudeh Hanieh Deilamsalehy Franck Dernoncourt Nazli Goharian 84 2 0 02 Feb 2023
Curriculum-guided Abstractive Summarization for Mental Health Online Posts Sajad Sotudeh Nazli Goharian Hanieh Deilamsalehy Franck Dernoncourt AI4MH 20 5 0 02 Feb 2023
A comprehensive review of automatic text summarization techniques: method, data, evaluation and coding D. Cajueiro A. G. Nery Igor Tavares Maísa Kely de Melo Silvia A. dos Reis Weigang Li V. R. R. Celestino 82 15 0 04 Jan 2023
Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluation Yixin Liu Alexander R. Fabbri Pengfei Liu Yilun Zhao Linyong Nan ... Simeng Han Shafiq Joty Chien-Sheng Wu Caiming Xiong Dragomir R. Radev ALM 86 134 0 15 Dec 2022
Prompted Opinion Summarization with GPT-3.5 Adithya Bhaskar Alexander R. Fabbri Greg Durrett ELM 52 56 0 29 Nov 2022
MentSum: A Resource for Exploring Summarization of Mental Health Online Posts Sajad Sotudeh Nazli Goharian Zachary Young AI4MH 58 13 0 02 Jun 2022
TSTR: Too Short to Represent, Summarize with Details! Intro-Guided Extended Summary Generation Sajad Sotudeh Nazli Goharian 48 6 0 02 Jun 2022
Multi-Narrative Semantic Overlap Task: Evaluation and Benchmark Naman Bansal Mousumi Akter Shubhra (Santu) Karmaker 73 0 0 14 Jan 2022
GeSERA: General-domain Summary Evaluation by Relevance Analysis Jessica Nayeli López Espejel Gaël de Chalendar J. G. Flores Thierry Charnois Ivan Vladimir Meza Ruiz 29 0 0 07 Oct 2021
Cut the CARP: Fishing for zero-shot story evaluation Shahbuland Matiana J. Smith Ryan Teehan Louis Castricato Stella Biderman Leo Gao Spencer Frazier 122 16 0 06 Oct 2021
Evaluating the Efficacy of Summarization Evaluation across Languages Fajri Koto Jey Han Lau Timothy Baldwin 108 19 0 02 Jun 2021
Towards Clinical Encounter Summarization: Learning to Compose Discharge Summaries from Prior Notes Han-Chin Shing Chaitanya P. Shivade Nima Pourdamghani Feng Nan Philip Resnik Douglas W. Oard Parminder Bhatia 88 26 0 27 Apr 2021
Neural Language Generation: Formulation, Methods, and Evaluation Cristina Garbacea Qiaozhu Mei 158 30 0 31 Jul 2020
SummEval: Re-evaluating Summarization Evaluation Alexander R. Fabbri Wojciech Kry'sciñski Bryan McCann Caiming Xiong R. Socher Dragomir R. Radev HILM 142 724 0 24 Jul 2020
Evaluation of Text Generation: A Survey Asli Celikyilmaz Elizabeth Clark Jianfeng Gao ELM LM&MA 156 389 0 26 Jun 2020
Attend to Medical Ontologies: Content Selection for Clinical Abstractive Summarization Sajad Sotudeh Nazli Goharian Ross W. Filice 66 56 0 01 May 2020
TLDR: Extreme Summarization of Scientific Documents Isabel Cachola Kyle Lo Arman Cohan Daniel S. Weld 157 217 0 30 Apr 2020
Abstractive Text Summarization based on Language Model Conditioning and Locality Modeling Dmitrii Aksenov J. Moreno-Schneider Peter Bourgonje Robert Schwarzenberg Leonhard Hennig Georg Rehm 115 26 0 29 Mar 2020
Fill in the BLANC: Human-free quality estimation of document summaries Oleg V. Vasilyev Vedant Dharnidharka John Bohannon 3DH 110 119 0 23 Feb 2020
ScisummNet: A Large Annotated Corpus and Content-Impact Models for Scientific Paper Summarization with Citation Networks Michihiro Yasunaga Jungo Kasai Rui Zhang Alexander R. Fabbri Irene Li Dan Friedman Dragomir R. Radev 147 209 0 04 Sep 2019
Ontology-Aware Clinical Abstractive Summarization Sean MacAvaney Sajad Sotudeh Arman Cohan Nazli Goharian Ish A. Talati Ross W. Filice 40 83 0 14 May 2019
A Novel ILP Framework for Summarizing Content with High Lexical Variety Wencan Luo Fei Liu Zitao Liu Diane Litman 31 5 0 25 Jul 2018