Fill in the BLANC: Human-free quality estimation of document summaries

23 February 2020

Papers citing "Fill in the BLANC: Human-free quality estimation of document summaries"

50 / 69 papers shown

Title
LecEval: An Automated Metric for Multimodal Knowledge Acquisition in Multimedia Learning Joy Lim Jia Yin Daniel Zhang-Li Jifan Yu H. Li Shangqing Tu ... Zhiyuan Liu Huiqin Liu Lei Hou Juanzi Li Bin Xu 24 0 0 04 May 2025
HELIOS: Adaptive Model And Early-Exit Selection for Efficient LLM Inference Serving Avinash Kumar Shashank Nag Jason Clemons L. John Poulami Das 26 0 0 14 Apr 2025
From Speech to Summary: A Comprehensive Survey of Speech Summarization Fabian Retkowski Maike Züfle Andreas Sudmann Dinah Pfau Jan Niehues Alexander Waibel 39 0 0 10 Apr 2025
PreSumm: Predicting Summarization Performance Without Summarizing Steven Koniaev Ori Ernst Jackie Chi Kit Cheung 26 0 0 07 Apr 2025
TathyaNyaya and FactLegalLlama: Advancing Factual Judgment Prediction and Explanation in the Indian Legal Context S. Nigam Balaramamahanthi Deepak Patnaik Shivam Mishra Noel Shallum Kripabandhu Ghosh Arnab Bhattacharya AILaw ELM 50 0 0 07 Apr 2025
Gaussian Process Tilted Nonparametric Density Estimation using Fisher Divergence Score Matching John Paisley Wei Zhang Brian Barr 38 0 0 04 Apr 2025
News is More than a Collection of Facts: Moral Frame Preserving News Summarization Enrico Liscio Michela Lorandi P. Murukannaiah 36 0 0 01 Apr 2025
Summarization Metrics for Spanish and Basque: Do Automatic Scores and LLM-Judges Correlate with Humans? Jeremy Barnes Naiara Perez Alba Bonet-Jover Begoña Altuna 54 1 0 21 Mar 2025
Context-Aware Deep Learning for Multi Modal Depression Detection Genevieve Lam Huang Dongyan Weisi Lin 26 0 0 26 Dec 2024
Summarizing long regulatory documents with a multi-step pipeline Mika Sie Ruby Beek Michiel Bots S. Brinkkemper Albert Gatt AILaw ELM 27 1 0 19 Aug 2024
Speech vs. Transcript: Does It Matter for Human Annotators in Speech Summarization? Roshan S. Sharma Suwon Shon Mark Lindsey Hira Dhamyal Rita Singh Bhiksha Raj 43 1 0 12 Aug 2024
PlagBench: Exploring the Duality of Large Language Models in Plagiarism Generation and Detection Jooyoung Lee Toshini Agrawal Adaku Uchendu Thai V. Le Jinghui Chen Dongwon Lee 23 1 0 24 Jun 2024
A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Models Haopeng Zhang Philip S. Yu Jiawei Zhang 35 14 0 17 Jun 2024
Legal Judgment Reimagined: PredEx and the Rise of Intelligent AI Interpretation in Indian Courts S. Nigam Anurag Sharma Danush Khanna Noel Shallum Kripabandhu Ghosh Arnab Bhattacharya ELM AILaw 32 9 0 06 Jun 2024
Favi-Score: A Measure for Favoritism in Automated Preference Ratings for Generative AI Evaluation Pius von Daniken Jan Deriu Don Tuggener Mark Cieliebak 14 1 0 03 Jun 2024
Do Language Models Enjoy Their Own Stories? Prompting Large Language Models for Automatic Story Evaluation Cyril Chhun Fabian M. Suchanek Chloé Clavel LRM 42 13 0 22 May 2024
Large Language Models are Inconsistent and Biased Evaluators Rickard Stureborg Dimitris Alikaniotis Yoshi Suhara ALM 32 50 0 02 May 2024
REFeREE: A REference-FREE Model-Based Metric for Text Simplification Yichen Huang Ekaterina Kochmar 43 1 0 26 Mar 2024
Information-Theoretic Distillation for Reference-less Summarization Jaehun Jung Ximing Lu Liwei Jiang Faeze Brahman Peter West Pang Wei Koh Yejin Choi 28 3 0 20 Mar 2024
LOCOST: State-Space Models for Long Document Abstractive Summarization Florian Le Bronnec Song Duong Mathieu Ravaut Alexandre Allauzen Nancy F. Chen Vincent Guigue Alberto Lumbreras Laure Soulier Patrick Gallinari 40 7 0 31 Jan 2024
Evaluating GPT-3.5's Awareness and Summarization Abilities for European Constitutional Texts with Shared Topics C. M. Greco Andrea Tagarelli AILaw ELM 14 0 0 25 Jan 2024
Knowledge-Centric Templatic Views of Documents Isabel Cachola Silviu Cucerzan Allen Herring Vuksan Mijovic Erik Oveson S. Jauhar 10 1 0 13 Jan 2024
LUNA: A Framework for Language Understanding and Naturalness Assessment Marat Saidov A. Bakalova Ekaterina Taktasheva Vladislav Mikhailov Ekaterina Artemova ELM 25 1 0 09 Jan 2024
Zero-shot Conversational Summarization Evaluations with small Large Language Models R. Manuvinakurike Saurav Sahay Sangeeta Manepalli L. Nachman ELM LM&MA 22 0 0 29 Nov 2023
Controllable Text Summarization: Unraveling Challenges, Approaches, and Prospects -- A Survey Ashok Urlana Pruthwik Mishra Tathagato Roy Rahul Mishra 21 8 0 15 Nov 2023
OpinSummEval: Revisiting Automated Evaluation for Opinion Summarization Yuchen Shen Xiaojun Wan 12 9 0 27 Oct 2023
BooookScore: A systematic exploration of book-length summarization in the era of LLMs Yapei Chang Kyle Lo Tanya Goyal Mohit Iyyer ALM 13 106 0 01 Oct 2023
ALens: An Adaptive Domain-Oriented Abstract Writing Training Tool for Novice Researchers Chen Cheng Ziang Li Zhenhui Peng Quan Li 17 0 0 08 Aug 2023
Mapping the Challenges of HCI: An Application and Evaluation of ChatGPT and GPT-4 for Mining Insights at Scale Jonas Oppenlaender Joonas Hamalainen 15 6 0 08 Jun 2023
Correction of Errors in Preference Ratings from Automated Metrics for Text Generation Jan Deriu Pius von Daniken Don Tuggener Mark Cieliebak 19 2 0 06 Jun 2023
Hybrid Long Document Summarization using C2F-FAR and ChatGPT: A Practical Study Guang Lu Sylvia B. Larcher Tu-Anh Tran 8 9 0 01 Jun 2023
UMSE: Unified Multi-scenario Summarization Evaluation Shen Gao Zhitao Yao Chongyang Tao Xiuying Chen Pengjie Ren Z. Ren Zhumin Chen 20 5 0 26 May 2023
AlignScore: Evaluating Factual Consistency with a Unified Alignment Function Yuheng Zha Yichi Yang Ruichen Li Zhiting Hu HILM 9 176 0 26 May 2023
Neural Natural Language Processing for Long Texts: A Survey on Classification and Summarization Dimitrios Tsirmpas Ioannis Gkionis Georgios Th. Papadopoulos Ioannis Mademlis AILaw AI4TS AI4CE 20 17 0 25 May 2023
Evaluating Evaluation Metrics: A Framework for Analyzing NLG Evaluation Metrics using Measurement Theory Ziang Xiao Susu Zhang Vivian Lai Q. V. Liao ELM 30 23 0 24 May 2023
Evaluating OpenAI's Whisper ASR for Punctuation Prediction and Topic Modeling of life histories of the Museum of the Person L. Gris R. Marcacini Arnaldo Cândido Júnior Edresson Casanova A. S. Soares S. Aluísio 13 7 0 23 May 2023
Automated Metrics for Medical Multi-Document Summarization Disagree with Human Evaluations Lucy Lu Wang Yulia Otmakhova Jay DeYoung Thinh Hung Truong Bailey Kuehl Erin Bransom Byron C. Wallace 97 20 0 23 May 2023
Revisiting Automatic Question Summarization Evaluation in the Biomedical Domain Hongyi Yuan Yaoyun Zhang Fei Huang Songfang Huang 13 1 0 18 Mar 2023
Benchmarking Large Language Models for News Summarization Tianyi Zhang Faisal Ladhak Esin Durmus Percy Liang Kathleen McKeown Tatsunori B. Hashimoto ELM 11 474 0 31 Jan 2023
A comprehensive review of automatic text summarization techniques: method, data, evaluation and coding D. Cajueiro A. G. Nery Igor Tavares Maísa Kely de Melo Silvia A. dos Reis Weigang Li V. R. R. Celestino 17 15 0 04 Jan 2023
DocAsRef: An Empirical Study on Repurposing Reference-Based Summary Quality Metrics Reference-Freely F. S. Bao Ruixuan Tu Ge Luo Yinfei Yang Hebi Li Minghui Qiu Youbiao He Cen Chen 4 2 0 20 Dec 2022
Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluation Yixin Liu Alexander R. Fabbri Pengfei Liu Yilun Zhao Linyong Nan ... Simeng Han Shafiq R. Joty Chien-Sheng Wu Caiming Xiong Dragomir R. Radev ALM 10 132 0 15 Dec 2022
Questioning the Validity of Summarization Datasets and Improving Their Factual Consistency Yanzhu Guo Chloé Clavel Moussa Kamal Eddine Michalis Vazirgiannis HILM 16 11 0 31 Oct 2022
On the Limitations of Reference-Free Evaluations of Generated Text Daniel Deutsch Rotem Dror Dan Roth 32 45 0 22 Oct 2022
Just ClozE! A Novel Framework for Evaluating the Factual Consistency Faster in Abstractive Summarization Yiyang Li Lei Li Marina Litvak N. Vanetik Dingxing Hu Yuze Li Yanquan Zhou HILM 25 0 0 06 Oct 2022
Probing of Quantitative Values in Abstractive Summarization Models Nathan M. White 11 0 0 03 Oct 2022
News Summarization and Evaluation in the Era of GPT-3 Tanya Goyal Junyi Jessy Li Greg Durrett ELM 16 381 0 26 Sep 2022
Of Human Criteria and Automatic Metrics: A Benchmark of the Evaluation of Story Generation Cyril Chhun Pierre Colombo Chloé Clavel Fabian M. Suchanek 49 50 0 24 Aug 2022
Neural Embeddings for Text Oleg V. Vasilyev John Bohannon MILM 11 2 0 17 Aug 2022
Abstractive Meeting Summarization: A Survey Virgile Rennard Guokan Shang Julie Hunter Michalis Vazirgiannis 18 15 0 08 Aug 2022