Towards a Better Metric for Evaluating Question Generation Systems

30 August 2018

Mitesh M. Khapra

Papers citing "Towards a Better Metric for Evaluating Question Generation Systems"

25 / 25 papers shown

Title
MIRROR: A Novel Approach for the Automated Evaluation of Open-Ended Question Generation Aniket Deroy Subhankar Maity Sudeshna Sarkar LLMAG LRM 41 3 0 16 Oct 2024
Automatic Answerability Evaluation for Question Generation Zifan Wang Kotaro Funakoshi Manabu Okumura 26 2 0 22 Sep 2023
SkillQG: Learning to Generate Question for Reading Comprehension Assessment Xiaoqiang Wang Bang Liu Siliang Tang Lingfei Wu 23 3 0 08 May 2023
A Pipeline for Generating, Annotating and Employing Synthetic Data for Real World Question Answering Matthew Maufe James Ravenscroft Rob Procter Maria Liakata 24 3 0 30 Nov 2022
Evaluating the Knowledge Dependency of Questions Hyeongdon Moon Yoonseok Yang Jamin Shin Hangyeol Yu Seunghyun Lee Myeongho Jeong Juneyoung Park Minsam Kim Seungtaek Choi AI4Ed 23 10 0 21 Nov 2022
RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question Alireza Mohammadshahi Thomas Scialom Majid Yazdani Pouya Yanki Angela Fan James Henderson Marzieh Saeidi 26 20 0 02 Nov 2022
Generative Language Models for Paragraph-Level Question Generation Asahi Ushio Fernando Alva-Manchego Jose Camacho-Collados ELM 13 45 0 08 Oct 2022
Of Human Criteria and Automatic Metrics: A Benchmark of the Evaluation of Story Generation Cyril Chhun Pierre Colombo Chloé Clavel Fabian M. Suchanek 53 50 0 24 Aug 2022
Studying the role of named entities for content preservation in text style transfer N. Babakov David Dale V. Logacheva I. Krotova Alexander Panchenko 13 2 0 20 Jun 2022
QRelScore: Better Evaluating Generated Questions with Deeper Understanding of Context-aware Relevance Xiaoqiang Wang Bang Liu Siliang Tang Lingfei Wu 21 9 0 29 Apr 2022
A Feasibility Study of Answer-Agnostic Question Generation for Education Liam Dugan E. Miltsakaki Shriyash Upadhyay Etan Ginsberg Hannah Gonzalez Dayheon Choi Chuning Yuan Chris Callison-Burch 27 12 0 16 Mar 2022
Feeding What You Need by Understanding What You Learned Xiaoqiang Wang Bang Liu Fangli Xu Bowei Long Siliang Tang Lingfei Wu 57 6 0 05 Mar 2022
It is AI's Turn to Ask Humans a Question: Question-Answer Pair Generation for Children's Story Books Bingsheng Yao Dakuo Wang Tongshuang Wu Zheng Zhang Toby Jia-Jun Li Mo Yu Ying Xu AI4Ed 23 43 0 08 Sep 2021
Semantic Answer Similarity for Evaluating Question Answering Models Julian Risch Timo Moller Julian Gutsch M. Pietsch ELM 30 67 0 13 Aug 2021
Controllable Open-ended Question Generation with A New Question Type Ontology Shuyang Cao Lu Wang 10 49 0 01 Jul 2021
DORB: Dynamically Optimizing Multiple Rewards with Bandits Ramakanth Pasunuru Han Guo Mohit Bansal OffRL 30 6 0 15 Nov 2020
Multi-hop Question Generation with Graph Convolutional Network Dan Su Yan Xu Wenliang Dai Ziwei Ji Tiezheng Yu Pascale Fung 21 39 0 19 Oct 2020
A Survey of Evaluation Metrics Used for NLG Systems Ananya B. Sai Akash Kumar Mohankumar Mitesh M. Khapra ELM 25 228 0 27 Aug 2020
Evaluation of Text Generation: A Survey Asli Celikyilmaz Elizabeth Clark Jianfeng Gao ELM LM&MA 19 376 0 26 Jun 2020
To Test Machine Comprehension, Start by Defining Comprehension Jesse Dunietz Greg Burnham Akash Bharadwaj Owen Rambow Jennifer Chu-Carroll D. Ferrucci FaML 54 65 0 04 May 2020
Addressing Semantic Drift in Question Generation for Semi-Supervised Question Answering Shiyue Zhang Mohit Bansal 21 140 0 13 Sep 2019
Let's Ask Again: Refine Network for Automatic Question Generation Preksha Nema Akash Kumar Mohankumar Mitesh M. Khapra Balaji Vasan Srinivasan Balaraman Ravindran 27 51 0 31 Aug 2019
Reinforcement Learning Based Graph-to-Sequence Model for Natural Question Generation Yu Chen Lingfei Wu Mohammed J. Zaki GNN 17 153 0 14 Aug 2019
Handling Divergent Reference Texts when Evaluating Table-to-Text Generation Bhuwan Dhingra Manaal Faruqui Ankur P. Parikh Ming-Wei Chang Dipanjan Das William W. Cohen 18 194 0 03 Jun 2019
Re-evaluating ADEM: A Deeper Look at Scoring Dialogue Responses Ananya B. Sai Mithun Das Gupta Mitesh M. Khapra Mukundhan Srinivasan 23 48 0 23 Feb 2019