v1v2 (latest)

What do Models Learn from Question Answering Datasets?

7 April 2020

ArXiv (abs)PDF HTML Github (55★)

Papers citing "What do Models Learn from Question Answering Datasets?"

46 / 46 papers shown

Title
A Survey of the State-of-the-Art in Conversational Question Answering Systems Manoj Madushanka Perera A. Mahmood Kasun Eranda Wijethilake Fahmida Islam Maryam Tahermazandarani Quan Z. Sheng ELM 81 0 0 06 Sep 2025
Shortcut Learning in In-Context Learning: A Survey Rui Song Yingji Li Fausto Giunchiglia Fausto Giunchiglia Hao Xu 159 3 0 04 Nov 2024
The Mystery of Compositional Generalization in Graph-based Generative Commonsense Reasoning Xiyan Fu Anette Frank LRM 177 1 0 08 Oct 2024
It Is Not About What You Say, It Is About How You Say It: A Surprisingly Simple Approach for Improving Reading Comprehension Sagi Shaier Lawrence E Hunter Katharina von der Wense 136 4 0 24 Jun 2024
First Heuristic Then Rational: Dynamic Use of Heuristics in Language Model Reasoning Yoichi Aoki Keito Kudo Tatsuki Kuribayashi Shusaku Sone Masaya Taniguchi Keisuke Sakaguchi Kentaro Inui LRM 159 1 0 23 Jun 2024
TIGQA:An Expert Annotated Question Answering Dataset in Tigrinya Hailay Teklehaymanot Dren Fazlija Niloy Ganguly Gourab K. Patro Wolfgang Nejdl 136 2 0 26 Apr 2024
From Form(s) to Meaning: Probing the Semantic Depths of Language Models Using Multisense Consistency Xenia Ohmer Elia Bruni Dieuwke Hupkes AI4CE 137 9 0 18 Apr 2024
Desiderata for the Context Use of Question Answering Systems Sagi Shaier Lawrence E Hunter Katharina von der Wense 169 6 0 31 Jan 2024
GPQA: A Graduate-Level Google-Proof Q&A Benchmark David Rein Betty Li Hou Asa Cooper Stickland Jackson Petty Richard Yuanzhe Pang Julien Dirani Julian Michael Samuel R. Bowman AI4MH ELM 293 1,193 0 20 Nov 2023
Whispers of Doubt Amidst Echoes of Triumph in NLP Robustness Ashim Gupta Rishanth Rajendhran Nathan Stringham Vivek Srikumar Ana Marasović AAML 126 5 0 16 Nov 2023
Implications of Annotation Artifacts in Edge Probing Test Datasets Sagnik Ray Choudhury Jushaan Kalra 65 0 0 20 Oct 2023
Benchmarks for Pirá 2.0, a Reading Comprehension Dataset about the Ocean, the Brazilian Coast, and Climate Change Paulo Pirozelli M. M. José I. Silveira Flávio Nakasato S. M. Peres A. Brandão Anna H. R. Costa Fabio Gagliardi Cozman RALM 85 5 0 19 Sep 2023
AGent: A Novel Pipeline for Automatically Creating Unanswerable Questions Son Quoc Tran Gia-Huy Do Phong Nguyen-Thuan Do Matt Kretchmar Xinya Du 130 0 0 10 Sep 2023
Learning to Generalize for Cross-domain QA Yingjie Niu Linyi Yang Ruihai Dong Yue Zhang 128 6 0 14 May 2023
Does Deep Learning Learn to Abstract? A Systematic Probing Framework Shengnan An Zeqi Lin B. Chen Qiang Fu Nanning Zheng Jian-Guang Lou 111 5 0 23 Feb 2023
The Impacts of Unanswerable Questions on the Robustness of Machine Reading Comprehension Models Son Quoc Tran Phong Nguyen-Thuan Do Uyen Le Matt Kretchmar ELM AAML 103 8 0 31 Jan 2023
Penalizing Confident Predictions on Largely Perturbed Inputs Does Not Improve Out-of-Distribution Generalization in Question Answering Kazutoshi Shinoda Saku Sugawara Akiko Aizawa OOD AAML 81 1 0 29 Nov 2022
CONDAQA: A Contrastive Reading Comprehension Dataset for Reasoning about Negation Abhilasha Ravichander Matt Gardner Ana Marasović 158 40 0 01 Nov 2022
IDK-MRC: Unanswerable Questions for Indonesian Machine Reading Comprehension Rifki Afina Putri Alice Oh 117 11 0 25 Oct 2022
Exploring The Landscape of Distributional Robustness for Question Answering Models Anas Awadalla Mitchell Wortsman Gabriel Ilharco Sewon Min Ian H. Magnusson Hannaneh Hajishirzi Ludwig Schmidt ELM OOD KELM 162 22 0 22 Oct 2022
Machine Reading, Fast and Slow: When Do Models "Understand" Language? Sagnik Ray Choudhury Anna Rogers Isabelle Augenstein LRM 104 18 0 15 Sep 2022
A Survey on Measuring and Mitigating Reasoning Shortcuts in Machine Reading Comprehension Xanh Ho Johannes Mario Meissner Saku Sugawara Akiko Aizawa OffRL 114 5 0 05 Sep 2022
Shortcut Learning of Large Language Models in Natural Language Understanding Mengnan Du Fengxiang He Na Zou Dacheng Tao Helen Zhou KELM OffRL 180 101 0 25 Aug 2022
MRCLens: an MRC Dataset Bias Detection Toolkit Yifan Zhong Haohan Wang Eric Xing 84 0 0 18 Jul 2022
An Empirical Investigation of Commonsense Self-Supervision with Knowledge Graphs Jiarui Zhang Filip Ilievski Kaixin Ma Jonathan M Francis A. Oltramari SSL 86 5 0 21 May 2022
Multimodal Adaptive Distillation for Leveraging Unimodal Encoders for Vision-Language Tasks Zhecan Wang Noel Codella Yen-Chun Chen Luowei Zhou Xiyang Dai ... Jianwei Yang Haoxuan You Kai-Wei Chang Shih-Fu Chang Lu Yuan VLM OffRL 128 27 0 22 Apr 2022
Antipatterns in Software Classification Taxonomies Cezar Sas A. Capiluppi 114 10 0 19 Apr 2022
Extending the Scope of Out-of-Domain: Examining QA models in multiple subdomains Chenyang Lyu Jennifer Foster Yvette Graham 123 4 0 09 Apr 2022
Trajectory Test-Train Overlap in Next-Location Prediction Datasets Massimiliano Luca Luca Pappalardo Bruno Lepri Gianni Barlacchi 96 5 0 07 Mar 2022
Using calibrator to improve robustness in Machine Reading Comprehension Jing Jin Houfeng Wang AAML 73 0 0 24 Feb 2022
CLIP-TD: CLIP Targeted Distillation for Vision-Language Tasks Zhecan Wang Noel Codella Yen-Chun Chen Luowei Zhou Jianwei Yang Xiyang Dai Bin Xiao Haoxuan You Shih-Fu Chang Lu Yuan CLIP VLM 101 43 0 15 Jan 2022
True or False: Does the Deep Learning Model Learn to Detect Rumors? Shiwen Ni Jiawen Li Hung-Yu kao 52 3 0 01 Dec 2021
How to Build Robust FAQ Chatbot with Controllable Question Generator? Yan Pan Mingyang Ma B. Pflugfelder Georg Groh AAML 56 3 0 18 Nov 2021
On the Robustness of Reading Comprehension Models to Entity Renaming Jun Yan Yang Xiao Sagnik Mukherjee Bill Yuchen Lin Robin Jia Xiang Ren 143 20 0 16 Oct 2021
Can Question Generation Debias Question Answering Models? A Case Study on Question-Context Lexical Overlap Kazutoshi Shinoda Saku Sugawara Akiko Aizawa 82 14 0 23 Sep 2021
Can Edge Probing Tasks Reveal Linguistic Knowledge in QA Models? Sagnik Ray Choudhury Nikita Bhutani Isabelle Augenstein 147 1 0 15 Sep 2021
Exploring Strategies for Generalizable Commonsense Reasoning with Pre-trained Models Kaixin Ma Filip Ilievski Jonathan M Francis Satoru Ozaki Eric Nyberg A. Oltramari LRM 105 17 0 07 Sep 2021
Interactive Machine Comprehension with Dynamic Knowledge Graphs Xingdi Yuan 133 3 0 31 Aug 2021
Bridging the Gap between Language Model and Reading Comprehension: Unsupervised MRC via Self-Supervision Ning Bian Xianpei Han Bo Chen Hongyu Lin Xianpei Han Le Sun SSL LRM 111 5 0 19 Jul 2021
Ensemble Learning-Based Approach for Improving Generalization Capability of Machine Reading Comprehension Systems Razieh Baradaran Hossein Amirkhani 116 18 0 01 Jul 2021
KLUE: Korean Language Understanding Evaluation Sungjoon Park Jihyung Moon Sungdong Kim Won Ik Cho Jiyoon Han ... Seonghyun Kim Lucy Park Alice Oh Jung-Woo Ha Kyunghyun Cho ELM VLM 235 211 0 20 May 2021
Are Multilingual BERT models robust? A Case Study on Adversarial Attacks for Multilingual Question Answering Sara Rosenthal Mihaela A. Bornea Avirup Sil AAML 78 10 0 15 Apr 2021
Toward Deconfounding the Influence of Entity Demographics for Question Answering Accuracy Maharshi Gor Kellie Webster Jordan L. Boyd-Graber CML FaML 126 11 0 15 Apr 2021
SpartQA: : A Textual Question Answering Benchmark for Spatial Reasoning Roshanak Mirzaee Hossein Rajaby Faghihi Qiang Ning Parisa Kordjmashidi 99 93 0 12 Apr 2021
The Effect of Natural Distribution Shift on Question Answering ModelsInternational Conference on Machine Learning (ICML), 2024 John Miller K. Krauth Benjamin Recht Ludwig Schmidt OOD 154 152 0 29 Apr 2020
Improving the Robustness of QA Models to Challenge Sets with Variational Question-Answer Pair Generation Kazutoshi Shinoda Saku Sugawara Akiko Aizawa OOD 107 12 0 07 Apr 2020