Improving Question Answering Model Robustness with Synthetic Adversarial Data Generation

18 April 2021

Robin Jia

Douwe Kiela

Papers citing "Improving Question Answering Model Robustness with Synthetic Adversarial Data Generation"

34 / 34 papers shown

Title
Findings of the BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora Alex Warstadt Aaron Mueller Leshem Choshen E. Wilcox Chengxu Zhuang ... Rafael Mosquera Bhargavi Paranjape Adina Williams Tal Linzen Ryan Cotterell 38 107 0 10 Apr 2025
Single-pass Detection of Jailbreaking Input in Large Language Models Leyla Naz Candogan Yongtao Wu Elias Abad Rocamora Grigorios G. Chrysos V. Cevher AAML 51 0 0 24 Feb 2025
Does Training on Synthetic Data Make Models Less Robust? Lingze Zhang Ellie Pavlick SyDa 89 0 0 11 Feb 2025
SimRAG: Self-Improving Retrieval-Augmented Generation for Adapting Large Language Models to Specialized Domains Ran Xu Hui Liu Sreyashi Nag Zhenwei Dai Yaochen Xie ... Chen Luo Yang Li Joyce C. Ho Carl Yang Qi He RALM 68 8 0 28 Jan 2025
Bridging Today and the Future of Humanity: AI Safety in 2024 and Beyond Shanshan Han 75 1 0 09 Oct 2024
Specification Overfitting in Artificial Intelligence Benjamin Roth Pedro Henrique Luz de Araujo Yuxi Xia Saskia Kaltenbrunner Christoph Korab 56 0 0 13 Mar 2024
Domain Adaptation of Multilingual Semantic Search -- Literature Review Anna Bringmann Anastasia Zhukova VLM 30 0 0 05 Feb 2024
How the Advent of Ubiquitous Large Language Models both Stymie and Turbocharge Dynamic Adversarial Question Generation Yoo Yeon Sung Ishani Mondal Jordan L. Boyd-Graber 28 0 0 20 Jan 2024
Can LLMs Augment Low-Resource Reading Comprehension Datasets? Opportunities and Challenges Vinay Samuel Houda Aynaou Arijit Ghosh Chowdhury Karthik Venkat Ramanan Aman Chadha SyDa 25 7 0 21 Sep 2023
From Adversarial Arms Race to Model-centric Evaluation: Motivating a Unified Automatic Robustness Evaluation Framework Yangyi Chen Hongcheng Gao Ganqu Cui Lifan Yuan Dehan Kong ... Longtao Huang H. Xue Zhiyuan Liu Maosong Sun Heng Ji AAML ELM 25 6 0 29 May 2023
A Practical Toolkit for Multilingual Question and Answer Generation Asahi Ushio Fernando Alva-Manchego Jose Camacho-Collados SyDa 26 13 0 27 May 2023
Entailment as Robust Self-Learner Jiaxin Ge Hongyin Luo Yoon Kim James R. Glass 39 3 0 26 May 2023
An Empirical Comparison of LM-based Question and Answer Generation Methods Asahi Ushio Fernando Alva-Manchego Jose Camacho-Collados 22 20 0 26 May 2023
Out-of-Distribution Generalization in Text Classification: Past, Present, and Future Linyi Yang Y. Song Xuan Ren Chenyang Lyu Yidong Wang Lingqiao Liu Jindong Wang Jennifer Foster Yue Zhang OOD 32 2 0 23 May 2023
SCENE: Self-Labeled Counterfactuals for Extrapolating to Negative Examples Deqing Fu Ameya Godbole Robin Jia 22 8 0 13 May 2023
Resources and Few-shot Learners for In-context Learning in Slavic Languages Michal vStefánik Marek Kadlcík Piotr Gramacki Petr Sojka 29 3 0 04 Apr 2023
A Pipeline for Generating, Annotating and Employing Synthetic Data for Real World Question Answering Matthew Maufe James Ravenscroft Rob Procter Maria Liakata 24 3 0 30 Nov 2022
Consecutive Question Generation via Dynamic Multitask Learning Yun Li Sujian Li Xing Shi LRM 14 2 0 16 Nov 2022
IDK-MRC: Unanswerable Questions for Indonesian Machine Reading Comprehension Rifki Afina Putri Alice H. Oh 28 9 0 25 Oct 2022
Event-Centric Question Answering via Contrastive Learning and Invertible Event Transformation Junru Lu Xingwei Tan Gabriele Pergola Lin Gui Yulan He 19 10 0 24 Oct 2022
CORE: A Retrieve-then-Edit Framework for Counterfactual Data Generation Tanay Dixit Bhargavi Paranjape Hannaneh Hajishirzi Luke Zettlemoyer SyDa 138 23 0 10 Oct 2022
Generative Language Models for Paragraph-Level Question Generation Asahi Ushio Fernando Alva-Manchego Jose Camacho-Collados ELM 11 45 0 08 Oct 2022
State-of-the-art generalisation research in NLP: A taxonomy and review Dieuwke Hupkes Mario Giulianelli Verna Dankers Mikel Artetxe Yanai Elazar ... Leila Khalatbari Maria Ryskina Rita Frieske Ryan Cotterell Zhijing Jin 114 93 0 06 Oct 2022
Increasing Adverse Drug Events extraction robustness on social media: case study on negation and speculation Simone Scaboro Beatrice Portelli Emmanuele Chersoni Enrico Santus G. Serra 24 5 0 06 Sep 2022
Collecting high-quality adversarial data for machine reading comprehension tasks with humans and models in the loop Damian Y. Romero Diaz M. Aniol John M. Culnan 27 0 0 28 Jun 2022
Adversarial Training for High-Stakes Reliability Daniel M. Ziegler Seraphina Nix Lawrence Chan Tim Bauman Peter Schmidt-Nielsen ... Noa Nabeshima Benjamin Weinstein-Raun D. Haas Buck Shlegeris Nate Thomas AAML 30 59 0 03 May 2022
Generating Data to Mitigate Spurious Correlations in Natural Language Inference Datasets Yuxiang Wu Matt Gardner Pontus Stenetorp Pradeep Dasigi 24 67 0 24 Mar 2022
WANLI: Worker and AI Collaboration for Natural Language Inference Dataset Creation Alisa Liu Swabha Swayamdipta Noah A. Smith Yejin Choi 39 212 0 16 Jan 2022
Models in the Loop: Aiding Crowdworkers with Generative Annotation Assistants Max Bartolo Tristan Thrush Sebastian Riedel Pontus Stenetorp Robin Jia Douwe Kiela 19 33 0 16 Dec 2021
Retrieval-guided Counterfactual Generation for QA Bhargavi Paranjape Matthew Lamm Ian Tenney 25 31 0 14 Oct 2021
Question Answering Infused Pre-training of General-Purpose Contextualized Representations Robin Jia M. Lewis Luke Zettlemoyer 18 28 0 15 Jun 2021
Cooperative Self-training of Machine Reading Comprehension Hongyin Luo Shang-Wen Li Ming Gao Seunghak Yu James R. Glass SyDa RALM 15 11 0 12 Mar 2021
DynaSent: A Dynamic Benchmark for Sentiment Analysis Christopher Potts Zhengxuan Wu Atticus Geiger Douwe Kiela 230 77 0 30 Dec 2020
Are We Modeling the Task or the Annotator? An Investigation of Annotator Bias in Natural Language Understanding Datasets Mor Geva Yoav Goldberg Jonathan Berant 237 319 0 21 Aug 2019