Adversarial Examples for Evaluating Reading Comprehension Systems

23 July 2017

Robin Jia

Papers citing "Adversarial Examples for Evaluating Reading Comprehension Systems"

50 / 925 papers shown

Title
Beyond Accuracy: A Consolidated Tool for Visual Question Answering BenchmarkingConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Dirk Vath Pascal Tilli Ngoc Thang Vu 133 4 0 11 Oct 2021
Distantly-Supervised Evidence Retrieval Enables Question Answering without Evidence AnnotationConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Chen Zhao Chenyan Xiong Jordan L. Boyd-Graber Hal Daumé RALM 161 10 0 10 Oct 2021
A Framework for Rationale Extraction for Deep QA models Sahana Ramnath Preksha Nema Deep Sahni Mitesh M. Khapra AAML FAtt 109 0 0 09 Oct 2021
Influence Tuning: Demoting Spurious Correlations via Instance Attribution and Instance-Driven Updates Xiaochuang Han Yulia Tsvetkov TDI 248 33 0 07 Oct 2021
TopiOCQA: Open-domain Conversational Question Answering with Topic Switching Vaibhav Adlakha Shehzaad Dhuliawala Kaheer Suleman H. D. Vries Siva Reddy BDL 334 114 0 02 Oct 2021
Improving Question Answering Performance Using Knowledge Distillation and Active LearningEngineering applications of artificial intelligence (EAAI), 2021 Yasaman Boreshban Seyed Morteza Mirbostani Gholamreza Ghassem-Sani Seyed Abolghasem Mirroshandel Shahin Amiriparian 183 18 0 26 Sep 2021
Sorting through the noise: Testing robustness of information processing in pre-trained language modelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Lalchand Pandia Allyson Ettinger 170 40 0 25 Sep 2021
Can Question Generation Debias Question Answering Models? A Case Study on Question-Context Lexical OverlapWorkshop on Machine Reading for Question Answering (MRQA), 2021 Kazutoshi Shinoda Saku Sugawara Akiko Aizawa 130 14 0 23 Sep 2021
Numerical reasoning in machine reading comprehension tasks: are we there yet? Hadeel Al-Negheimish Pranava Madhyastha A. Russo AIMat ReLM 138 14 0 16 Sep 2021
Targeted Attack on Deep RL-based Autonomous Driving with Learned Visual Patterns Prasanth Buddareddygari Travis Zhang Yezhou Yang Yi Ren AAML 143 20 0 16 Sep 2021
Can Edge Probing Tasks Reveal Linguistic Knowledge in QA Models? Sagnik Ray Choudhury Nikita Bhutani Isabelle Augenstein 297 1 0 15 Sep 2021
ARCH: Efficient Adversarial Regularized Training with Caching Simiao Zuo Chen Liang Haoming Jiang Pengcheng He Xiaodong Liu Jianfeng Gao Weizhu Chen T. Zhao AAML 167 3 0 15 Sep 2021
Adversarial Examples for Evaluating Math Word Problem Solvers Vivek Kumar Rishabh Maheshwary Vikram Pudi AAML 125 35 0 13 Sep 2021
Virtual Data Augmentation: A Robust and General Framework for Fine-tuning Pre-trained Models Kun Zhou Wayne Xin Zhao Sirui Wang Fuzheng Zhang Wei Wu Ji-Rong Wen AAML 182 8 0 13 Sep 2021
RockNER: A Simple Method to Create Adversarial Examples for Evaluating the Robustness of Named Entity Recognition Models Bill Yuchen Lin Wenyang Gao Jun Yan Ryan Rene Moreno Xiang Ren AAML 130 48 0 12 Sep 2021
An Evaluation Dataset and Strategy for Building Robust Multi-turn Response Selection ModelConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Kijong Han Seojin Lee Wooin Lee Joosung Lee Donghun Lee AAML 101 5 0 10 Sep 2021
Contrasting Human- and Machine-Generated Word-Level Adversarial Examples for Text ClassificationConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Maximilian Mozes Max Bartolo Pontus Stenetorp Bennett Kleinberg Lewis D. Griffin DeLMO AAML SILM 130 8 0 09 Sep 2021
Multi-granularity Textual Adversarial Attack with Behavior CloningConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Yangyi Chen Jingtong Su Wei Wei AAML 116 35 0 09 Sep 2021
Avoiding Inference Heuristics in Few-shot Prompt-based FinetuningConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Prasetya Ajie Utama N. Moosavi Victor Sanh Iryna Gurevych AAML 198 36 0 09 Sep 2021
Exploring Strategies for Generalizable Commonsense Reasoning with Pre-trained ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Kaixin Ma Filip Ilievski Jonathan M Francis Satoru Ozaki Eric Nyberg A. Oltramari LRM 121 17 0 07 Sep 2021
On Length Divergence Bias in Textual Matching ModelsFindings (Findings), 2021 Lan Jiang Tianshu Lyu Yankai Lin Chong Meng Xiaoyong Lyu D. Yin 216 5 0 06 Sep 2021
Efficient Combinatorial Optimization for Word-level Adversarial Textual Attack Shengcai Liu Ning Lu Cheng Chen Ke Tang AAML 287 36 0 06 Sep 2021
Towards Improving Adversarial Training of NLP ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Jin Yong Yoo Yanjun Qi AAML 444 144 0 01 Sep 2021
Don't Discard All the Biased Instances: Investigating a Core Assumption in Dataset Bias Mitigation TechniquesConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Hossein Amirkhani Mohammad Taher Pilehvar 110 6 0 01 Sep 2021
The Role of Explainability in Assuring Safety of Machine Learning in HealthcareIEEE Transactions on Emerging Topics in Computing (TETC), 2021 Yan Jia John McDermid T. Lawton Ibrahim Habli 225 65 0 01 Sep 2021
HAT4RD: Hierarchical Adversarial Training for Rumor Detection on Social MediaItalian National Conference on Sensors (INS), 2021 Shiwen Ni Jiawen Li Hung-Yu kao 184 8 0 29 Aug 2021
Enhanced Seq2Seq Autoencoder via Contrastive Learning for Abstractive Text Summarization Chujie Zheng Kunpeng Zhang Harry J. Wang Ling Fan Zhe Wang 138 12 0 26 Aug 2021
ProoFVer: Natural Logic Theorem Proving for Fact VerificationTransactions of the Association for Computational Linguistics (TACL), 2021 Amrith Krishna Sebastian Riedel Andreas Vlachos 306 75 0 25 Aug 2021
Semantic-Preserving Adversarial Text AttacksIEEE Transactions on Sustainable Computing (TSC), 2021 Xinghao Yang Weifeng Liu James Bailey Dacheng Tao Wei Liu AAML 270 17 0 23 Aug 2021
Attacks against Ranking Algorithms with Text Embeddings: a Case Study on Recruitment AlgorithmsBlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackBoxNLP), 2021 A. Samadi Debapriya Banerjee Shirin Nilizadeh 99 2 0 12 Aug 2021
Is My Model Using The Right Evidence? Systematic Probes for Examining Evidence-Based Tabular Reasoning Vivek Gupta Riyaz Ahmad Bhat Atreya Ghosal Manisha Srivastava M. Singh Vivek Srikumar LMTD 227 19 0 02 Aug 2021
MuSiQue: Multihop Questions via Single-hop Question Composition H. Trivedi Niranjan Balasubramanian Tushar Khot Ashish Sabharwal LRM 422 526 0 02 Aug 2021
Break, Perturb, Build: Automatic Perturbation of Reasoning Paths Through Question DecompositionTransactions of the Association for Computational Linguistics (TACL), 2021 Mor Geva Tomer Wolfson Jonathan Berant ReLM LRM 192 23 0 29 Jul 2021
Towards Robustness Against Natural Language Word SubstitutionsInternational Conference on Learning Representations (ICLR), 2021 Xinshuai Dong Anh Tuan Luu Rongrong Ji Hong Liu SILM AAML 273 128 0 28 Jul 2021
QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading ComprehensionACM Computing Surveys (CSUR), 2021 Anna Rogers Matt Gardner Isabelle Augenstein 341 188 0 27 Jul 2021
Stress Test Evaluation of Biomedical Word EmbeddingsWorkshop on Biomedical Natural Language Processing (BioNLP), 2021 Vladimir Araujo Andrés Carvallo Carlos Aspillaga C. Thorne Denis Parra 122 9 0 24 Jul 2021
Bridging the Gap between Language Model and Reading Comprehension: Unsupervised MRC via Self-Supervision Ning Bian Xianpei Han Bo Chen Hongyu Lin Xianpei Han Le Sun SSL LRM 151 5 0 19 Jul 2021
Probabilistic Verification of Neural Networks Against Group FairnessWorld Congress on Formal Methods (FM), 2021 Bing-Jie Sun Jun Sun Ting Dai Lijun Zhang AAML 64 30 0 18 Jul 2021
Self-Supervised Contrastive Learning with Adversarial Perturbations for Defending Word Substitution-based Attacks Zhao Meng Yihan Dong Mrinmaya Sachan Roger Wattenhofer AAML 158 11 0 15 Jul 2021
Automatic Task Requirements Writing Evaluation via Machine Reading ComprehensionInternational Conference on Artificial Intelligence in Education (AIED), 2021 Shiting Xu Guowei Xu Peilei Jia Wenbiao Ding Zhongqin Wu Zitao Liu 87 1 0 15 Jul 2021
Uncertainty-Aware Reliable Text ClassificationKnowledge Discovery and Data Mining (KDD), 2021 Yibo Hu Latifur Khan EDL UQCV 147 36 0 15 Jul 2021
Controlled Caption Generation for Images Through Adversarial Attacks Nayyer Aafaq Naveed Akhtar Wei Liu M. Shah Lin Wang AAML 119 12 0 07 Jul 2021
Doing Good or Doing Right? Exploring the Weakness of Commonsense Causal Reasoning Models Mingyue Han Yinglin Wang LRM 176 12 0 05 Jul 2021
On the Interaction of Belief Bias and ExplanationsFindings (Findings), 2021 Ana Valeria González Anna Rogers Anders Søgaard FAtt 194 19 0 29 Jun 2021
Fairness via Representation Neutralization Mengnan Du Subhabrata Mukherjee Guanchu Wang Ruixiang Tang Ahmed Hassan Awadallah Helen Zhou 227 85 0 23 Jun 2021
Does Robustness Improve Fairness? Approaching Fairness with Word Substitution Robustness Methods for Text ClassificationFindings (Findings), 2021 Yada Pruksachatkun Satyapriya Krishna Jwala Dhamala Rahul Gupta Kai-Wei Chang 132 33 0 21 Jun 2021
CROP: Certifying Robust Policies for Reinforcement Learning through Functional Smoothing Fan Wu Linyi Li Zijian Huang Yevgeniy Vorobeychik Ding Zhao Yue Liu AAML OffRL 178 64 0 17 Jun 2021
Automatic Construction of Evaluation Suites for Natural Language Generation Datasets Simon Mille Kaustubh D. Dhole Saad Mahamood Laura Perez-Beltrachini Varun Gangal Mihir Kale Emiel van Miltenburg Sebastian Gehrmann ELM 159 25 0 16 Jun 2021
Improving Paraphrase Detection with the Adversarial Paraphrasing TaskAnnual Meeting of the Association for Computational Linguistics (ACL), 2021 Animesh Nighojkar John Licato 145 40 0 14 Jun 2021
An Empirical Survey of Data Augmentation for Limited Data Learning in NLPTransactions of the Association for Computational Linguistics (TACL), 2021 Jiaao Chen Derek Tam Colin Raffel Joey Tianyi Zhou Diyi Yang 224 208 0 14 Jun 2021