Adversarial Examples for Evaluating Reading Comprehension Systems

23 July 2017

Robin Jia

Papers citing "Adversarial Examples for Evaluating Reading Comprehension Systems"

50 / 890 papers shown

Title
DeepPerform: An Efficient Approach for Performance Testing of Resource-Constrained Neural Networks Simin Chen Mirazul Haque Cong Liu Wei Yang 45 21 0 10 Oct 2022
State-of-the-art generalisation research in NLP: A taxonomy and review Dieuwke Hupkes Mario Giulianelli Verna Dankers Mikel Artetxe Yanai Elazar ... Leila Khalatbari Maria Ryskina Rita Frieske Ryan Cotterell Zhijing Jin 114 93 0 06 Oct 2022
U3E: Unsupervised and Erasure-based Evidence Extraction for Machine Reading Comprehension Suzhe He Shumin Shi Chenghao Wu 31 0 0 06 Oct 2022
ChemAlgebra: Algebraic Reasoning on Chemical Reactions Andrea Valenti D. Bacciu Antonio Vergari OOD LRM 32 0 0 05 Oct 2022
Text Characterization Toolkit Daniel Simig Tianlu Wang Verna Dankers Peter Henderson Khuyagbaatar Batsuren Dieuwke Hupkes Mona T. Diab 26 0 0 04 Oct 2022
Using contradictions improves question answering systems Étienne Fortier-Dubois Domenic Rosati 13 0 0 28 Sep 2022
Semantic-based Pre-training for Dialogue Understanding Xuefeng Bai Linfeng Song Yue Zhang 35 7 0 19 Sep 2022
Possible Stories: Evaluating Situated Commonsense Reasoning under Multiple Possible Scenarios Mana Ashida Saku Sugawara 65 6 0 16 Sep 2022
Machine Reading, Fast and Slow: When Do Models "Understand" Language? Sagnik Ray Choudhury Anna Rogers Isabelle Augenstein LRM 32 17 0 15 Sep 2022
Instance Attack:An Explanation-based Vulnerability Analysis Framework Against DNNs for Malware Detection Ruijin Sun Shize Guo Jinhong Guo Changyou Xing Luming Yang Xi Guo Zhisong Pan AAML 24 1 0 06 Sep 2022
Rare but Severe Neural Machine Translation Errors Induced by Minimal Deletion: An Empirical Study on Chinese and English Ruikang Shi Alvin Grissom II D. Trinh 32 2 0 05 Sep 2022
A Survey on Measuring and Mitigating Reasoning Shortcuts in Machine Reading Comprehension Xanh Ho Johannes Mario Meissner Saku Sugawara Akiko Aizawa OffRL 35 4 0 05 Sep 2022
Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned Deep Ganguli Liane Lovitt John Kernion Amanda Askell Yuntao Bai ... Nicholas Joseph Sam McCandlish C. Olah Jared Kaplan Jack Clark 225 446 0 23 Aug 2022
A Novel Plug-and-Play Approach for Adversarially Robust Generalization Deepak Maurya Adarsh Barik Jean Honorio OOD AAML 38 0 0 19 Aug 2022
Discovering Bugs in Vision Models using Off-the-shelf Image Generation and Captioning Olivia Wiles Isabela Albuquerque Sven Gowal VLM 40 47 0 18 Aug 2022
A Comprehensive Survey of Natural Language Generation Advances from the Perspective of Digital Deception Keenan I. Jones Enes ALTUNCU V. N. Franqueira Yi-Chia Wang Shujun Li DeLMO 36 3 0 11 Aug 2022
ChiQA: A Large Scale Image-based Real-World Question Answering Dataset for Multi-Modal Understanding Bingning Wang Feiya Lv Ting Yao Yiming Yuan Jin Ma Yu Luo Haijin Liang 28 3 0 05 Aug 2022
Adversarial Attacks on Image Generation With Made-Up Words Raphael Milliere 37 38 0 04 Aug 2022
To Answer or Not to Answer? Improving Machine Reading Comprehension Model with Span-based Contrastive Learning Yunjie Ji Liangyu Chen Chenxiao Dou Baochang Ma Xiangang Li 43 5 0 02 Aug 2022
An Interpretability Evaluation Benchmark for Pre-trained Language Models Ya-Ming Shen Lijie Wang Ying Chen Xinyan Xiao Jing Liu Hua-Hong Wu 37 4 0 28 Jul 2022
Catch Me If You Can: Deceiving Stance Detection and Geotagging Models to Protect Privacy of Individuals on Twitter Dilara Doğan Bahadir Altun Muhammed Said Zengin Mucahid Kutlu Tamer Elsayed 16 2 0 23 Jul 2022
MRCLens: an MRC Dataset Bias Detection Toolkit Yifan Zhong Haohan Wang Eric P. Xing 21 0 0 18 Jul 2022
An Understanding-Oriented Robust Machine Reading Comprehension Model Feiliang Ren Yongkang Liu Bochao Li Shilei Liu Bingchao Wang Jiaqi Wang Chunchao Liu Qi Ma 19 3 0 01 Jul 2022
SoK: Content Moderation in Social Media, from Guidelines to Enforcement, and Research to Practice Mohit Singhal Chen Ling Pujan Paudel Poojitha Thota Nihal Kumarswamy Gianluca Stringhini Shirin Nilizadeh 75 28 0 29 Jun 2022
Collecting high-quality adversarial data for machine reading comprehension tasks with humans and models in the loop Damian Y. Romero Diaz M. Aniol John M. Culnan 27 0 0 28 Jun 2022
Plug and Play Counterfactual Text Generation for Model Robustness Nishtha Madaan Srikanta J. Bedathur Diptikalyan Saha 28 4 0 21 Jun 2022
Is Multi-Modal Necessarily Better? Robustness Evaluation of Multi-modal Fake News Detection Jinyin Chen Chengyu Jia Haibin Zheng Ruoxi Chen Chenbo Fu AAML 22 10 0 17 Jun 2022
Improving the Adversarial Robustness of NLP Models by Information Bottleneck Ce Zhang Xiang Zhou Yixin Wan Xiaoqing Zheng Kai-Wei Chang Cho-Jui Hsieh 14 25 0 11 Jun 2022
BITE: Textual Backdoor Attacks with Iterative Trigger Injection Jun Yan Vansh Gupta Xiang Ren SILM 23 46 0 25 May 2022
Does Your Model Classify Entities Reasonably? Diagnosing and Mitigating Spurious Correlations in Entity Typing Nan Xu Fei Wang Bangzheng Li Mingtao Dong Muhao Chen 34 20 0 25 May 2022
Less Learn Shortcut: Analyzing and Mitigating Learning of Spurious Feature-Label Correlation Yanrui Du Jing Yang Yan Chen Jing Liu Sendong Zhao Qiaoqiao She Huaqin Wu Haifeng Wang Bing Qin 36 9 0 25 May 2022
Teaching Broad Reasoning Skills for Multi-Step QA by Generating Hard Contexts H. Trivedi Niranjan Balasubramanian Tushar Khot Ashish Sabharwal ReLM LRM 14 11 0 25 May 2022
Certified Robustness Against Natural Language Attacks by Causal Intervention Haiteng Zhao Chang Ma Xinshuai Dong A. Luu Zhi-Hong Deng Hanwang Zhang AAML 33 35 0 24 May 2022
Partial-input baselines show that NLI models can ignore context, but they don't Neha Srikanth Rachel Rudinger 28 4 0 24 May 2022
Learning to Ignore Adversarial Attacks Yiming Zhang Yan Zhou Samuel Carton Chenhao Tan 48 2 0 23 May 2022
A Fine-grained Interpretability Evaluation Benchmark for Neural NLP Lijie Wang Yaozong Shen Shu-ping Peng Shuai Zhang Xinyan Xiao Hao Liu Hongxuan Tang Ying Chen Hua-Hong Wu Haifeng Wang ELM 16 21 0 23 May 2022
Phrase-level Textual Adversarial Attack with Label Preservation Yibin Lei Yu Cao Dianqi Li Dinesh Manocha Meng Fang Mykola Pechenizkiy AAML 37 24 0 22 May 2022
A Survey on AI Sustainability: Emerging Trends on Learning Algorithms and Research Challenges Zhenghua Chen Min-man Wu Alvin Chan Xiaoli Li Yew-Soon Ong 19 6 0 08 May 2022
SemAttack: Natural Textual Attacks via Different Semantic Spaces Wei Ping Chejian Xu Xiangyu Liu Yuk-Kit Cheng Bo-wen Li SILM AAML 19 51 0 03 May 2022
A Word is Worth A Thousand Dollars: Adversarial Attack on Tweets Fools Stock Predictions Yong Xie Dakuo Wang Pin-Yu Chen Jinjun Xiong Sijia Liu Oluwasanmi Koyejo AAML 19 22 0 01 May 2022
Software Testing for Machine Learning D. Marijan A. Gotlieb AAML 22 27 0 30 Apr 2022
Detecting Textual Adversarial Examples Based on Distributional Characteristics of Data Representations Na Liu Mark Dras Wei Emma Zhang AAML 22 6 0 29 Apr 2022
Can Rationalization Improve Robustness? Howard Chen Jacqueline He Karthik Narasimhan Danqi Chen AAML 23 40 0 25 Apr 2022
Human-AI Collaboration via Conditional Delegation: A Case Study of Content Moderation Vivian Lai Samuel Carton Rajat Bhatnagar Vera Liao Yunfeng Zhang Chenhao Tan 20 130 0 25 Apr 2022
Disappeared Command: Spoofing Attack On Automatic Speech Recognition Systems with Sound Masking Jinghui Xu Jifeng Zhu Yong-Liang Yang 13 1 0 19 Apr 2022
Residue-Based Natural Language Adversarial Attack Detection Vyas Raina Mark J. F. Gales AAML 21 11 0 17 Apr 2022
Logical Inference for Counting on Semi-structured Tables Tomoya Kurosawa Hitomi Yanaka LMTD 24 2 0 16 Apr 2022
Fast Few-shot Debugging for NLU Test Suites Christopher Malon Kai Li E. Kruus 22 4 0 13 Apr 2022
ASQA: Factoid Questions Meet Long-Form Answers Ivan Stelmakh Yi Luan Bhuwan Dhingra Ming-Wei Chang 27 157 0 12 Apr 2022
Extending the Scope of Out-of-Domain: Examining QA models in multiple subdomains Chenyang Lyu Jennifer Foster Yvette Graham 18 4 0 09 Apr 2022