Adversarial Examples for Evaluating Reading Comprehension Systems

23 July 2017

Robin Jia

Papers citing "Adversarial Examples for Evaluating Reading Comprehension Systems"

50 / 890 papers shown

Title
Explaining Math Word Problem Solvers Abby Newcomb Jugal Kalita 13 1 0 24 Jul 2023
Gradient-Based Word Substitution for Obstinate Adversarial Examples Generation in Language Models Yimu Wang Peng Shi Hongyang Zhang SILM 11 3 0 24 Jul 2023
NatLogAttack: A Framework for Attacking Natural Language Inference Models with Natural Logic Zióu Zheng Xiao-Dan Zhu AAML LRM 45 5 0 06 Jul 2023
Evade ChatGPT Detectors via A Single Space Shuyang Cai Wanyun Cui DeLMO 38 15 0 05 Jul 2023
SCAT: Robust Self-supervised Contrastive Learning via Adversarial Training for Text Classification J. Wu Dit-Yan Yeung SILM 25 0 0 04 Jul 2023
Analyzing Multiple-Choice Reading and Listening Comprehension Tests Vatsal Raina Adian Liusie Mark J. F. Gales ELM 41 2 0 03 Jul 2023
Evaluating Paraphrastic Robustness in Textual Entailment Models Dhruv Verma Yash Kumar Lal Shreyashee Sinha Benjamin Van Durme Adam Poliak 28 5 0 29 Jun 2023
A Survey on Out-of-Distribution Evaluation of Neural NLP Models Xinzhe Li Ming Liu Shang Gao Wray L. Buntine 14 20 0 27 Jun 2023
Are aligned neural networks adversarially aligned? Nicholas Carlini Milad Nasr Christopher A. Choquette-Choo Matthew Jagielski Irena Gao ... Pang Wei Koh Daphne Ippolito Katherine Lee Florian Tramèr Ludwig Schmidt AAML 27 224 0 26 Jun 2023
Which Spurious Correlations Impact Reasoning in NLI Models? A Visual Interactive Diagnosis through Data-Constrained Counterfactuals Robin Shing Moon Chan Afra Amini Mennatallah El-Assady LRM AAML 32 2 0 21 Jun 2023
Did the Models Understand Documents? Benchmarking Models for Language Understanding in Document-Level Relation Extraction Haotian Chen Bingsheng Chen Xiangdong Zhou 43 6 0 20 Jun 2023
Jamp: Controlled Japanese Temporal Inference Dataset for Evaluating Generalization Capacity of Language Models Tomoki Sugimoto Yasumasa Onoe Hitomi Yanaka 53 4 0 19 Jun 2023
Evaluating Superhuman Models with Consistency Checks Lukas Fluri Daniel Paleka Florian Tramèr ELM 42 42 0 16 Jun 2023
PromptAttack: Probing Dialogue State Trackers with Adversarial Prompts Xiangjue Dong Yun He Ziwei Zhu James Caverlee AAML 31 7 0 07 Jun 2023
Adversary for Social Good: Leveraging Adversarial Attacks to Protect Personal Attribute Privacy Xiaoting Li Ling-Hao Chen Dinghao Wu AAML SILM 11 6 0 04 Jun 2023
A Multilingual Evaluation of NER Robustness to Adversarial Inputs A. Srinivasan Sowmya Vajjala AAML 15 3 0 30 May 2023
Fighting Bias with Bias: Promoting Model Robustness by Amplifying Dataset Biases Yuval Reif Roy Schwartz 28 7 0 30 May 2023
Robust Natural Language Understanding with Residual Attention Debiasing Fei Wang James Y. Huang Tianyi Yan Wenxuan Zhou Muhao Chen 29 10 0 28 May 2023
Large Language Models Can be Lazy Learners: Analyze Shortcuts in In-Context Learning Ruixiang Tang Dehan Kong Lo-li Huang Hui Xue 29 50 0 26 May 2023
Don't Retrain, Just Rewrite: Countering Adversarial Perturbations by Rewriting Text Ashim Gupta Carter Blum Temma Choji Yingjie Fei Shalin S Shah Alakananda Vempala Vivek Srikumar AAML 26 9 0 25 May 2023
Exploring Automatically Perturbed Natural Language Explanations in Relation Extraction Wanyun Cui Xingran Chen LRM AAML 25 0 0 24 May 2023
On Degrees of Freedom in Defining and Testing Natural Language Understanding Saku Sugawara S. Tsugita ELM 28 1 0 24 May 2023
From Shortcuts to Triggers: Backdoor Defense with Denoised PoE Qin Liu Fei Wang Chaowei Xiao Muhao Chen AAML 34 21 0 24 May 2023
How Fragile is Relation Extraction under Entity Replacements? Yiwei Wang Bryan Hooi Fei Wang Yujun Cai Yuxuan Liang Wenxuan Zhou Jing Tang Manjuan Duan Muhao Chen 66 5 0 22 May 2023
Pseudo-Label Training and Model Inertia in Neural Machine Translation B. Hsu Anna Currey Xing Niu Maria Nuadejde Georgiana Dinu ODL 38 2 0 19 May 2023
A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validation Xiaowei Huang Wenjie Ruan Wei Huang Gao Jin Yizhen Dong ... Sihao Wu Peipei Xu Dengyu Wu André Freitas Mustafa A. Mustafa ALM 39 82 0 19 May 2023
Echoes of Biases: How Stigmatizing Language Affects AI Performance Yizhi Liu Weiguang Wang G. Gao Ritu Agarwal 21 2 0 17 May 2023
Ortho-ODE: Enhancing Robustness and of Neural ODEs against Adversarial Attacks V. Purohit AAML 24 1 0 16 May 2023
Assessing Hidden Risks of LLMs: An Empirical Study on Robustness, Consistency, and Credibility Wen-song Ye Mingfeng Ou Tianyi Li Yipeng Chen Xuetao Ma ... Sai Wu Jie Fu Gang Chen Haobo Wang J. Zhao 44 36 0 15 May 2023
Measuring Consistency in Text-based Financial Forecasting Models Linyi Yang Yingpeng Ma Yue Zhang 28 4 0 15 May 2023
Think Twice: Measuring the Efficiency of Eliminating Prediction Shortcuts of Question Answering Models Lukávs Mikula Michal vStefánik Marek Petrovivc Petr Sojka 33 3 0 11 May 2023
A Frustratingly Easy Improvement for Position Embeddings via Random Padding Mingxu Tao Yansong Feng Dongyan Zhao 29 6 0 08 May 2023
Toward Adversarial Training on Contextualized Language Representation Hongqiu Wu Yong-Jin Liu Han Shi Haizhen Zhao M. Zhang AAML 15 13 0 08 May 2023
Post-Abstention: Towards Reliably Re-Attempting the Abstained Instances in QA Neeraj Varshney Chitta Baral 33 13 0 02 May 2023
Sentiment Perception Adversarial Attacks on Neural Machine Translation Systems Vyas Raina Mark J. F. Gales AAML 26 1 0 02 May 2023
Revisiting Robustness in Graph Machine Learning Lukas Gosch Daniel Sturm Simon Geisler Stephan Günnemann AAML OOD 72 21 0 01 May 2023
On the Robustness of Aspect-based Sentiment Analysis: Rethinking Model, Data, and Training Hao Fei Tat-Seng Chua Chenliang Li Donghong Ji Meishan Zhang Yafeng Ren 32 39 0 19 Apr 2023
ESimCSE Unsupervised Contrastive Learning Jointly with UDA Semi-Supervised Learning for Large Label System Text Classification Mode Ruan Lu Zhou Hangcheng Ran Meng Zhao Jin Qin JiaoYu Wei Feng Wang ChenZi 40 0 0 19 Apr 2023
Evaluating the Robustness of Machine Reading Comprehension Models to Low Resource Entity Renaming Clemencia Siro T. Ajayi 17 2 0 06 Apr 2023
Decentralized Adversarial Training over Graphs Ying Cao Elsa Rizk Stefan Vlaski Ali H. Sayed AAML 40 1 0 23 Mar 2023
Adversarial Attacks against Binary Similarity Systems Gianluca Capozzi Daniele Cono DÉlia Giuseppe Antonio Di Luna Leonardo Querzoni AAML 29 0 0 20 Mar 2023
Model-tuning Via Prompts Makes NLP Models Adversarially Robust Mrigank Raman Pratyush Maini J. Zico Kolter Zachary Chase Lipton Danish Pruthi AAML 35 17 0 13 Mar 2023
Evaluating the Robustness of Conversational Recommender Systems by Adversarial Examples Ali Montazeralghaem James Allan AAML SILM 16 0 0 09 Mar 2023
Learning the Legibility of Visual Text Perturbations D. Seth Rickard Stureborg Danish Pruthi Bhuwan Dhingra AAML 48 4 0 09 Mar 2023
Automatically Auditing Large Language Models via Discrete Optimization Erik Jones Anca Dragan Aditi Raghunathan Jacob Steinhardt 40 157 0 08 Mar 2023
Contrastive variational information bottleneck for aspect-based sentiment analysis Ming-Wei Chang Min Yang Qingshan Jiang Ruifeng Xu 19 4 0 06 Mar 2023
Multi-Agent Adversarial Training Using Diffusion Learning Ying Cao Elsa Rizk Stefan Vlaski Ali H. Sayed DiffM 34 4 0 03 Mar 2023
Frauds Bargain Attack: Generating Adversarial Text Samples via Word Manipulation Process Mingze Ni Zhen-Biao Sun Wei Liu AAML SILM 25 7 0 01 Mar 2023
Systematic Rectification of Language Models via Dead-end Analysis Mengyao Cao Mehdi Fatemi Jackie C.K. Cheung Samira Shabanian KELM 32 15 0 27 Feb 2023
Empirical Investigation of Neural Symbolic Reasoning Strategies Yoichi Aoki Keito Kudo Tatsuki Kuribayashi Ana Brassard Masashi Yoshikawa Keisuke Sakaguchi Kentaro Inui 26 2 0 16 Feb 2023