ERASER: A Benchmark to Evaluate Rationalized NLP Models

8 November 2019

Papers citing "ERASER: A Benchmark to Evaluate Rationalized NLP Models"

50 / 117 papers shown

Title
ferret: a Framework for Benchmarking Explainers on Transformers Giuseppe Attanasio Eliana Pastor C. Bonaventura Debora Nozza 33 30 0 02 Aug 2022
An Interpretability Evaluation Benchmark for Pre-trained Language Models Ya-Ming Shen Lijie Wang Ying Chen Xinyan Xiao Jing Liu Hua-Hong Wu 34 4 0 28 Jul 2022
FRAME: Evaluating Rationale-Label Consistency Metrics for Free-Text Rationales Aaron Chan Shaoliang Nie Liang Tan Xiaochang Peng Hamed Firooz Maziar Sanjabi Xiang Ren 40 9 0 02 Jul 2022
The NLP Sandbox: an efficient model-to-data system to enable federated and unbiased evaluation of clinical NLP models Yao Yan Thomas Yu Kathleen Muenzen Sijia Liu Connor Boyle ... Bradley Taylor James A Eddy J. Guinney S. Mooney T. Schaffter MedIm 34 0 0 28 Jun 2022
BAGEL: A Benchmark for Assessing Graph Neural Network Explanations Mandeep Rathee Thorben Funke Avishek Anand Megha Khosla 36 14 0 28 Jun 2022
Mediators: Conversational Agents Explaining NLP Model Behavior Nils Feldhus A. Ravichandran Sebastian Möller 27 16 0 13 Jun 2022
Resolving the Human Subjects Status of Machine Learning's Crowdworkers Divyansh Kaushik Zachary Chase Lipton A. London 25 2 0 08 Jun 2022
Challenges in Applying Explainability Methods to Improve the Fairness of NLP Models Esma Balkir S. Kiritchenko I. Nejadgholi Kathleen C. Fraser 21 36 0 08 Jun 2022
Learning to Ignore Adversarial Attacks Yiming Zhang Yan Zhou Samuel Carton Chenhao Tan 46 2 0 23 May 2022
KOLD: Korean Offensive Language Dataset Young-kuk Jeong Juhyun Oh Jaimeen Ahn Jongwon Lee Jihyung Mon Sungjoon Park Alice H. Oh 40 25 0 23 May 2022
Necessity and Sufficiency for Explaining Text Classifiers: A Case Study in Hate Speech Detection Esma Balkir I. Nejadgholi Kathleen C. Fraser S. Kiritchenko FAtt 33 27 0 06 May 2022
Emp-RFT: Empathetic Response Generation via Recognizing Feature Transitions between Utterances Wongyung Kim Youbin Ahn Donghyun Kim Kyong-Ho Lee 34 16 0 06 May 2022
METGEN: A Module-Based Entailment Tree Generation Framework for Answer Explanation Ruixin Hong Hongming Zhang Xintong Yu Changshui Zhang ReLM LRM 30 32 0 05 May 2022
CAVES: A Dataset to facilitate Explainable Classification and Summarization of Concerns towards COVID Vaccines Soham Poddar Azlaan Mustafa Samad Rajdeep Mukherjee Niloy Ganguly Saptarshi Ghosh 17 26 0 28 Apr 2022
Can Rationalization Improve Robustness? Howard Chen Jacqueline He Karthik Narasimhan Danqi Chen AAML 16 40 0 25 Apr 2022
Re-Examining Human Annotations for Interpretable NLP Cheng-Han Chiang Hung-yi Lee FAtt XAI 15 6 0 10 Apr 2022
E-KAR: A Benchmark for Rationalizing Natural Language Analogical Reasoning Jiangjie Chen Rui Xu Ziquan Fu Wei Shi Zhongqiao Li Xinbo Zhang Changzhi Sun Lei Li Yanghua Xiao Hao Zhou ELM 23 35 0 16 Mar 2022
Measuring the Mixing of Contextual Information in the Transformer Javier Ferrando Gerard I. Gállego Marta R. Costa-jussá 23 48 0 08 Mar 2022
DermX: an end-to-end framework for explainable automated dermatological diagnosis Raluca Jalaboi F. Faye Mauricio Orbes-Arteaga D. Jørgensen Ole Winther A. Galimzianova MedIm 11 17 0 14 Feb 2022
RerrFact: Reduced Evidence Retrieval Representations for Scientific Claim Verification Ashish Rana Deepanshu Khanna Tirthankar Ghosal Muskaan Singh Harpreet Singh P. Rana 12 5 0 05 Feb 2022
Making a (Counterfactual) Difference One Rationale at a Time Michael J. Plyler Michal Green Min Chi 21 11 0 13 Jan 2022
Explain, Edit, and Understand: Rethinking User Study Design for Evaluating Model Explanations Siddhant Arora Danish Pruthi Norman M. Sadeh William W. Cohen Zachary Chase Lipton Graham Neubig FAtt 32 38 0 17 Dec 2021
UNIREX: A Unified Learning Framework for Language Model Rationale Extraction Aaron Chan Maziar Sanjabi Lambert Mathias L Tan Shaoliang Nie Xiaochang Peng Xiang Ren Hamed Firooz 38 41 0 16 Dec 2021
Generating Fluent Fact Checking Explanations with Unsupervised Post-Editing Shailza Jolly Pepa Atanasova Isabelle Augenstein 28 13 0 13 Dec 2021
What to Learn, and How: Toward Effective Learning from Rationales Samuel Carton Surya Kanoria Chenhao Tan 24 22 0 30 Nov 2021
Improving Deep Learning Interpretability by Saliency Guided Training Aya Abdelsalam Ismail H. C. Bravo S. Feizi FAtt 18 79 0 29 Nov 2021
Towards Interpretable and Reliable Reading Comprehension: A Pipeline Model with Unanswerability Prediction Kosuke Nishida Kyosuke Nishida Itsumi Saito Sen Yoshida 30 7 0 17 Nov 2021
Understanding Interlocking Dynamics of Cooperative Rationalization Mo Yu Yang Zhang Shiyu Chang Tommi Jaakkola 18 41 0 26 Oct 2021
Double Trouble: How to not explain a text classifier's decisions using counterfactuals synthesized by masked language models? Thang M. Pham Trung H. Bui Long Mai Anh Totti Nguyen 21 7 0 22 Oct 2021
Interpreting Deep Learning Models in Natural Language Processing: A Review Xiaofei Sun Diyi Yang Xiaoya Li Tianwei Zhang Yuxian Meng Han Qiu Guoyin Wang Eduard H. Hovy Jiwei Li 17 44 0 20 Oct 2021
The Irrationality of Neural Rationale Models Yiming Zheng Serena Booth J. Shah Yilun Zhou 27 16 0 14 Oct 2021
The Eval4NLP Shared Task on Explainable Quality Estimation: Overview and Results M. Fomicheva Piyawat Lertvittayakumjorn Wei-Ye Zhao Steffen Eger Yang Gao ELM 16 39 0 08 Oct 2021
Trustworthy AI: From Principles to Practices Bo-wen Li Peng Qi Bo Liu Shuai Di Jingen Liu Jiquan Pei Jinfeng Yi Bowen Zhou 117 355 0 04 Oct 2021
Decision-Focused Summarization Chao-Chun Hsu Chenhao Tan 31 16 0 14 Sep 2021
Summarize-then-Answer: Generating Concise Explanations for Multi-hop Reading Comprehension Naoya Inoue H. Trivedi Steven K. Sinha Niranjan Balasubramanian Kentaro Inui 55 14 0 14 Sep 2021
AutoTriggER: Label-Efficient and Robust Named Entity Recognition with Auxiliary Trigger Extraction Dong-Ho Lee Ravi Kiran Selvam Sheikh Muhammad Sarwar Bill Yuchen Lin Fred Morstatter Jay Pujara Elizabeth Boschee James Allan Xiang Ren 23 2 0 10 Sep 2021
Diagnostics-Guided Explanation Generation Pepa Atanasova J. Simonsen Christina Lioma Isabelle Augenstein LRM FAtt 36 6 0 08 Sep 2021
Counterfactual Evaluation for Explainable AI Yingqiang Ge Shuchang Liu Zelong Li Shuyuan Xu Shijie Geng Yunqi Li Juntao Tan Fei Sun Yongfeng Zhang CML 35 13 0 05 Sep 2021
Enjoy the Salience: Towards Better Transformer-based Faithful Explanations with Word Salience G. Chrysostomou Nikolaos Aletras 26 16 0 31 Aug 2021
Discretized Integrated Gradients for Explaining Language Models Soumya Sanyal Xiang Ren FAtt 14 53 0 31 Aug 2021
DuTrust: A Sentiment Analysis Dataset for Trustworthiness Evaluation Lijie Wang Hao Liu Shu-ping Peng Hongxuan Tang Xinyan Xiao Ying Chen Hua-Hong Wu Haifeng Wang 17 5 0 30 Aug 2021
A Survey on Automated Fact-Checking Zhijiang Guo M. Schlichtkrull Andreas Vlachos 27 456 0 26 Aug 2021
Pairing Conceptual Modeling with Machine Learning W. Maass V. Storey HAI 21 33 0 27 Jun 2021
Knowledge-Grounded Self-Rationalization via Extractive and Natural Language Explanations Bodhisattwa Prasad Majumder Oana-Maria Camburu Thomas Lukasiewicz Julian McAuley 23 35 0 25 Jun 2021
Synthetic Benchmarks for Scientific Research in Explainable Machine Learning Yang Liu Sujay Khandagale Colin White W. Neiswanger 34 65 0 23 Jun 2021
PALRACE: Reading Comprehension Dataset with Human Data and Labeled Rationales Jiajie Zou Yuran Zhang Peiqing Jin Cheng Luo Xunyi Pan Nai Ding FaML 18 5 0 23 Jun 2021
On the Diversity and Limits of Human Explanations Chenhao Tan 16 31 0 22 Jun 2021
Probing GNN Explainers: A Rigorous Theoretical and Empirical Analysis of GNN Explanation Methods Chirag Agarwal Marinka Zitnik Himabindu Lakkaraju 19 51 0 16 Jun 2021
Prompting Contrastive Explanations for Commonsense Reasoning Tasks Bhargavi Paranjape Julian Michael Marjan Ghazvininejad Luke Zettlemoyer Hannaneh Hajishirzi ReLM LRM 20 66 0 12 Jun 2021
multiPRover: Generating Multiple Proofs for Improved Interpretability in Rule Reasoning Swarnadeep Saha Prateek Yadav Mohit Bansal ReLM LRM 16 26 0 02 Jun 2021