Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Models

1 January 2021

Tongshuang Wu

Marco Tulio Ribeiro

Jeffrey Heer

Daniel S. Weld

ArXiv PDF HTML

Papers citing "Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Models"

50 / 178 papers shown

Title
SCENE: Self-Labeled Counterfactuals for Extrapolating to Negative Examples Deqing Fu Ameya Godbole Robin Jia 22 8 0 13 May 2023
COLA: Contextualized Commonsense Causal Reasoning from the Causal Inference Perspective Zhaowei Wang Quyet V. Do Hongming Zhang Jiayao Zhang Weiqi Wang Tianqing Fang Yangqiu Song Ginny Y. Wong Simon See LRM 28 28 0 09 May 2023
ANTONIO: Towards a Systematic Method of Generating NLP Benchmarks for Verification Marco Casadio Luca Arnaboldi M. Daggitt Omri Isac Tanvi Dinkar Daniel Kienitz Verena Rieser Ekaterina Komendantskaya 25 4 0 06 May 2023
ReMask: A Robust Information-Masking Approach for Domain Counterfactual Generation Pengfei Hong Rishabh Bhardwaj Navonil Majumdar Somak Aditya Soujanya Poria AAML 6 0 0 04 May 2023
Explaining Language Models' Predictions with High-Impact Concepts Ruochen Zhao Shafiq R. Joty Yongjie Wang Tan Wang LRM 63 8 0 03 May 2023
TIGTEC : Token Importance Guided TExt Counterfactuals Milan Bhan Jean-Noël Vittaut N. Chesneau Marie-Jeanne Lesot 11 9 0 24 Apr 2023
Angler: Helping Machine Translation Practitioners Prioritize Model Improvements Samantha Robertson Zijie J. Wang Dominik Moritz Mary Beth Kery Fred Hohman 30 15 0 12 Apr 2023
Explaining Recommendation System Using Counterfactual Textual Explanations Niloofar Ranjbar S. Momtazi MohammadMehdi Homayounpour 27 4 0 14 Mar 2023
GAM Coach: Towards Interactive and User-centered Algorithmic Recourse Zijie J. Wang J. W. Vaughan R. Caruana Duen Horng Chau HAI 15 21 0 27 Feb 2023
ScatterShot: Interactive In-context Example Curation for Text Transformation Tongshuang Wu Hua Shen Daniel S. Weld Jeffrey Heer Marco Tulio Ribeiro 19 24 0 14 Feb 2023
Toward a Theory of Causation for Interpreting Neural Code Models David Nader-Palacio Alejandro Velasco Nathan Cooper Á. Rodríguez Kevin Moran Denys Poshyvanyk 28 16 0 07 Feb 2023
DISCO: Distilling Counterfactuals with Large Language Models Zeming Chen Qiyue Gao Antoine Bosselut Ashish Sabharwal Kyle Richardson 29 25 0 20 Dec 2022
Discovering Language Model Behaviors with Model-Written Evaluations Ethan Perez Sam Ringer Kamilė Lukošiūtė Karina Nguyen Edwin Chen ... Danny Hernandez Deep Ganguli Evan Hubinger Nicholas Schiefer Jared Kaplan ALM 20 357 0 19 Dec 2022
AGRO: Adversarial Discovery of Error-prone groups for Robust Optimization Bhargavi Paranjape Pradeep Dasigi Vivek Srikumar Luke Zettlemoyer Hannaneh Hajishirzi 36 7 0 02 Dec 2022
AutoCAD: Automatically Generating Counterfactuals for Mitigating Shortcut Learning Jiaxin Wen Yeshuang Zhu Jinchao Zhang Jie Zhou Minlie Huang CML AAML 22 8 0 29 Nov 2022
GLUE-X: Evaluating Natural Language Understanding Models from an Out-of-distribution Generalization Perspective Linyi Yang Shuibai Zhang Libo Qin Yafu Li Yidong Wang Hanmeng Liu Jindong Wang Xingxu Xie Yue Zhang ELM 36 79 0 15 Nov 2022
Capabilities for Better ML Engineering Chenyang Yang Rachel A. Brower-Sinning Grace A. Lewis Christian Kastner Tongshuang Wu 19 3 0 11 Nov 2022
Discover, Explanation, Improvement: An Automatic Slice Detection Framework for Natural Language Processing Wenyue Hua Lifeng Jin Linfeng Song Haitao Mi Yongfeng Zhang Dong Yu 8 1 0 08 Nov 2022
NaturalAdversaries: Can Naturalistic Adversaries Be as Effective as Artificial Adversaries? Saadia Gabriel Hamid Palangi Yejin Choi AAML 37 1 0 08 Nov 2022
A General Search-based Framework for Generating Textual Counterfactual Explanations Daniel Gilo Shaul Markovitch LRM 25 0 0 01 Nov 2022
BioNLI: Generating a Biomedical NLI Dataset Using Lexico-semantic Constraints for Adversarial Examples Mohaddeseh Bastan Mihai Surdeanu Niranjan Balasubramanian 23 13 0 26 Oct 2022
Rich Knowledge Sources Bring Complex Knowledge Conflicts: Recalibrating Models to Reflect Conflicting Evidence Hung-Ting Chen Michael J.Q. Zhang Eunsol Choi RALM HILM 36 91 0 25 Oct 2022
Cascading Biases: Investigating the Effect of Heuristic Annotation Strategies on Data and Models Chaitanya Malaviya Sudeep Bhatia Mark Yatskar 19 4 0 24 Oct 2022
NeuroCounterfactuals: Beyond Minimal-Edit Counterfactuals for Richer Data Augmentation Phillip Howard Gadi Singer Vasudev Lal Yejin Choi Swabha Swayamdipta CML 52 25 0 22 Oct 2022
Robustifying Sentiment Classification by Maximally Exploiting Few Counterfactuals Maarten De Raedt Fréderic Godin Chris Develder Thomas Demeester 6 1 0 21 Oct 2022
Controllable Fake Document Infilling for Cyber Deception Yibo Hu Yu Lin Eric Parolin Latif Khan Kevin W. Hamlen 22 8 0 18 Oct 2022
Beyond Model Interpretability: On the Faithfulness and Adversarial Robustness of Contrastive Textual Explanations Julia El Zini M. Awad AAML 18 2 0 17 Oct 2022
CORE: A Retrieve-then-Edit Framework for Counterfactual Data Generation Tanay Dixit Bhargavi Paranjape Hannaneh Hajishirzi Luke Zettlemoyer SyDa 138 23 0 10 Oct 2022
FAST: Improving Controllability for Text Generation with Feedback Aware Self-Training Junyi Chai Reid Pryzant Victor Ye Dong Konstantin Golobokov Chenguang Zhu Yi Liu 29 5 0 06 Oct 2022
Unpacking Large Language Models with Conceptual Consistency Pritish Sahu Michael Cogswell Yunye Gong Ajay Divakaran LRM 79 16 0 29 Sep 2022
Causal Proxy Models for Concept-Based Model Explanations Zhengxuan Wu Karel DÓosterlinck Atticus Geiger Amir Zur Christopher Potts MILM 75 35 0 28 Sep 2022
Towards Faithful Model Explanation in NLP: A Survey Qing Lyu Marianna Apidianaki Chris Callison-Burch XAI 106 107 0 22 Sep 2022
On Faithfulness and Coherence of Language Explanations for Recommendation Systems Zhouhang Xie Julian McAuley Bodhisattwa Prasad Majumder LRM 22 1 0 12 Sep 2022
Interpreting Embedding Spaces by Conceptualization Adi Simhi Shaul Markovitch 24 5 0 22 Aug 2022
Leveraging Explanations in Interactive Machine Learning: An Overview Stefano Teso Öznur Alkan Wolfgang Stammer Elizabeth M. Daly XAI FAtt LRM 26 62 0 29 Jul 2022
Efficient Classification with Counterfactual Reasoning and Active Learning A. Mohammed D. Nguyen Bao Duong T. Nguyen CML 22 0 0 25 Jul 2022
Flexible text generation for counterfactual fairness probing Zee Fryer Vera Axelrod Ben Packer Alex Beutel Jilin Chen Kellie Webster 20 18 0 28 Jun 2022
Challenges in Applying Explainability Methods to Improve the Fairness of NLP Models Esma Balkir S. Kiritchenko I. Nejadgholi Kathleen C. Fraser 21 36 0 08 Jun 2022
OmniXAI: A Library for Explainable AI Wenzhuo Yang Hung Le Tanmay Laud Silvio Savarese S. Hoi SyDa 21 39 0 01 Jun 2022
Order-sensitive Shapley Values for Evaluating Conceptual Soundness of NLP Models Kaiji Lu Anupam Datta 13 0 0 01 Jun 2022
Leveraging Causal Inference for Explainable Automatic Program Repair Jianzong Wang Shijing Si Z. Zhu Xiaoyang Qu Zhenhou Hong Jing Xiao 14 3 0 26 May 2022
Counterfactually Augmented Data and Unintended Bias: The Case of Sexism and Hate Speech Detection Indira Sen Mattia Samory Claudia Wagner Isabelle Augenstein 24 16 0 09 May 2022
Necessity and Sufficiency for Explaining Text Classifiers: A Case Study in Hate Speech Detection Esma Balkir I. Nejadgholi Kathleen C. Fraser S. Kiritchenko FAtt 33 27 0 06 May 2022
ExSum: From Local Explanations to Model Understanding Yilun Zhou Marco Tulio Ribeiro J. Shah FAtt LRM 11 25 0 30 Apr 2022
Counterfactual Explanations for Natural Language Interfaces George Tolkachev Stephen Mell Steve Zdancewic Osbert Bastani LRM AAML 9 4 0 27 Apr 2022
Learning to Scaffold: Optimizing Model Explanations for Teaching Patrick Fernandes Marcos Vinícius Treviso Danish Pruthi André F. T. Martins Graham Neubig FAtt 17 22 0 22 Apr 2022
Measuring Compositional Consistency for Video Question Answering Mona Gandhi Mustafa Omer Gul Eva Prakash Madeleine Grunde-McLaughlin Ranjay Krishna Maneesh Agrawala CoGe 37 15 0 14 Apr 2022
Interpretation of Black Box NLP Models: A Survey Shivani Choudhary N. Chatterjee S. K. Saha FAtt 32 10 0 31 Mar 2022
Text Transformations in Contrastive Self-Supervised Learning: A Review Amrita Bhattacharjee Mansooreh Karami Huan Liu SSL 27 23 0 22 Mar 2022
CARETS: A Consistency And Robustness Evaluative Test Suite for VQA Carlos E. Jimenez Olga Russakovsky Karthik Narasimhan CoGe 21 14 0 15 Mar 2022