Multimodal Explanations: Justifying Decisions and Pointing to the Evidence

15 February 2018

Bernt Schiele

Papers citing "Multimodal Explanations: Justifying Decisions and Pointing to the Evidence"

37 / 37 papers shown

Title
Towards Efficient and Robust VQA-NLE Data Generation with Large Vision-Language Models Patrick Amadeus Irawan Genta Indra Winata Samuel Cahyawijaya Ayu Purwarianti 25 0 0 23 Sep 2024
Convincing Rationales for Visual Question Answering Reasoning Kun Li G. Vosselman Michael Ying Yang 34 1 0 06 Feb 2024
Zero-shot Translation of Attention Patterns in VQA Models to Natural Language Leonard Salewski A. Sophia Koepke Hendrik P. A. Lensch Zeynep Akata 25 2 0 08 Nov 2023
Do Models Explain Themselves? Counterfactual Simulatability of Natural Language Explanations Yanda Chen Ruiqi Zhong Narutatsu Ri Chen Zhao He He Jacob Steinhardt Zhou Yu Kathleen McKeown LRM 13 46 0 17 Jul 2023
SPARSEFIT: Few-shot Prompting with Sparse Fine-tuning for Jointly Generating Predictions and Natural Language Explanations Jesus Solano Oana-Maria Camburu Pasquale Minervini 8 1 0 22 May 2023
Solving NLP Problems through Human-System Collaboration: A Discussion-based Approach Masahiro Kaneko Graham Neubig Naoaki Okazaki 22 6 0 19 May 2023
Explaining black box text modules in natural language with language models Chandan Singh Aliyah R. Hsu Richard Antonello Shailee Jain Alexander G. Huth Bin-Xia Yu Jianfeng Gao MILM 16 46 0 17 May 2023
Patchwork Learning: A Paradigm Towards Integrative Analysis across Diverse Biomedical Data Sources Suraj Rajendran Weishen Pan M. Sabuncu Yong Chen Jiayu Zhou Fei Wang 49 14 0 10 May 2023
ViperGPT: Visual Inference via Python Execution for Reasoning Dídac Surís Sachit Menon Carl Vondrick MLLM LRM ReLM 19 428 0 14 Mar 2023
Towards a Unified Model for Generating Answers and Explanations in Visual Question Answering Chenxi Whitehouse Tillman Weyde Pranava Madhyastha LRM 30 3 0 25 Jan 2023
Causality-Inspired Taxonomy for Explainable Artificial Intelligence Pedro C. Neto Tiago B. Gonccalves João Ribeiro Pinto W. Silva Ana F. Sequeira Arun Ross Jaime S. Cardoso XAI 26 12 0 19 Aug 2022
Chunk-aware Alignment and Lexical Constraint for Visual Entailment with Natural Language Explanations Qian Yang Yunxin Li Baotian Hu Lin Ma Yuxin Ding Min Zhang 15 10 0 23 Jul 2022
On Advances in Text Generation from Images Beyond Captioning: A Case Study in Self-Rationalization Shruti Palaskar Akshita Bhagia Yonatan Bisk Florian Metze A. Black Ana Marasović 11 4 0 24 May 2022
Interpretation of Black Box NLP Models: A Survey Shivani Choudhary N. Chatterjee S. K. Saha FAtt 15 10 0 31 Mar 2022
Grounding Answers for Visual Questions Asked by Visually Impaired People Chongyan Chen Samreen Anjum Danna Gurari 20 50 0 04 Feb 2022
Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunities Waddah Saeed C. Omlin XAI 34 409 0 11 Nov 2021
Levels of explainable artificial intelligence for human-aligned conversational explanations Richard Dazeley Peter Vamplew Cameron Foale Charlotte Young Sunil Aryal F. Cruz 19 88 0 07 Jul 2021
Knowledge-Grounded Self-Rationalization via Extractive and Natural Language Explanations Bodhisattwa Prasad Majumder Oana-Maria Camburu Thomas Lukasiewicz Julian McAuley 8 35 0 25 Jun 2021
On the Diversity and Limits of Human Explanations Chenhao Tan 8 31 0 22 Jun 2021
Diagnosing Vision-and-Language Navigation: What Really Matters Wanrong Zhu Yuankai Qi P. Narayana Kazoo Sone Sugato Basu X. Wang Qi Wu M. Eckstein W. Wang LM&Ro 14 50 0 30 Mar 2021
Explainability of deep vision-based autonomous driving systems: Review and challenges Éloi Zablocki H. Ben-younes P. Pérez Matthieu Cord XAI 32 168 0 13 Jan 2021
Explanation from Specification Harish Naik Gyorgy Turán XAI 16 0 0 13 Dec 2020
Right for the Right Concept: Revising Neuro-Symbolic Concepts by Interacting with their Explanations Wolfgang Stammer P. Schramowski Kristian Kersting FAtt 14 105 0 25 Nov 2020
Towards Robust Pattern Recognition: A Review Xu-Yao Zhang Cheng-Lin Liu C. Suen OOD HAI 6 102 0 12 Jun 2020
Estimating semantic structure for the VQA answer space Corentin Kervadec G. Antipov M. Baccouche Christian Wolf 18 4 0 10 Jun 2020
Attentional Bottleneck: Towards an Interpretable Deep Driving Network Jinkyu Kim Mayank Bansal 6 13 0 08 May 2020
Explainable Deep Learning: A Field Guide for the Uninitiated Gabrielle Ras Ning Xie Marcel van Gerven Derek Doran AAML XAI 29 366 0 30 Apr 2020
TAB-VCR: Tags and Attributes based Visual Commonsense Reasoning Baselines Jingxiang Lin Unnat Jain A. Schwing LRM ReLM 24 9 0 31 Oct 2019
Can I Trust the Explainer? Verifying Post-hoc Explanatory Methods Oana-Maria Camburu Eleonora Giunchiglia Jakob N. Foerster Thomas Lukasiewicz Phil Blunsom FAtt AAML 11 59 0 04 Oct 2019
U-CAM: Visual Explanation using Uncertainty based Class Activation Maps Badri N. Patro Mayank Lunayach Shivansh Patel Vinay P. Namboodiri FAtt UQCV 16 76 0 17 Aug 2019
Evaluating Explanation Without Ground Truth in Interpretable Machine Learning Fan Yang Mengnan Du Xia Hu XAI ELM 6 66 0 16 Jul 2019
Conservative Q-Improvement: Reinforcement Learning for an Interpretable Decision-Tree Policy Aaron M. Roth Nicholay Topin Pooyan Jamshidi Manuela Veloso OffRL 18 47 0 02 Jul 2019
Explaining Explanations to Society Leilani H. Gilpin Cecilia Testart Nathaniel Fruchter Julius Adebayo XAI 14 34 0 19 Jan 2019
Grounded Video Description Luowei Zhou Yannis Kalantidis Xinlei Chen Jason J. Corso Marcus Rohrbach 8 189 0 17 Dec 2018
Multimodal Explanations by Predicting Counterfactuality in Videos Atsushi Kanehira Kentaro Takemoto S. Inayoshi Tatsuya Harada 18 35 0 04 Dec 2018
e-SNLI: Natural Language Inference with Natural Language Explanations Oana-Maria Camburu Tim Rocktaschel Thomas Lukasiewicz Phil Blunsom LRM 252 618 0 04 Dec 2018
Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding Akira Fukui Dong Huk Park Daylen Yang Anna Rohrbach Trevor Darrell Marcus Rohrbach 144 1,458 0 06 Jun 2016