v1v2 (latest)

A Review on Explainability in Multimodal Deep Neural Nets

IEEE Access (IEEE Access), 2021

17 May 2021

Papers citing "A Review on Explainability in Multimodal Deep Neural Nets"

45 / 45 papers shown

Title
Attention Lattice Adapter: Visual Explanation Generation for Visual Foundation Model Shinnosuke Hirano Yuiga Wada T. Iida Komei Sugiura 86 0 0 18 Sep 2025
Can Multitask Learning Enhance Model Explainability? Hiba Najjar Bushra Alshbib A. Dengel 68 0 0 09 Aug 2025
Edge-Based Multimodal Sensor Data Fusion with Vision Language Models (VLMs) for Real-time Autonomous Vehicle Accident Avoidance Fengze Yang Bo Yu Yang Zhou Xuewen Luo Zhengzhong Tu Chenxi Liu 228 0 0 01 Aug 2025
Fixed Point Explainability Emanuele La Malfa Jon Vadillo Marco Molinari Michael Wooldridge 384 0 0 18 May 2025
A Step towards Interpretable Multimodal AI Models with MultiFIX Mafalda Malafaia Thalea Schlender Tanja Alderliesten Peter A. N. Bosman 147 1 0 16 May 2025
Multi-modal biometric authentication: Leveraging shared layer architectures for enhanced securityIEEE Access (IEEE Access), 2024 Vatchala S Yogesh C Yeshwanth Govindarajan Krithik Raja M Vishal Pramav Amirtha Ganesan Aashish Vinod A Dharun Ramesh 172 6 0 04 Nov 2024
Why context matters in VQA and Reasoning: Semantic interventions for VLM input modalities Kenza Amara Lukas Klein Carsten T. Lüth Paul Jäger Hendrik Strobelt Mennatallah El-Assady 135 3 0 02 Oct 2024
Do We Trust What They Say or What They Do? A Multimodal User Embedding Provides Personalized Explanations Zhicheng Ren Zhiping Xiao Luke Huan 228 0 0 04 Sep 2024
MicroXercise: A Micro-Level Comparative and Explainable System for Remote Physical TherapyIEEE/ACM International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE), 2024 Hanchen David Wang Nibraas Khan Anna Chen Nilanjan Sarkar Pamela Wisniewski Meiyi Ma 124 2 0 06 Aug 2024
A Systematic Review of Intermediate Fusion in Multimodal Deep Learning for Biomedical ApplicationsImage and Vision Computing (IVC), 2024 V. Guarrasi Fatih Aksu Camillo Maria Caruso Francesco Di Feola Aurora Rofena Filippo Ruffini Paolo Soda OffRL MedIm AI4CE 153 45 0 02 Aug 2024
Fairness and Bias in Multimodal AI: A Survey Tosin Adewumi Lama Alkhaled Namrata Gurung G. V. Boven Irene Pagliai 293 23 0 27 Jun 2024
A Survey on Safe Multi-Modal Learning System Tianyi Zhao Liangliang Zhang Yao Ma Lu Cheng 471 21 0 08 Feb 2024
Review of multimodal machine learning approaches in healthcare "Felix H. Krones Umar Marikkar Guy Parsons Adam Szmul Adam Mahdi 312 83 0 04 Feb 2024
CrisisKAN: Knowledge-infused and Explainable Multimodal Attention Network for Crisis Event ClassificationEuropean Conference on Information Retrieval (ECIR), 2024 Shubham Gupta Nandini Saini Suman Kundu Debasis Das 210 10 0 11 Jan 2024
Large Language Models in Law: A SurveyAI Open (AO), 2023 Jinqi Lai Wensheng Gan Jiayang Wu Zhenlian Qi Philip S. Yu ELM AILaw 271 156 0 26 Nov 2023
NERIF: GPT-4V for Automatic Scoring of Drawn Models Gyeong-Geon Lee Xiaoming Zhai 254 13 0 21 Nov 2023
Enhancing the machine vision performance with multi-spectral light sources Feng Zhang Rui Bao Congqi Dai Wanlu Zhang Shu Liu R. Guo 115 0 0 20 Oct 2023
MultiModN- Multimodal, Multi-Task, Interpretable Modular NetworksNeural Information Processing Systems (NeurIPS), 2023 Vinitra Swamy Malika Satayeva Jibril Frej Thierry Bossy Thijs Vogels Martin Jaggi Tanja Käser Mary-Anne Hartley 177 19 0 25 Sep 2023
Towards Vision-Language Mechanistic Interpretability: A Causal Tracing Tool for BLIP Vedant Palit Rohan Pandey Aryaman Arora Paul Pu Liang 216 43 0 27 Aug 2023
Causal Intersectionality and Dual Form of Gradient Descent for Multimodal Analysis: a Case Study on Hateful MemesInternational Conference on Language Resources and Evaluation (LREC), 2023 Yosuke Miyanishi Minh Le Nguyen 309 2 0 19 Aug 2023
Explainable Multi-View Deep Networks Methodology for Experimental Physics Nadav Schneider Muriel Tzdaka G. Sturm Guy Lazovski G. Bar G. Oren R. Gvishi Gal Oren 158 0 0 16 Aug 2023
Impact of Feature Encoding on Malware Classification ExplainabilityEuropean Conference on Artificial Intelligence (ECAI), 2023 E. Manai M. Mejri Jaouhar Fattahi 118 2 0 10 Jul 2023
Requirements for Explainability and Acceptance of Artificial Intelligence in Collaborative WorkInteracción (HCI), 2023 Sabine Theis Sophie F. Jentzsch Fotini Deligiannaki C. Berro A. Raulf C. Bruder 158 13 0 27 Jun 2023
Employing Multimodal Machine Learning for Stress DetectionJournal of Healthcare Engineering (J Healthc Eng), 2021 Rahee Walambe Pranav Nayak Ashmit Bhardwaj K. Kotecha 133 53 0 15 Jun 2023
Multimodal Explainable Artificial Intelligence: A Comprehensive Review of Methodological Advances and Future Research DirectionsIEEE Access (IEEE Access), 2023 N. Rodis Christos Sardianos Panagiotis I. Radoglou-Grammatikis Panagiotis G. Sarigiannidis Iraklis Varlamis Georgios Th. Papadopoulos 253 36 0 09 Jun 2023
IMAD: IMage-Augmented multi-modal DialogueJournal of Mathematical Sciences (J. Math. Sci.), 2023 Viktor Moskvoretskii Anton Frolov Denis Kuznetsov 145 6 0 17 May 2023
Patchwork Learning: A Paradigm Towards Integrative Analysis across Diverse Biomedical Data SourcesPatterns (Patterns), 2023 Suraj Rajendran Weishen Pan M. Sabuncu Yong Chen Jiayu Zhou Fei Wang 230 20 0 10 May 2023
Interpretable multimodal sentiment analysis based on textual modality descriptions by using large-scale language models Sixia Li S. Okada 253 4 0 07 May 2023
Diagnosing and Rectifying Vision Models using LanguageInternational Conference on Learning Representations (ICLR), 2023 Yuhui Zhang Jeff Z. HaoChen Shih-Cheng Huang Kuan-Chieh Wang James Zou Serena Yeung 150 61 0 08 Feb 2023
Multimodal Explainability via Latent Shift applied to COVID-19 stratificationPattern Recognition (Pattern Recogn.), 2022 V. Guarrasi L. Tronchin Domenico Albano E. Faiella Deborah Fazzini D. Santucci Paolo Soda 241 30 0 28 Dec 2022
Manifestations of Xenophobia in AI SystemsAi & Society (AS), 2022 Nenad Tomašev J. L. Maynard Iason Gabriel 329 11 0 15 Dec 2022
On the Robustness of Explanations of Deep Neural Network Models: A Survey Amlan Jyoti Karthik Balaji Ganesh Manoj Gayala Nandita Lakshmi Tunuguntla Sandesh Kamath V. Balasubramanian XAI FAtt AAML 222 9 0 09 Nov 2022
Towards Human-centered Explainable AI: A Survey of User Studies for Model ExplanationsIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022 Yao Rong Tobias Leemann Thai-trang Nguyen Lisa Fiedler Peizhu Qian Vaibhav Unhelkar Tina Seidel Gjergji Kasneci Enkelejda Kasneci ELM 258 157 0 20 Oct 2022
MMRNet: Improving Reliability for Multimodal Object Detection and Segmentation for Bin Picking via Multimodal Redundancy Yuhao Chen Hayden Gunraj E. Z. Zeng Robbie Meyer Maximilian Gilles Alexander Wong 174 3 0 19 Oct 2022
Fidelity of Ensemble Aggregation for Saliency Map Explanations using Bayesian Optimization Techniques Yannik Mahlau Christian Nolde FAtt 259 0 0 04 Jul 2022
Is Multi-Modal Necessarily Better? Robustness Evaluation of Multi-modal Fake News DetectionIEEE Transactions on Network Science and Engineering (IEEE T-NSE), 2022 Jinyin Chen Chengyu Jia Haibin Zheng Ruoxi Chen Chenbo Fu AAML 174 18 0 17 Jun 2022
Improving Multimodal Speech Recognition by Data Augmentation and Speech Representations Dan Oneaţă H. Cucu 102 22 0 27 Apr 2022
Multi-objective optimization determines when, which and how to fuse deep networks: an application to predict COVID-19 outcomesComputers in Biology and Medicine (Comput Biol Med), 2022 V. Guarrasi Paolo Soda 104 27 0 07 Apr 2022
Explainable Misinformation Detection Across Multiple Social Media PlatformsIEEE Access (IEEE Access), 2022 Gargi Joshi Ananya Srivastava Bhargav D. Yagnik Md Musleh Uddin Hasan Zainuddin Saiyed Lubna A Gabralla Ajith Abraham Rahee Walambe K. Kotecha 227 25 0 20 Mar 2022
Emulating Quantum Dynamics with Neural Networks via Knowledge DistillationFrontiers in Materials (Front. Mater.), 2022 Yu Yao C. Cao S. Haas Mahak Agarwal Divya Khanna M. Abram 203 4 0 19 Mar 2022
From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AIACM Computing Surveys (ACM CSUR), 2022 Meike Nauta Jan Trienes Shreyasi Pathak Elisa Nguyen Michelle Peters Yasmin Schmitt Jorg Schlotterer M. V. Keulen C. Seifert ELM XAI 511 545 0 20 Jan 2022
Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future OpportunitiesKnowledge-Based Systems (KBS), 2021 Waddah Saeed C. Omlin XAI 241 565 0 11 Nov 2021
HEROHE Challenge: assessing HER2 status in breast cancer without immunohistochemistry or in situ hybridization Eduardo Conde-Sousa João Vale Ming Feng Kele Xu Yin Wang ... Guilherme Aresta Teresa Araújo Paulo Aguiar C. Eloy A. Polónia 120 38 0 08 Nov 2021
Multimodal Co-learning: Challenges, Applications with Datasets, Recent Advances and Future DirectionsInformation Fusion (Inf. Fusion), 2021 Anil Rahate Rahee Walambe S. Ramanna K. Kotecha 329 171 0 29 Jul 2021
"Why Should I Trust You?": Explaining the Predictions of Any Classifier Marco Tulio Ribeiro Sameer Singh Carlos Guestrin FAtt FaML 2.0K 19,337 0 16 Feb 2016