Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classification

21 November 2022

Papers citing "Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classification"

50 / 173 papers shown

Title
Understanding Multimodal Deep Neural Networks: A Concept Selection View Chenming Shang Hengyuan Zhang Hao Wen Yujiu Yang 33 5 0 13 Apr 2024
Sparse Concept Bottleneck Models: Gumbel Tricks in Contrastive Learning Andrei Semenov Vladimir Ivanov Aleksandr Beznosikov Alexander Gasnikov 16 6 0 04 Apr 2024
Beyond Embeddings: The Promise of Visual Table in Visual Reasoning Yiwu Zhong Zi-Yuan Hu Michael R. Lyu Liwei Wang 29 1 0 27 Mar 2024
If CLIP Could Talk: Understanding Vision-Language Model Representations Through Their Preferred Concept Descriptions Reza Esfandiarpoor Cristina Menghini Stephen H. Bach CoGe VLM 27 8 0 25 Mar 2024
MSCoTDet: Language-driven Multi-modal Fusion for Improved Multispectral Pedestrian Detection Taeheon Kim Sangyun Chung Damin Yeom Youngjoon Yu Hak Gu Kim Y. Ro 38 2 0 22 Mar 2024
Just Shift It: Test-Time Prototype Shifting for Zero-Shot Generalization with Vision-Language Models Elaine Sui Xiaohan Wang Serena Yeung-Levy VLM 21 5 0 19 Mar 2024
Decomposing Disease Descriptions for Enhanced Pathology Detection: A Multi-Aspect Vision-Language Pre-training Framework Vu Minh Hieu Phan Yutong Xie Yuankai Qi Lingqiao Liu Liyang Liu Bowen Zhang Zhibin Liao Qi Wu Minh Nguyen Nhat To Johan W. Verjans 51 11 0 12 Mar 2024
Textual Knowledge Matters: Cross-Modality Co-Teaching for Generalized Visual Class Discovery Haiyang Zheng Nan Pu Wenjing Li N. Sebe Zhun Zhong 39 7 0 12 Mar 2024
Beyond Finite Data: Towards Data-free Out-of-distribution Generalization via Extrapolation Yijiang Li Sucheng Ren Weipeng Deng Yuzhi Xu Ying Gao Edith Ngai Haohan Wang OOD 33 1 0 08 Mar 2024
PEEB: Part-based Image Classifiers with an Explainable and Editable Language Bottleneck Thang M. Pham Peijie Chen Tin Nguyen Seunghyun Yoon Trung Bui Anh Nguyen VLM 38 7 0 08 Mar 2024
A Concept-based Interpretable Model for the Diagnosis of Choroid Neoplasias using Multimodal Data Yifan Wu Yang Liu Yue Yang Michael S. Yao Wenli Yang ... Yueming Liu James C. Gee Xuan Yang Wenbin Wei Shi Gu 22 2 0 08 Mar 2024
LLMBind: A Unified Modality-Task Integration Framework Bin Zhu Munan Ning Peng Jin Bin Lin Jinfa Huang ... Junwu Zhang Zhenyu Tang Mingjun Pan Xing Zhou Li-ming Yuan MLLM 32 6 0 22 Feb 2024
Eliminating Information Leakage in Hard Concept Bottleneck Models with Supervised, Hierarchical Concept Learning Ao Sun Yuanyuan Yuan Pingchuan Ma Shuai Wang 11 6 0 03 Feb 2024
Can we Constrain Concept Bottleneck Models to Learn Semantically Meaningful Input Features? Jack Furby Daniel Cunnington Dave Braines Alun D. Preece 24 3 0 01 Feb 2024
Visual Objectification in Films: Towards a New AI Task for Video Interpretation Julie Tores L. Sassatelli Hui-Yin Wu Clement Bergman Lea Andolfi ... F. Precioso Thierry Devars Magali Guaresi Virginie Julliard Sarah Lecossais 25 2 0 24 Jan 2024
DiConStruct: Causal Concept-based Explanations through Black-Box Distillation Ricardo Moreira Jacopo Bono Mário Cardoso Pedro Saleiro Mário A. T. Figueiredo P. Bizarro CML 15 4 0 16 Jan 2024
Image classification network enhancement methods based on knowledge injection Yishuang Tian Ning Wang Liang Zhang 20 1 0 09 Jan 2024
Few-shot Adaptation of Multi-modal Foundation Models: A Survey Fan Liu Tianshu Zhang Wenwen Dai Wenwen Cai Wenwen Cai Xiaocong Zhou Delong Chen VLM OffRL 20 22 0 03 Jan 2024
A Comprehensive Study of Knowledge Editing for Large Language Models Ningyu Zhang Yunzhi Yao Bo Tian Peng Wang Shumin Deng ... Lei Liang Zhiqiang Zhang Xiao-Jun Zhu Jun Zhou Huajun Chen KELM 26 76 0 02 Jan 2024
SI-MIL: Taming Deep MIL for Self-Interpretability in Gigapixel Histopathology S. Kapse Pushpak Pati Srijan Das Jingwei Zhang Chao Chen Maria Vakalopoulou Joel H. Saltz Dimitris Samaras Rajarsi R. Gupta Prateek Prasanna 23 10 0 22 Dec 2023
MMGPL: Multimodal Medical Data Analysis with Graph Prompt Learning Liang Peng Songyue Cai Zongqian Wu Huifang Shang Xiaofeng Zhu Xiaoxiao Li 28 9 0 22 Dec 2023
Concept-based Explainable Artificial Intelligence: A Survey Eleonora Poeta Gabriele Ciravegna Eliana Pastor Tania Cerquitelli Elena Baralis LRM XAI 19 41 0 20 Dec 2023
CEIR: Concept-based Explainable Image Representation Learning Yan Cui Shuhong Liu Liuzhuozheng Li Zhiyuan Yuan SSL VLM 21 3 0 17 Dec 2023
Learning Interpretable Queries for Explainable Image Classification with Information Pursuit Stefan Kolek Aditya Chattopadhyay Kwan Ho Ryan Chan Héctor Andrade-Loarca Gitta Kutyniok René Vidal 14 1 0 16 Dec 2023
Collaborating Foundation Models for Domain Generalized Semantic Segmentation Yasser Benigmim Subhankar Roy S. Essid Vicky Kalogeiton Stéphane Lathuilière 18 12 0 15 Dec 2023
Training-free Zero-shot Composed Image Retrieval with Local Concept Reranking Shitong Sun Fanghua Ye Shaogang Gong 19 13 0 14 Dec 2023
Object Recognition as Next Token Prediction Kaiyu Yue Borchun Chen Jonas Geiping Hengduo Li Tom Goldstein Ser-Nam Lim 22 8 0 04 Dec 2023
Generating Action-conditioned Prompts for Open-vocabulary Video Action Recognition Chengyou Jia Minnan Luo Xiaojun Chang Zhuohang Dang Mingfei Han Mengmeng Wang Guangwen Dai Sizhe Dang Jingdong Wang VLM 26 4 0 04 Dec 2023
CLIP-QDA: An Explainable Concept Bottleneck Model Rémi Kazmierczak Eloise Berthier Goran Frehse Gianni Franchi 14 7 0 30 Nov 2023
GELDA: A generative language annotation framework to reveal visual biases in datasets Krish Kabra Kathleen M. Lewis Guha Balakrishnan VLM 11 1 0 29 Nov 2023
ArGue: Attribute-Guided Prompt Tuning for Vision-Language Models Xinyu Tian Shu Zou Zhaoyuan Yang Jing Zhang VLM 20 21 0 27 Nov 2023
Towards Concept-based Interpretability of Skin Lesion Diagnosis using Vision-Language Models Cristiano Patrício Luís F. Teixeira João C. Neves 10 6 0 24 Nov 2023
Trustworthy Large Models in Vision: A Survey Ziyan Guo Li Xu Jun Liu MU 56 0 0 16 Nov 2023
Follow-Up Differential Descriptions: Language Models Resolve Ambiguities for Image Classification Reza Esfandiarpoor Stephen H. Bach VLM 19 13 0 10 Nov 2023
Integrating Language-Derived Appearance Elements with Visual Cues in Pedestrian Detection Sungjune Park Hyunjun Kim Y. Ro 37 11 0 02 Nov 2023
Interpretable-by-Design Text Understanding with Iteratively Generated Concept Bottleneck Josh Magnus Ludan Qing Lyu Yue Yang Liam Dugan Mark Yatskar Chris Callison-Burch 24 4 0 30 Oct 2023
Cross-Modal Conceptualization in Bottleneck Models Danis Alukaev S. Kiselev Ilya S. Pershin Bulat Ibragimov Vladimir Ivanov Alexey Kornaev Ivan Titov 33 7 0 23 Oct 2023
Large Language Models can Share Images, Too! Young-Jun Lee Dokyong Lee Joo Won Sung Jonghwan Hyeon Ho-Jin Choi MLLM 24 2 0 23 Oct 2023
From Neural Activations to Concepts: A Survey on Explaining Concepts in Neural Networks Jae Hee Lee Sergio Lanza Stefan Wermter 14 8 0 18 Oct 2023
Automated Natural Language Explanation of Deep Visual Neurons with Large Models Chenxu Zhao Wei Qian Yucheng Shi Mengdi Huai Ninghao Liu 16 2 0 16 Oct 2023
SurroCBM: Concept Bottleneck Surrogate Models for Generative Post-hoc Explanation Bo Pan Zhenke Liu Yifei Zhang Liang Zhao 17 2 0 11 Oct 2023
Robust and Interpretable Medical Image Classifiers via Concept Bottleneck Models An Yan Yu-Xiang Wang Yiwu Zhong Zexue He Petros Karypis ... Chengyu Dong Amilcare Gentili Chun-Nan Hsu Jingbo Shang Julian McAuley 24 30 0 04 Oct 2023
Coarse-to-Fine Concept Bottleneck Models Konstantinos P. Panousis Dino Ienco Diego Marcos 12 5 0 03 Oct 2023
Interpretability is in the Mind of the Beholder: A Causal Framework for Human-interpretable Representation Learning Emanuele Marconato Andrea Passerini Stefano Teso 14 13 0 14 Sep 2023
Variational Information Pursuit with Large Language and Multimodal Models for Interpretable Predictions Kwan Ho Ryan Chan Aditya Chattopadhyay B. Haeffele René Vidal 24 0 0 24 Aug 2023
Concept Bottleneck with Visual Concept Filtering for Explainable Medical Image Classification In-Ho Kim Jongha Kim Joon-Young Choi Hyunwoo J. Kim 12 13 0 23 Aug 2023
Exploring Parameter-Efficient Fine-Tuning Techniques for Code Generation with Large Language Models M. Weyssow Xin Zhou Kisub Kim David Lo H. Sahraoui 30 27 0 21 Aug 2023
Learning Concise and Descriptive Attributes for Visual Recognition Andy Yan Yu-Xiang Wang Yiwu Zhong Chengyu Dong Zexue He Yujie Lu William Wang Jingbo Shang Julian McAuley VLM 16 60 0 07 Aug 2023
GIST: Generating Image-Specific Text for Fine-grained Object Classification Kathleen M. Lewis Emily Mu Adrian V. Dalca John Guttag VLM 19 7 0 21 Jul 2023
PiTL: Cross-modal Retrieval with Weakly-supervised Vision-language Pre-training via Prompting Zixin Guo T. Wang Selen Pehlivan Abduljalil Radman Jorma T. Laaksonen VLM 25 2 0 14 Jul 2023