Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classification

21 November 2022

Papers citing "Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classification"

50 / 173 papers shown

Title
Tree of Attributes Prompt Learning for Vision-Language Models Tong Ding Wanhua Li Zhongqi Miao Hanspeter Pfister VLM 52 1 0 15 Oct 2024
MiRAGeNews: Multimodal Realistic AI-Generated News Detection Runsheng Huang Liam Dugan Y. Yang Chris Callison-Burch 31 3 0 11 Oct 2024
Semantic Token Reweighting for Interpretable and Controllable Text Embeddings in CLIP Eunji Kim Kyuhong Shim Simyung Chang Sungroh Yoon CLIP 23 0 0 11 Oct 2024
Enforcing Interpretability in Time Series Transformers: A Concept Bottleneck Framework Angela van Sprang Erman Acar Willem Zuidema AI4TS 33 1 0 08 Oct 2024
Mitigating Modality Prior-Induced Hallucinations in Multimodal Large Language Models via Deciphering Attention Causality Guanyu Zhou Yibo Yan Xin Zou Kun Wang Aiwei Liu Xuming Hu 38 7 0 07 Oct 2024
Variational Language Concepts for Interpreting Foundation Language Models Hengyi Wang Shiwei Tan Zhiqing Hong Desheng Zhang Hao Wang 27 3 0 04 Oct 2024
Self-eXplainable AI for Medical Image Analysis: A Survey and New Outlooks Junlin Hou Sicen Liu Yequan Bie Hongmei Wang Andong Tan Luyang Luo Hao Chen XAI 23 3 0 03 Oct 2024
Multimodal LLM Enhanced Cross-lingual Cross-modal Retrieval Yabing Wang Le Wang Qiang-feng Zhou Zhibin Wang Hao Li Gang Hua Wei Tang 28 7 0 30 Sep 2024
Image-guided topic modeling for interpretable privacy classification Alina Elena Baia Andrea Cavallaro 32 0 0 27 Sep 2024
Explanation Bottleneck Models Shinýa Yamaguchi Kosuke Nishida LRM BDL 44 1 0 26 Sep 2024
Explaining Datasets in Words: Statistical Models with Natural Language Parameters Ruiqi Zhong Heng Wang Dan Klein Jacob Steinhardt 35 6 0 13 Sep 2024
Unraveling Text Generation in LLMs: A Stochastic Differential Equation Approach Yukun Zhang DiffM 19 0 0 17 Aug 2024
Explain via Any Concept: Concept Bottleneck Model with Open Vocabulary Concepts Andong Tan Fengtao Zhou Hao Chen VLM 24 3 0 05 Aug 2024
AdaCBM: An Adaptive Concept Bottleneck Model for Explainable and Accurate Diagnosis T. Chowdhury Vu Minh Hieu Phan Kewen Liao Minh Nguyen Nhat To Yutong Xie A. Hengel Johan W. Verjans Zhibin Liao 14 1 0 04 Aug 2024
XAI meets LLMs: A Survey of the Relation between Explainable AI and Large Language Models Erik Cambria Lorenzo Malandri Fabio Mercorio Navid Nobani Andrea Seveso 48 11 0 21 Jul 2024
DEPICT: Diffusion-Enabled Permutation Importance for Image Classification Tasks Sarah Jabbour Gregory Kondas Ella Kazerooni Michael Sjoding David Fouhey Jenna Wiens FAtt DiffM 29 1 0 19 Jul 2024
LaMI-DETR: Open-Vocabulary Detection with Language Model Instruction Penghui Du Yu Wang Yifan Sun Luting Wang Yue Liao Gang Zhang Errui Ding Yan Wang Jingdong Wang Si Liu VLM ObjD 33 1 0 16 Jul 2024
Open Vocabulary Multi-Label Video Classification Rohit Gupta Mamshad Nayeem Rizve Jayakrishnan Unnikrishnan Ashish Tawari Son Tran Mubarak Shah Benjamin Z. Yao Trishul M. Chilimbi VLM 62 1 0 12 Jul 2024
Constructing Concept-based Models to Mitigate Spurious Correlations with Minimal Human Effort Jeeyung Kim Ze Wang Qiang Qiu 38 1 0 12 Jul 2024
Concept Bottleneck Models Without Predefined Concepts Simon Schrodi Julian Schur Max Argus Thomas Brox 28 9 0 04 Jul 2024
Extracting and Encoding: Leveraging Large Language Models and Medical Knowledge to Enhance Radiological Text Representation Pablo Messina René Vidal Denis Parra Álvaro Soto Vladimir Araujo MedIm 53 2 0 02 Jul 2024
Restyling Unsupervised Concept Based Interpretable Networks with Generative Models Jayneel Parekh Quentin Bouniot Pavlo Mozharovskyi A. Newson Florence dÁlché-Buc SSL 53 1 0 01 Jul 2024
Evidential Concept Embedding Models: Towards Reliable Concept Explanations for Skin Disease Diagnosis Yibo Gao Zheyao Gao Xin Gao Yuanye Liu Bomin Wang Xiahai Zhuang 23 1 0 27 Jun 2024
Towards Compositionality in Concept Learning Adam Stein Aaditya Naik Yinjun Wu Mayur Naik Eric Wong CoGe 37 2 0 26 Jun 2024
Unveiling LLM Mechanisms Through Neural ODEs and Control Theory Yukun Zhang Qi Dong 34 0 0 23 Jun 2024
Reading Is Believing: Revisiting Language Bottleneck Models for Image Classification Honori Udo Takafumi Koshinaka VLM 32 0 0 22 Jun 2024
Self-supervised Interpretable Concept-based Models for Text Classification Francesco De Santis Philippe Bich Gabriele Ciravegna Pietro Barbiero Danilo Giordano Tania Cerquitelli 26 0 0 20 Jun 2024
Probabilistic Conceptual Explainers: Trustworthy Conceptual Explanations for Vision Foundation Models Hengyi Wang Shiwei Tan Hao Wang BDL 27 6 0 18 Jun 2024
Neural Concept Binder Wolfgang Stammer Antonia Wüst David Steinmann Kristian Kersting OCL 29 4 0 14 Jun 2024
Conceptual Learning via Embedding Approximations for Reinforcing Interpretability and Transparency Maor Dikter Tsachi Blau Chaim Baskin 33 0 0 13 Jun 2024
ConceptHash: Interpretable Fine-Grained Hashing via Concept Discovery Kam Woh Ng Xiatian Zhu Yi-Zhe Song Tao Xiang 33 2 0 12 Jun 2024
Aligning Human Knowledge with Visual Concepts Towards Explainable Medical Image Classification Yunhe Gao Difei Gu Mu Zhou Dimitris N. Metaxas 30 4 0 08 Jun 2024
PaCE: Parsimonious Concept Engineering for Large Language Models Jinqi Luo Tianjiao Ding Kwan Ho Ryan Chan D. Thaker Aditya Chattopadhyay Chris Callison-Burch René Vidal CVBM 35 7 0 06 Jun 2024
Exploiting LMM-based knowledge for image classification tasks Maria Tzelepi Vasileios Mezaris VLM 30 3 0 05 Jun 2024
I Bet You Did Not Mean That: Testing Semantic Importance via Betting Jacopo Teneggi Jeremias Sulam FAtt 23 1 0 29 May 2024
LLM-based Hierarchical Concept Decomposition for Interpretable Fine-Grained Image Classification Renyi Qu Mark Yatskar 24 1 0 29 May 2024
Crafting Interpretable Embeddings by Asking LLMs Questions Vinamra Benara Chandan Singh John X. Morris Richard Antonello Ion Stoica Alexander G. Huth Jianfeng Gao 19 5 0 26 May 2024
BDetCLIP: Multimodal Prompting Contrastive Test-Time Backdoor Detection Yuwei Niu Shuo He Qi Wei Feng Liu Lei Feng AAML 33 1 0 24 May 2024
A Textbook Remedy for Domain Shifts: Knowledge Priors for Medical Image Analysis Yue Yang Mona Gandhi Yufei Wang Yifan Wu Michael S. Yao Christopher Callison-Burch James C. Gee Mark Yatskar 43 3 0 23 May 2024
Mammo-CLIP: A Vision Language Foundation Model to Enhance Data Efficiency and Robustness in Mammography Shantanu Ghosh Clare B. Poynton Shyam Visweswaran Kayhan Batmanghelich VLM 32 8 0 20 May 2024
Incorporating Clinical Guidelines through Adapting Multi-modal Large Language Model for Prostate Cancer PI-RADS Scoring Tiantian Zhang Manxi Lin Hongda Guo Xiaofan Zhang Ka Fung Peter Chiu Aasa Feragen Qi Dou 29 1 0 14 May 2024
Can Better Text Semantics in Prompt Tuning Improve VLM Generalization? Hari Chandana Kuchibhotla Sai Srinivas Kancheti Abbavaram Gowtham Reddy Vineeth N. Balasubramanian VLM 29 0 0 13 May 2024
Navigating the Future of Federated Recommendation Systems with Foundation Models Zhiwei Li Guodong Long Chunxu Zhang Honglei Zhang Jing Jiang Chengqi Zhang 105 0 0 12 May 2024
Improving Concept Alignment in Vision-Language Concept Bottleneck Models Nithish Muthuchamy Selvaraj Xiaobao Guo Bingquan Shen A. Kong Alex C. Kot VLM 37 0 0 03 May 2024
Improving Intervention Efficacy via Concept Realignment in Concept Bottleneck Models Nishad Singhi Jae Myung Kim Karsten Roth Zeynep Akata 38 1 0 02 May 2024
Leveraging Cross-Modal Neighbor Representation for Improved CLIP Classification Chao Yi Lu Ren De-Chuan Zhan Han-Jia Ye CLIP VLM 16 5 0 27 Apr 2024
Embracing Diversity: Interpretable Zero-shot classification beyond one vector per class Mazda Moayeri Michael G. Rabbat Mark Ibrahim Diane Bouchacourt VLM 41 1 0 25 Apr 2024
A Multimodal Automated Interpretability Agent Tamar Rott Shaham Sarah Schwettmann Franklin Wang Achyuta Rajaram Evan Hernandez Jacob Andreas Antonio Torralba 26 17 0 22 Apr 2024
Pre-trained Vision-Language Models Learn Discoverable Visual Concepts Yuan Zang Tian Yun Hao Tan Trung Bui Chen Sun VLM CoGe 45 9 0 19 Apr 2024
Incremental Residual Concept Bottleneck Models Chenming Shang Shiji Zhou Hengyuan Zhang Xinzhe Ni Yujiu Yang Yuwang Wang 29 14 0 13 Apr 2024