Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classification

21 November 2022

Papers citing "Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classification"

50 / 172 papers shown

Title
Discovering Fine-Grained Visual-Concept Relations by Disentangled Optimal Transport Concept Bottleneck Models Yan Xie Zequn Zeng Hao Zhang Yucheng Ding Y. Wang Zhengjue Wang Bo Chen Hongwei Liu OT 26 0 0 12 May 2025
Interpretable Zero-shot Learning with Infinite Class Concepts Zihan Ye Shreyank N Gowda Shiming Chen Yaochu Jin Kaizhu Huang Xiaobo Jin VLM 33 0 0 06 May 2025
IP-CRR: Information Pursuit for Interpretable Classification of Chest Radiology Reports Yuyan Ge Kwan Ho Ryan Chan Pablo Messina René Vidal 36 0 0 30 Apr 2025
FedMVP: Federated Multi-modal Visual Prompt Tuning for Vision-Language Models Mainak Singha Subhankar Roy Sarthak Mehrotra Ankit Jha Moloud Abdar Biplab Banerjee Elisa Ricci VLM VPVLM 108 0 0 29 Apr 2025
If Concept Bottlenecks are the Question, are Foundation Models the Answer? Nicola Debole Pietro Barbiero Francesco Giannini Andrea Passerini Stefano Teso Emanuele Marconato 71 0 0 28 Apr 2025
Addressing Concept Mislabeling in Concept Bottleneck Models Through Preference Optimization Emiliano Penaloza Tianyue H. Zhan Laurent Charlin Mateo Espinosa Zarlenga 40 0 0 25 Apr 2025
Avoiding Leakage Poisoning: Concept Interventions Under Distribution Shifts M. Zarlenga Gabriele Dominici Pietro Barbiero Z. Shams M. Jamnik KELM 96 0 0 24 Apr 2025
GECKO: Gigapixel Vision-Concept Contrastive Pretraining in Histopathology S. Kapse Pushpak Pati Srikar Yellapragada Srijan Das Rajarsi R. Gupta Joel H. Saltz Dimitris Samaras Prateek Prasanna VLM 41 0 0 01 Apr 2025
Self-Evolving Visual Concept Library using Vision-Language Critics Atharva Sehgal Patrick Yuan Ziniu Hu Yisong Yue Jennifer J. Sun Swarat Chaudhuri VLM 45 0 0 31 Mar 2025
Language Guided Concept Bottleneck Models for Interpretable Continual Learning Lu Yu Haoyu Han Zhe Tao Hantao Yao Changsheng Xu CLL 55 0 0 30 Mar 2025
TraNCE: Transformative Non-linear Concept Explainer for CNNs Ugochukwu Ejike Akpudo Yongsheng Gao J. Zhou Andrew Lewis 62 0 0 26 Mar 2025
Attribute-formed Class-specific Concept Space: Endowing Language Bottleneck Model with Better Interpretability and Scalability Jianyang Zhang Qianli Luo Guowu Yang Wenjing Yang Weide Liu Guosheng Lin Fengmao Lv 54 0 0 26 Mar 2025
Interpretable Generative Models through Post-hoc Concept Bottlenecks Akshay Kulkarni Ge Yan Chung-En Sun Tuomas P. Oikarinen Tsui-Wei Weng 39 0 0 25 Mar 2025
Towards Human-Understandable Multi-Dimensional Concept Discovery Arne Grobrugge Niklas Kühl G. Satzger Philipp Spitzer 44 0 0 24 Mar 2025
Training-Free Personalization via Retrieval and Reasoning on Fingerprints Deepayan Das Davide Talon Yiming Wang Massimiliano Mancini Elisa Ricci VLM LRM 42 0 0 24 Mar 2025
Explaining Domain Shifts in Language: Concept erasing for Interpretable Image Classification Zequn Zeng Yudi Su Jianqiao Sun Tiansheng Wen Hao Zhang Zhengjue Wang Bo Chen Hongwei Liu Jiawei Ma VLM 55 0 0 24 Mar 2025
OSLoPrompt: Bridging Low-Supervision Challenges and Open-Set Domain Generalization in CLIP M. Cui Divyam Gupta Mainak Singha Sai Bhargav Rongali Ankit Jha Muhammad Haris Khan Biplab Banerjee VLM 53 1 0 20 Mar 2025
Derm1M: A Million-scale Vision-Language Dataset Aligned with Clinical Ontology Knowledge for Dermatology Siyuan Yan Ming Hu Yiwen Jiang X. Li Hao Fei P. Tschandl Harald Kittler Zongyuan Ge VLM 62 0 0 19 Mar 2025
Unlocking Open-Set Language Accessibility in Vision Models Fawaz Sammani Jonas Fischer Nikos Deligiannis VLM 53 0 0 14 Mar 2025
Birds look like cars: Adversarial analysis of intrinsically interpretable deep learning Hubert Baniecki P. Biecek AAML 78 0 0 11 Mar 2025
Interactive Medical Image Analysis with Concept-based Similarity Reasoning Ta Duc Huy Sen Kim Tran Phan Nguyen Nguyen Hoang Tran Tran Bao Sam A. Hengel Zhibin Liao Johan W. Verjans Minh Nguyen Nhat To Vu Minh Hieu Phan 41 0 0 10 Mar 2025
Causally Reliable Concept Bottleneck Models Giovanni De Felice Arianna Casanova Flores Francesco De Santis Silvia Santini Johannes Schneider Pietro Barbiero Alberto Termine 58 2 0 06 Mar 2025
Interpretable Few-Shot Retinal Disease Diagnosis with Concept-Guided Prompting of Vision-Language Models Deval Mehta Yiwen Jiang Catherine L Jan M. He Kshitij S. Jadhav Zongyuan Ge VLM 60 0 0 04 Mar 2025
Walking the Web of Concept-Class Relationships in Incrementally Trained Interpretable Models Susmit Agrawal Deepika Vemuri S. Paul Vineeth N. Balasubramanian CLL 62 0 0 27 Feb 2025
Model-agnostic Coreset Selection via LLM-based Concept Bottlenecks Akshay Mehra Trisha Mittal Subhadra Gopalakrishnan Joshua Kimball 34 0 0 23 Feb 2025
Black Sheep in the Herd: Playing with Spuriously Correlated Attributes for Vision-Language Recognition Xinyu Tian Shu Zou Zhaoyuan Yang Mengqi He Jing Zhang VLM 43 0 0 19 Feb 2025
DiSciPLE: Learning Interpretable Programs for Scientific Visual Discovery Utkarsh Mall Cheng Perng Phoo Mia Chiquier Bharath Hariharan Kavita Bala Carl Vondrick 69 1 0 17 Feb 2025
Shortcuts and Identifiability in Concept-based Models from a Neuro-Symbolic Lens Samuele Bortolotti Emanuele Marconato Paolo Morettin Andrea Passerini Stefano Teso 53 2 0 16 Feb 2025
Interpretable Failure Detection with Human-Level Concepts Kien X. Nguyen Tang Li Xi Peng 48 0 0 07 Feb 2025
VLG-CBM: Training Concept Bottleneck Models with Vision-Language Guidance Divyansh Srivastava Beatriz Cabrero-Daniel Christian Berger VLM 57 8 0 17 Jan 2025
RadAlign: Advancing Radiology Report Generation with Vision-Language Concept Alignment Difei Gu Yunhe Gao Yang Zhou Mu Zhou Dimitris N. Metaxas LM&MA 42 1 0 13 Jan 2025
Enhancing Patient-Centric Communication: Leveraging LLMs to Simulate Patient Perspectives Xinyao Ma Rui Zhu Zihao Wang Jingwei Xiong Qingyu Chen Haixu Tang L. Jean Camp Lucila Ohno-Machado LM&MA 39 0 0 12 Jan 2025
Energy-Based Concept Bottleneck Models: Unifying Prediction, Concept Intervention, and Probabilistic Interpretations Xin-Chao Xu Yi Qin Lu Mi Hao Wang X. Li 66 9 0 03 Jan 2025
Real Classification by Description: Extending CLIP's Limits of Part Attributes Recognition Ethan Baron Idan Tankel Peter Tu Guy Ben-Yosef VLM 72 0 0 18 Dec 2024
Does VLM Classification Benefit from LLM Description Semantics? Pingchuan Ma Lennart Rietdorf Dmytro Kotovenko Vincent Tao Hu Bjorn Ommer VLM 69 0 0 16 Dec 2024
LMM-Regularized CLIP Embeddings for Image Classification Maria Tzelepi Vasileios Mezaris LLMAG VLM 72 0 0 16 Dec 2024
Explainable and Interpretable Multimodal Large Language Models: A Comprehensive Survey Yunkai Dang Kaichen Huang Jiahao Huo Yibo Yan S. Huang ... Kun Wang Yong Liu Jing Shao Hui Xiong Xuming Hu LRM 96 14 0 03 Dec 2024
Dual Risk Minimization: Towards Next-Level Robustness in Fine-tuning Zero-Shot Models Kaican Li Weiyan Xie Yongxiang Huang Didan Deng Lanqing Hong Z. Li Ricardo Silva N. Zhang 67 0 0 29 Nov 2024
Aligning Knowledge Concepts to Whole Slide Images for Precise Histopathology Image Analysis Weiqin Zhao Ziyu Guo Yinshuang Fan Yuming Jiang Maximus C. F. Yeung Lequan Yu 69 3 0 27 Nov 2024
Concept Bottleneck Language Models For protein design Aya Abdelsalam Ismail Tuomas Oikarinen Amy Wang Julius Adebayo Samuel Stanton ... J. Kleinhenz Allen Goodman H. C. Bravo Kyunghyun Cho Nathan C. Frey 25 4 0 09 Nov 2024
Aligning Characteristic Descriptors with Images for Human-Expert-like Explainability Bharat Yalavarthi N. Ratha 27 0 0 06 Nov 2024
Benchmarking XAI Explanations with Human-Aligned Evaluations Rémi Kazmierczak Steve Azzolin Eloise Berthier Anna Hedström Patricia Delhomme ... Goran Frehse Massimiliano Mancini Baptiste Caramiaux Andrea Passerini Gianni Franchi 21 1 0 04 Nov 2024
Beyond Accuracy: Ensuring Correct Predictions With Correct Rationales Tang Li Mengmeng Ma Xi Peng 29 2 0 31 Oct 2024
Interpretable Language Modeling via Induction-head Ngram Models Eunji Kim Sriya Mantena Weiwei Yang Chandan Singh Sungroh Yoon Jianfeng Gao 44 0 0 31 Oct 2024
Aggregate-and-Adapt Natural Language Prompts for Downstream Generalization of CLIP Chen Huang Skyler Seto Samira Abnar David Grangier Navdeep Jaitly J. Susskind VLM 36 0 0 31 Oct 2024
Bayesian Concept Bottleneck Models with LLM Priors Jean Feng Avni Kothari Luke Zier Chandan Singh Yan Shuo Tan 13 2 0 21 Oct 2024
Concept Complement Bottleneck Model for Interpretable Medical Image Diagnosis Hongmei Wang Junlin Hou Hao Chen 26 0 0 20 Oct 2024
Scene Graph Generation with Role-Playing Large Language Models Guikun Chen Jin Li Wenguan Wang VLM 40 5 0 20 Oct 2024
Help Me Identify: Is an LLM+VQA System All We Need to Identify Visual Concepts? Shailaja Keyur Sampat Maitreya Patel Yezhou Yang Chitta Baral 16 0 0 17 Oct 2024
Tree of Attributes Prompt Learning for Vision-Language Models Tong Ding Wanhua Li Zhongqi Miao Hanspeter Pfister VLM 52 1 0 15 Oct 2024