Identifying Interpretable Subspaces in Image Representations

20 July 2023

Papers citing "Identifying Interpretable Subspaces in Image Representations"

28 / 28 papers shown

Title
Embedding Shift Dissection on CLIP: Effects of Augmentations on VLM's Representation Learning Ashim Dahal Saydul Akbar Murad Nick Rahimi VLM 40 0 0 30 Mar 2025
QPM: Discrete Optimization for Globally Interpretable Image Classification Thomas Norrenbrock T. Kaiser Sovan Biswas R. Manuvinakurike Bodo Rosenhahn 50 0 0 27 Feb 2025
NeurFlow: Interpreting Neural Networks through Neuron Groups and Functional Interactions Tue Cao Nhat X. Hoang Hieu H. Pham P. Nguyen My T. Thai 69 0 0 22 Feb 2025
LaVCa: LLM-assisted Visual Cortex Captioning Takuya Matsuyama Shinji Nishimoto Yu Takagi 48 0 0 20 Feb 2025
Narrowing Information Bottleneck Theory for Multimodal Image-Text Representations Interpretability Zhiyu Zhu Zhibo Jin Jiayu Zhang Nan Yang Jiahao Huang Jianlong Zhou Fang Chen 39 0 0 16 Feb 2025
FairDropout: Using Example-Tied Dropout to Enhance Generalization of Minority Groups Géraldin Nanfack Eugene Belilovsky 51 0 0 10 Feb 2025
Sparse Autoencoders for Scientifically Rigorous Interpretation of Vision Models Samuel Stevens Wei-Lun Chao T. Berger-Wolf Yu-Chuan Su VLM 69 2 0 10 Feb 2025
A Concept-Centric Approach to Multi-Modality Learning Yuchong Geng Ao Tang 70 0 0 18 Dec 2024
Mask-Free Neuron Concept Annotation for Interpreting Neural Networks in Medical Domain Hyeon Bae Kim Yong Hyun Ahn Seong Tae Kim 37 1 0 16 Jul 2024
AND: Audio Network Dissection for Interpreting Deep Acoustic Models Tung-Yu Wu Yu-Xiang Lin Tsui-Wei Weng 43 1 0 24 Jun 2024
LLM-assisted Concept Discovery: Automatically Identifying and Explaining Neuron Functions N. Hoang-Xuan Minh Nhat Vu My T. Thai 23 3 0 12 Jun 2024
CoSy: Evaluating Textual Explanations of Neurons Laura Kopf P. Bommer Anna Hedström Sebastian Lapuschkin Marina M.-C. Höhne Kirill Bykov 33 7 0 30 May 2024
Linear Explanations for Individual Neurons Tuomas P. Oikarinen Tsui-Wei Weng FAtt MILM 29 5 0 10 May 2024
WWW: A Unified Framework for Explaining What, Where and Why of Neural Networks by Interpretation of Neuron Concepts Yong Hyun Ahn Hyeon Bae Kim Seong Tae Kim 16 4 0 29 Feb 2024
Prospector Heads: Generalized Feature Attribution for Large Models & Data Gautam Machiraju Alexander Derry Arjun D Desai Neel Guha Amir-Hossein Karimi James Zou Russ Altman Christopher Ré Parag Mallick AI4TS MedIm 41 0 0 18 Feb 2024
Explaining the Implicit Neural Canvas: Connecting Pixels to Neurons by Tracing their Contributions Namitha Padmanabhan M. Gwilliam Pulkit Kumar Shishira R. Maiya Max Ehrlich Abhinav Shrivastava 29 2 1 18 Jan 2024
Manipulating Feature Visualizations with Gradient Slingshots Dilyara Bareeva Marina M.-C. Höhne Alexander Warnecke Lukas Pirch Klaus-Robert Müller Konrad Rieck Kirill Bykov AAML 27 6 0 11 Jan 2024
Labeling Neural Representations with Inverse Recognition Kirill Bykov Laura Kopf Shinichi Nakajima Marius Kloft Marina M.-C. Höhne BDL 19 15 0 22 Nov 2023
Uncovering Unique Concept Vectors through Latent Space Decomposition Mara Graziani Laura Mahony An-phi Nguyen Henning Muller Vincent Andrearczyk 31 4 0 13 Jul 2023
Scale Alone Does not Improve Mechanistic Interpretability in Vision Models Roland S. Zimmermann Thomas Klein Wieland Brendel 10 13 0 11 Jul 2023
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models Junnan Li Dongxu Li Silvio Savarese Steven C. H. Hoi VLM MLLM 247 4,186 0 30 Jan 2023
RankMe: Assessing the downstream performance of pretrained self-supervised representations by their rank Q. Garrido Randall Balestriero Laurent Najman Yann LeCun SSL 46 71 0 05 Oct 2022
Toy Models of Superposition Nelson Elhage Tristan Hume Catherine Olsson Nicholas Schiefer T. Henighan ... Sam McCandlish Jared Kaplan Dario Amodei Martin Wattenberg C. Olah AAML MILM 120 314 0 21 Sep 2022
Measuring Self-Supervised Representation Quality for Downstream Classification using Discriminative Features N. Kalibhat Kanika Narang Hamed Firooz Maziar Sanjabi S. Feizi SSL 23 7 0 03 Mar 2022
Natural Language Descriptions of Deep Visual Features Evan Hernandez Sarah Schwettmann David Bau Teona Bagashvili Antonio Torralba Jacob Andreas MILM 194 116 0 26 Jan 2022
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 286 5,723 0 29 Apr 2021
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 238 3,359 0 09 Mar 2020
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 282 39,083 0 01 Sep 2014