Pixels Versus Priors: Controlling Knowledge Priors in Vision-Language Models through Visual Counterfacts

Pixels Versus Priors: Controlling Knowledge Priors in Vision-Language Models through Visual Counterfacts

21 May 2025

Michal Golovanevsky

Ritambhara Singh

Carsten Eickhoff

Papers citing "Pixels Versus Priors: Controlling Knowledge Priors in Vision-Language Models through Visual Counterfacts"

13 / 13 papers shown

Title
Forgotten Polygons: Multimodal Large Language Models are Shape-Blind William Rudman Michal Golovanesky Amir Bar Vedant Palit Yann LeCun Carsten Eickhoff Ritambhara Singh LRM 90 3 0 21 Feb 2025
Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scaling Xiaokang Chen Zhiyu Wu Xingchao Liu Zizheng Pan Wen Liu Zhenda Xie X. Yu Chong Ruan AI4TS 57 126 0 29 Jan 2025
Interpreting and Editing Vision-Language Representations to Mitigate Hallucinations Nick Jiang Anish Kachinthaya Suzie Petryk Yossi Gandelsman VLM 53 23 0 03 Oct 2024
VLKEB: A Large Vision-Language Model Knowledge Editing Benchmark Han Huang Haitian Zhong Tao Yu Qiang Liu Shu Wu Liang Wang Tien-Ping Tan VLM KELM 47 9 0 12 Mar 2024
Patchscopes: A Unifying Framework for Inspecting Hidden Representations of Language Models Asma Ghandeharioun Avi Caciularu Adam Pearce Lucas Dixon Mor Geva 66 97 0 11 Jan 2024
The mechanistic basis of data dependence and abrupt learning in an in-context classification task Gautam Reddy 61 58 0 03 Dec 2023
Spuriosity Rankings: Sorting Data to Measure and Mitigate Biases Mazda Moayeri Wenxiao Wang Sahil Singla Soheil Feizi 101 15 0 05 Dec 2022
VL-CheckList: Evaluating Pre-trained Vision-Language Models with Objects, Attributes and Relations Tiancheng Zhao Tianqi Zhang Mingwei Zhu Haozhan Shen Kyusong Lee Xiaopeng Lu Jianwei Yin VLM CoGe MLLM 83 93 0 01 Jul 2022
Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality Tristan Thrush Ryan Jiang Max Bartolo Amanpreet Singh Adina Williams Douwe Kiela Candace Ross CoGe 80 415 0 07 Apr 2022
Locating and Editing Factual Associations in GPT Kevin Meng David Bau A. Andonian Yonatan Belinkov KELM 154 1,275 0 10 Feb 2022
Probing Image-Language Transformers for Verb Understanding Lisa Anne Hendricks Aida Nematzadeh 51 116 0 16 Jun 2021
Knowledge Neurons in Pretrained Transformers Damai Dai Li Dong Y. Hao Zhifang Sui Baobao Chang Furu Wei KELM MU 58 440 0 18 Apr 2021
Transformer Feed-Forward Layers Are Key-Value Memories Mor Geva R. Schuster Jonathan Berant Omer Levy KELM 109 792 0 29 Dec 2020