VisoGender: A dataset for benchmarking gender bias in image-text pronoun resolution

21 June 2023

Aleksandar Shtedritski

Hannah Rose Kirk

CoGe

ArXiv PDF HTML

Papers citing "VisoGender: A dataset for benchmarking gender bias in image-text pronoun resolution"

33 / 33 papers shown

Title
FortisAVQA and MAVEN: a Benchmark Dataset and Debiasing Framework for Robust Multimodal Reasoning Jie Ma Zhitao Gao Qi Chai J. Liu P. Wang Jing Tao Zhou Su 42 0 0 01 Apr 2025
A Large Scale Analysis of Gender Biases in Text-to-Image Generative Models Leander Girrbach Stephan Alaniz Genevieve Smith Zeynep Akata 37 0 0 30 Mar 2025
VisBias: Measuring Explicit and Implicit Social Biases in Vision Language Models Jen-Tse Huang Jiantong Qin Jianping Zhang Youliang Yuan Wenxuan Wang Jieyu Zhao VLM 54 0 0 10 Mar 2025
VLMs as GeoGuessr Masters: Exceptional Performance, Hidden Biases, and Privacy Risks Jingyuan Huang Jen-tse Huang Ziyi Liu Xiaoyuan Liu Wenxuan Wang Jieyu Zhao 43 1 0 16 Feb 2025
SB-Bench: Stereotype Bias Benchmark for Large Multimodal Models Vishal Narnaware Ashmal Vayani Rohit Gupta Swetha Sirnam Mubarak Shah 104 3 0 12 Feb 2025
Intrinsic Bias is Predicted by Pretraining Data and Correlates with Downstream Performance in Vision-Language Encoders Kshitish Ghate Isaac Slaughter Kyra Wilson Mona Diab Aylin Caliskan 71 0 0 11 Feb 2025
Nearest Neighbor Normalization Improves Multimodal Retrieval Neil Chowdhury Franklin Wang Sumedh Shenoy Douwe Kiela Sarah Schwettmann Tristan Thrush VLM 24 3 0 31 Oct 2024
Revealing and Reducing Gender Biases in Vision and Language Assistants (VLAs) Leander Girrbach Yiran Huang Stephan Alaniz Trevor Darrell Zeynep Akata VLM 32 2 0 25 Oct 2024
debiaSAE: Benchmarking and Mitigating Vision-Language Model Bias Kuleen Sasse Shan Chen Jackson Pond Danielle S. Bitterman J. D. Osborne VLM 13 1 0 17 Oct 2024
Fairness and Bias Mitigation in Computer Vision: A Survey Sepehr Dehdashtian Ruozhen He Yi Li Guha Balakrishnan Nuno Vasconcelos Vicente Ordonez Vishnu Naresh Boddeti 21 4 0 05 Aug 2024
GABInsight: Exploring Gender-Activity Binding Bias in Vision-Language Models Ali Abdollahi Mahdi Ghaznavi Mohammad Reza Karimi Nejad Arash Mari Oriyad Reza Abbasi Ali Salesi Melika Behjati M. Rohban M. Baghshah CoGe 18 1 0 30 Jul 2024
Evaluating Model Bias Requires Characterizing its Mistakes Isabela Albuquerque Jessica Schrouff David Warde-Farley Ali Taylan Cemgil Sven Gowal Olivia Wiles 34 0 0 15 Jul 2024
What an Elegant Bridge: Multilingual LLMs are Biased Similarly in Different Languages Viktor Mihaylov Aleksandar Shtedritski 30 0 0 12 Jul 2024
MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation? Zhaorun Chen Yichao Du Zichen Wen Yiyang Zhou Chenhang Cui ... Jiawei Zhou Zhuokai Zhao Rafael Rafailov Chelsea Finn Huaxiu Yao EGVM MLLM 41 29 0 05 Jul 2024
FairJob: A Real-World Dataset for Fairness in Online Systems Mariia Vladimirova Federico Pavone Eustache Diemert 16 1 0 03 Jul 2024
BiasDora: Exploring Hidden Biased Associations in Vision-Language Models Chahat Raj A. Mukherjee Aylin Caliskan Antonios Anastasopoulos Ziwei Zhu VLM 32 4 0 02 Jul 2024
$GenderBias-\emph{VL}: Benchmarking Gender Bias in Vision Language Models via Counterfactual Probing$ GenderBias-\emph{VL}: Benchmarking Gender Bias in Vision Language Models via Counterfactual Probing Yisong Xiao Aishan Liu QianJia Cheng Zhenfei Yin Siyuan Liang Jiapeng Li Jing Shao Xianglong Liu Dacheng Tao 24 4 0 30 Jun 2024
VLind-Bench: Measuring Language Priors in Large Vision-Language Models Kang-il Lee Minbeom Kim Seunghyun Yoon Minsung Kim Dongryeol Lee Hyukhun Koh Kyomin Jung CoGe VLM 64 5 0 13 Jun 2024
DiffusionPID: Interpreting Diffusion via Partial Information Decomposition Shaurya Dewan Rushikesh Zawar Prakanshul Saxena Yingshan Chang Andrew F. Luo Yonatan Bisk DiffM 22 3 0 07 Jun 2024
Uncovering Bias in Large Vision-Language Models at Scale with Counterfactuals Phillip Howard Kathleen C. Fraser Anahita Bhiwandiwalla S. Kiritchenko 48 9 0 30 May 2024
Think Before You Act: A Two-Stage Framework for Mitigating Gender Bias Towards Vision-Language Tasks Yunqi Zhang Songda Li Chunyuan Deng Luyi Wang Hui Zhao 16 0 0 27 May 2024
Look, Listen, and Answer: Overcoming Biases for Audio-Visual Question Answering Jie Ma Min Hu Pinghui Wang Wangchun Sun Lingyun Song Hongbin Pei Jun Liu Youtian Du 28 4 0 18 Apr 2024
SafetyPrompts: a Systematic Review of Open Datasets for Evaluating and Improving Large Language Model Safety Paul Röttger Fabio Pernisi Bertie Vidgen Dirk Hovy ELM KELM 51 30 0 08 Apr 2024
A Unified Framework and Dataset for Assessing Societal Bias in Vision-Language Models Ashutosh Sathe Prachi Jain Sunayana Sitaram 37 1 0 21 Feb 2024
SocialCounterfactuals: Probing and Mitigating Intersectional Social Biases in Vision-Language Models with Counterfactual Examples Phillip Howard Avinash Madasu Tiep Le Gustavo Lujan Moreno Anahita Bhiwandiwalla Vasudev Lal 43 16 0 30 Nov 2023
Foundational Models Defining a New Era in Vision: A Survey and Outlook Muhammad Awais Muzammal Naseer Salman Khan Rao Muhammad Anwer Hisham Cholakkal M. Shah Ming Yang F. Khan VLM 13 116 0 25 Jul 2023
Vision Meets Definitions: Unsupervised Visual Word Sense Disambiguation Incorporating Gloss Information Sunjae Kwon Rishabh Garodia Minhwa Lee Zhichao Yang Hong-ye Yu CoGe 26 3 0 02 May 2023
Why is Winoground Hard? Investigating Failures in Visuolinguistic Compositionality Anuj Diwan Layne Berry Eunsol Choi David F. Harwath Kyle Mahowald CoGe 78 41 0 01 Nov 2022
GroupViT: Semantic Segmentation Emerges from Text Supervision Jiarui Xu Shalini De Mello Sifei Liu Wonmin Byeon Thomas Breuel Jan Kautz X. Wang ViT VLM 173 494 0 22 Feb 2022
COVR: A test-bed for Visually Grounded Compositional Generalization with real images Ben Bogin Shivanshu Gupta Matt Gardner Jonathan Berant CoGe 29 29 0 22 Sep 2021
Are Gender-Neutral Queries Really Gender-Neutral? Mitigating Gender Bias in Image Search Jialu Wang Yang Liu X. Wang FaML 132 95 0 12 Sep 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 293 2,875 0 11 Feb 2021
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 279 39,083 0 01 Sep 2014