Understanding and Evaluating Racial Biases in Image Captioning

16 June 2021

Papers citing "Understanding and Evaluating Racial Biases in Image Captioning"

29 / 79 papers shown

Title
Graph Neural Networks in Vision-Language Image Understanding: A Survey Henry Senior Greg Slabaugh Shanxin Yuan Luca Rossi GNN 23 13 0 07 Mar 2023
Ethical Considerations for Responsible Data Curation Jerone T. A. Andrews Dora Zhao William Thong Apostolos Modas Orestis Papakyriakopoulos Alice Xiang 17 19 0 07 Feb 2023
Switching to Discriminative Image Captioning by Relieving a Bottleneck of Reinforcement Learning Ukyo Honda Taro Watanabe Yuji Matsumoto 8 9 0 06 Dec 2022
Adaptive Testing of Computer Vision Models Irena Gao Gabriel Ilharco Scott M. Lundberg Marco Tulio Ribeiro VLM 12 42 0 06 Dec 2022
Large-Scale Bidirectional Training for Zero-Shot Image Captioning Taehoon Kim Mark A Marsden Pyunghwan Ahn Sangyun Kim Sihaeng Lee Alessandra Sala S. Kim VLM 27 4 0 13 Nov 2022
Men Also Do Laundry: Multi-Attribute Bias Amplification Dora Zhao Jerone T. A. Andrews Alice Xiang FaML 28 20 0 21 Oct 2022
On Learning Fairness and Accuracy on Multiple Subgroups Changjian Shui Gezheng Xu Qi Chen Jiaqi Li Charles X. Ling Tal Arbel Boyu Wang Christian Gagné 37 37 0 19 Oct 2022
Bias Mimicking: A Simple Sampling Approach for Bias Mitigation Maan Qraitem Kate Saenko Bryan A. Plummer 56 34 0 30 Sep 2022
HAPI: A Large-scale Longitudinal Dataset of Commercial ML API Predictions Lingjiao Chen Zhihua Jin Sabri Eyuboglu Christopher Ré Matei A. Zaharia James Y. Zou 37 9 0 18 Sep 2022
Distribution Aware Metrics for Conditional Natural Language Generation David M. Chan Yiming Ni David A. Ross Sudheendra Vijayanarasimhan Austin Myers John F. Canny 40 4 0 15 Sep 2022
Every picture tells a story: Image-grounded controllable stylistic story generation Holy Lovenia Bryan Wilie Romain Barraud Samuel Cahyawijaya Willy Chung Pascale Fung 19 8 0 04 Sep 2022
CODER: Coupled Diversity-Sensitive Momentum Contrastive Learning for Image-Text Retrieval Haoran Wang Dongliang He Wenhao Wu Boyang Xia Min Yang Fu Li Yunlong Yu Zhong Ji Errui Ding Jingdong Wang 19 22 0 21 Aug 2022
GSRFormer: Grounded Situation Recognition Transformer with Alternate Semantic Attention Refinement Zhi-Qi Cheng Qianwen Dai Siyao Li Teruko Mitamura Alexander G. Hauptmann 16 34 0 18 Aug 2022
FairGRAPE: Fairness-aware GRAdient Pruning mEthod for Face Attribute Classification Xiao-Ze Lin Seungbae Kim Jungseock Joo CVBM 29 38 0 22 Jul 2022
Gender Artifacts in Visual Datasets Nicole Meister Dora Zhao Angelina Wang V. V. Ramaswamy Ruth C. Fong Olga Russakovsky 19 28 0 18 Jun 2022
Measuring Representational Harms in Image Captioning Angelina Wang Solon Barocas Kristen Laird Hanna M. Wallach 19 51 0 14 Jun 2022
GIT: A Generative Image-to-text Transformer for Vision and Language Jianfeng Wang Zhengyuan Yang Xiaowei Hu Linjie Li Kevin Qinghong Lin Zhe Gan Zicheng Liu Ce Liu Lijuan Wang VLM 27 526 0 27 May 2022
Gender and Racial Bias in Visual Question Answering Datasets Yusuke Hirota Yuta Nakashima Noa Garcia FaML 127 46 0 17 May 2022
What's in a Caption? Dataset-Specific Linguistic Diversity and Its Effect on Visual Description Models and Metrics David M. Chan Austin Myers Sudheendra Vijayanarasimhan David A. Ross Bryan Seybold John F. Canny 26 6 0 12 May 2022
Subverting Fair Image Search with Generative Adversarial Perturbations A. Ghosh Matthew Jagielski Chris L. Wilson 17 7 0 05 May 2022
Flamingo: a Visual Language Model for Few-Shot Learning Jean-Baptiste Alayrac Jeff Donahue Pauline Luc Antoine Miech Iain Barr ... Mikolaj Binkowski Ricardo Barreira Oriol Vinyals Andrew Zisserman Karen Simonyan MLLM VLM 46 3,326 0 29 Apr 2022
Measuring Compositional Consistency for Video Question Answering Mona Gandhi Mustafa Omer Gul Eva Prakash Madeleine Grunde-McLaughlin Ranjay Krishna Maneesh Agrawala CoGe 32 15 0 14 Apr 2022
Quantifying Societal Bias Amplification in Image Captioning Yusuke Hirota Yuta Nakashima Noa Garcia 19 49 0 29 Mar 2022
A Prompt Array Keeps the Bias Away: Debiasing Vision-Language Models with Adversarial Learning Hugo Elias Berg S. Hall Yash Bhalgat Wonsuk Yang Hannah Rose Kirk Aleksandar Shtedritski Max Bain VLM 17 99 0 22 Mar 2022
DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Models Jaemin Cho Abhaysinh Zala Mohit Bansal ViT 132 170 0 08 Feb 2022
A Systematic Study of Bias Amplification Melissa Hall L. V. D. van der Maaten Laura Gustafson Maxwell Jones Aaron B. Adcock 92 70 0 27 Jan 2022
Topological Regularization for Dense Prediction Deqing Fu Bradley J. Nelson MDE 14 0 0 22 Nov 2021
One Label, One Billion Faces: Usage and Consistency of Racial Categories in Computer Vision Zaid Khan Y. Fu 144 51 0 03 Feb 2021
REVISE: A Tool for Measuring and Mitigating Bias in Visual Datasets Angelina Wang Alexander Liu Ryan Zhang Anat Kleiman Leslie Kim Dora Zhao Iroha Shirai Arvind Narayanan Olga Russakovsky 25 185 0 16 Apr 2020