Measuring Representational Harms in Image Captioning

14 June 2022

Papers citing "Measuring Representational Harms in Image Captioning"

31 / 31 papers shown

Title
Building Trustworthy Multimodal AI: A Review of Fairness, Transparency, and Ethics in Vision-Language Tasks Mohammad Saleha Azadeh Tabatabaeib 52 0 0 14 Apr 2025
The Backfiring Effect of Weak AI Safety Regulation Benjamin Laufer Jon Kleinberg Hoda Heidari 41 0 0 26 Mar 2025
AI Mismatches: Identifying Potential Algorithmic Harms Before AI Development Devansh Saxena Ji-Youn Jung J. Forlizzi Kenneth Holstein J. Zimmerman 57 0 0 25 Feb 2025
Identifying Implicit Social Biases in Vision-Language Models Kimia Hamidieh Haoran Zhang Walter Gerych Thomas Hartvigsen Marzyeh Ghassemi VLM 28 11 0 01 Nov 2024
The Dark Side of AI Companionship: A Taxonomy of Harmful Algorithmic Behaviors in Human-AI Relationships Renwen Zhang Han Li Han Meng Jinyuan Zhan Hongyuan Gan Yi-Chieh Lee 19 0 0 26 Oct 2024
Building Solidarity Amid Hostility: Experiences of Fat People in Online Communities Blakeley H. Payne Jordan Taylor Katta Spiel Casey Fiesler 23 0 0 06 Oct 2024
Challenging Fairness: A Comprehensive Exploration of Bias in LLM-Based Recommendations Shahnewaz Karim Sakib Anindya Bijoy Das 23 0 0 17 Sep 2024
Evaluating Model Bias Requires Characterizing its Mistakes Isabela Albuquerque Jessica Schrouff David Warde-Farley Ali Taylan Cemgil Sven Gowal Olivia Wiles 42 2 0 15 Jul 2024
Beyond Perplexity: Multi-dimensional Safety Evaluation of LLM Compression Zhichao Xu Ashim Gupta Tao Li Oliver Bentham Vivek Srikumar 40 8 0 06 Jul 2024
FairDeDup: Detecting and Mitigating Vision-Language Fairness Disparities in Semantic Dataset Deduplication Eric Slyman Stefan Lee Scott D. Cohen Kushal Kafle VLM 28 5 0 24 Apr 2024
Harm Amplification in Text-to-Image Models Susan Hao Renee Shelby Yuchi Liu Hansa Srinivasan Mukul Bhutani Burcu Karagol Ayan Ryan Poplin Shivani Poddar Sarah Laszlo 34 7 0 01 Feb 2024
A Scoping Study of Evaluation Practices for Responsible AI Tools: Steps Towards Effectiveness Evaluations G. Berman Nitesh Goyal Michael A. Madaio ELM 27 19 0 30 Jan 2024
Beyond Behaviorist Representational Harms: A Plan for Measurement and Mitigation Jennifer Chien David Danks 34 13 0 25 Jan 2024
SCoFT: Self-Contrastive Fine-Tuning for Equitable Image Generation Zhixuan Liu Peter Schaldenbrand Beverley-Claire Okogwu Wenxuan Peng Youngsik Yun Andrew Hundt Jihie Kim Jean Oh 23 16 0 16 Jan 2024
ToViLaG: Your Visual-Language Generative Model is Also An Evildoer Xinpeng Wang Xiaoyuan Yi Han Jiang Shanlin Zhou Zhihua Wei Xing Xie 25 12 0 13 Dec 2023
Explaining CLIP's performance disparities on data from blind/low vision users Daniela Massiceti Camilla Longden Agnieszka Slowik Samuel Wills Martin Grayson C. Morrison VLM 17 7 0 29 Nov 2023
Toward Operationalizing Pipeline-aware ML Fairness: A Research Agenda for Developing Practical Guidelines and Tools Maximilian Schambach Rakshit Naidu Rayid Ghani Kit T. Rodolfa Daniel E. Ho Hoda Heidari FaML 30 13 0 29 Sep 2023
VLSlice: Interactive Vision-and-Language Slice Discovery Eric Slyman Minsuk Kahng Stefan Lee VLM 8 7 0 13 Sep 2023
Beyond the ML Model: Applying Safety Engineering Frameworks to Text-to-Image Development Shalaleh Rismani Renee Shelby A. Smart Renelito Delos Santos AJung Moon Negar Rostamzadeh 25 9 0 19 Jul 2023
Investigating Practices and Opportunities for Cross-functional Collaboration around AI Fairness in Industry Practice Wesley Hanwen Deng Nuri Yildirim Monica Chang Motahhare Eslami Kenneth Holstein Michael A. Madaio 17 42 0 10 Jun 2023
Safety and Fairness for Content Moderation in Generative Models Susan Hao Piyush Kumar Sarah Laszlo Shivani Poddar Bhaktipriya Radharapu Renee Shelby EGVM 19 17 0 09 Jun 2023
Nichelle and Nancy: The Influence of Demographic Attributes and Tokenization Length on First Name Biases Haozhe An Rachel Rudinger 10 9 0 26 May 2023
AI's Regimes of Representation: A Community-centered Study of Text-to-Image Models in South Asia Rida Qadri Renee Shelby Cynthia L. Bennett Emily Denton 14 65 0 19 May 2023
Fairness in Visual Clustering: A Novel Transformer Clustering Approach Xuan-Bac Nguyen C. Duong Marios Savvides Kaushik Roy Hugh Churchill Khoa Luu 24 9 0 14 Apr 2023
Uncurated Image-Text Datasets: Shedding Light on Demographic Bias Noa Garcia Yusuke Hirota Yankun Wu Yuta Nakashima EGVM 20 50 0 06 Apr 2023
Overwriting Pretrained Bias with Finetuning Data Angelina Wang Olga Russakovsky 19 29 0 10 Mar 2023
Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reduction Renee Shelby Shalaleh Rismani Kathryn Henne AJung Moon Negar Rostamzadeh ... N'Mah Yilla-Akbari Jess Gallegos A. Smart Emilio Garcia Gurleen Virk 29 187 0 11 Oct 2022
A survey of Identification and mitigation of Machine Learning algorithmic biases in Image Analysis Laurent Risser Agustin Picard Lucas Hervier Jean-Michel Loubes FaML 25 5 0 10 Oct 2022
FairGRAPE: Fairness-aware GRAdient Pruning mEthod for Face Attribute Classification Xiao-Ze Lin Seungbae Kim Jungseock Joo CVBM 21 38 0 22 Jul 2022
DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Models Jaemin Cho Abhaysinh Zala Mohit Bansal ViT 132 170 0 08 Feb 2022
Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioning Jiasen Lu Caiming Xiong Devi Parikh R. Socher 83 1,440 0 06 Dec 2016