v1v2 (latest)

"What We Can't Measure, We Can't Understand": Challenges to Demographic Data Procurement in the Pursuit of Fairness

Conference on Fairness, Accountability and Transparency (FAccT), 2020

30 October 2020

Papers citing ""What We Can't Measure, We Can't Understand": Challenges to Demographic Data Procurement in the Pursuit of Fairness"

50 / 59 papers shown

Title
Near-Exponential Savings for Mean Estimation with Active Learning Julian M. Morimoto Jacob Goldin Daniel E. Ho 72 0 0 07 Nov 2025
Demographic-Agnostic Fairness without Harm Zhongteng Cai Mohammad Mahdi Khalili Xueru Zhang 100 0 0 28 Sep 2025
Beyond Internal Data: Bounding and Estimating Fairness from Incomplete Data Varsha Ramineni Hossein A. Rahmani Emine Yilmaz David Barber 120 0 0 18 Aug 2025
Beyond Internal Data: Constructing Complete Datasets for Fairness Testing Varsha Ramineni Hossein A. Rahmani Emine Yilmaz David Barber 130 0 0 24 Jul 2025
Fairness-in-the-Workflow: How Machine Learning Practitioners at Big Tech Companies Approach Fairness in Recommender Systems Jing Nathan Yan Emma Harvey Junxiong Wang Jeffrey M. Rzeszotarski Allison Koenecke FaML 290 0 0 26 May 2025
Talking About the Assumption in the RoomInternational Conference on Human Factors in Computing Systems (CHI), 2025 Ramaravind Kommiya Mothilal Faisal M. Lalani Syed Ishtiaque Ahmed Shion Guha Sharifa Sultana 273 2 0 20 Feb 2025
Auditing a Dutch Public Sector Risk Profiling Algorithm Using an Unsupervised Bias Detection Tool Floris Holstege Mackenzie Jorgensen Kirtan Padh Jurriaan Parie Joel Persson Krsto Prorokovic Lukas Snoek 382 1 0 03 Feb 2025
Accurate and Data-Efficient Toxicity Prediction when Annotators DisagreeConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Harbani Jaggi Kashyap Murali Eve Fleisig Erdem Bıyık 128 3 0 16 Oct 2024
Minimum Viable Ethics: From Institutionalizing Industry AI Governance to Product Impact Archana Ahlawat Amy Winecoff Jonathan Mayer 200 1 0 11 Sep 2024
Position: Measure Dataset Diversity, Don't Just Claim It Dora Zhao Jerone T. A. Andrews Orestis Papakyriakopoulos Alice Xiang 267 29 0 11 Jul 2024
FairJob: A Real-World Dataset for Fairness in Online Systems Mariia Vladimirova Federico Pavone Eustache Diemert 301 6 0 03 Jul 2024
A Taxonomy of Challenges to Curating Fair Datasets Dora Zhao M. Scheuerman Pooja Chitre Jerone T. A. Andrews Georgia Panagiotidou Shawn Walker Kathleen H. Pine Alice Xiang 265 4 0 10 Jun 2024
Addressing Discretization-Induced Bias in Demographic Prediction Evan Dong Aaron Schein Yixin Wang Nikhil Garg 190 6 0 27 May 2024
Interpretability Needs a New Paradigm Andreas Madsen Himabindu Lakkaraju Siva Reddy Sarath Chandar 185 6 0 08 May 2024
Lazy Data Practices Harm Fairness Research Jan Simson Alessandro Fabris Christoph Kern 155 10 0 26 Apr 2024
Fairness Without Harm: An Influence-Guided Active Sampling Approach Jinlong Pang Jialu Wang Zhaowei Zhu Yuanshun Yao Chen Qian Yang Liu TDI 243 8 0 20 Feb 2024
AboutMe: Using Self-Descriptions in Webpages to Document the Effects of English Pretraining Data FiltersAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 L. Lucy Suchin Gururangan Luca Soldaini Emma Strubell David Bamman Lauren Klein Jesse Dodge 333 19 0 12 Jan 2024
Modeling subjectivity (by Mimicking Annotator Annotation) in toxic comment identification across diverse communities Senjuti Dutta Sid Mittal Sherol Chen Deepak Ramachandran Ravi Rajakumar Ian D Kivlichan Sunny Mak Alena Butryna Praveen Paritosh University of Tennessee 276 8 0 01 Nov 2023
"One-Size-Fits-All"? Examining Expectations around What Constitute "Fair" or "Good" NLG System BehaviorsNorth American Chapter of the Association for Computational Linguistics (NAACL), 2023 Li Lucy Su Lin Blodgett Milad Shokouhi Hanna M. Wallach Alexandra Olteanu 289 12 0 23 Oct 2023
Estimating and Implementing Conventional Fairness Metrics With Probabilistic Protected Features Hadi Elzayn Emily Black Patrick Vossler Nathanael Jo Jacob Goldin Daniel E. Ho 131 7 0 02 Oct 2023
Beyond Skin Tone: A Multidimensional Measure of Apparent Skin ColorIEEE International Conference on Computer Vision (ICCV), 2023 William Thong Przemyslaw K. Joniak Alice Xiang 281 26 0 10 Sep 2023
TIDE: Textual Identity Detection for Evaluating and Augmenting Classification and Language Models Emmanuel Klu Sameer Sethi 150 0 0 07 Sep 2023
When Fair Classification Meets Noisy Protected AttributesAAAI/ACM Conference on AI, Ethics, and Society (AIES), 2023 Avijit Ghosh Pablo Kvitca Chris L. Wilson FaML 147 10 0 06 Jul 2023
Evaluating the Social Impact of Generative AI Systems in Systems and Society Irene Solaiman Zeerak Talat William Agnew Lama Ahmad Dylan K. Baker ... Marie-Therese Png Shubham Singh A. Strait Lukas Struppek Arjun Subramonian ELM EGVM 435 145 0 09 Jun 2023
Disentangling and Operationalizing AI Fairness at LinkedInConference on Fairness, Accountability and Transparency (FAccT), 2023 Joaquin Quiñonero Candela Yuwen Wu Brian Hsu Sakshi Jain Jennifer Ramos Jon Adams R. Hallman Kinjal Basu 197 11 0 30 May 2023
A View From Somewhere: Human-Centric Face RepresentationsInternational Conference on Learning Representations (ICLR), 2023 Jerone T. A. Andrews Przemyslaw K. Joniak Alice Xiang CVBM 167 11 0 30 Mar 2023
Can Workers Meaningfully Consent to Workplace Wellbeing Technologies?Conference on Fairness, Accountability and Transparency (FAccT), 2023 Shreyans Chowdhary Anna Kawakami Mary L. Gray J. Suh Alexandra Olteanu Koustuv Saha 221 42 0 13 Mar 2023
Overwriting Pretrained Bias with Finetuning DataIEEE International Conference on Computer Vision (ICCV), 2023 Angelina Wang Olga Russakovsky 290 45 0 10 Mar 2023
Multi-dimensional discrimination in Law and Machine Learning -- A comparative overviewConference on Fairness, Accountability and Transparency (FAccT), 2023 Arjun Roy J. Horstmann Eirini Ntoutsi FaML 161 26 0 12 Feb 2023
Ethical Considerations for Responsible Data CurationNeural Information Processing Systems (NeurIPS), 2023 Jerone T. A. Andrews Dora Zhao William Thong Apostolos Modas Orestis Papakyriakopoulos Alice Xiang 418 30 0 07 Feb 2023
An Operational Perspective to Fairness Interventions: Where and How to Intervene Brian Hsu Xiaotong Chen Ying Han Hongseok Namkoong Kinjal Basu 280 2 0 03 Feb 2023
Simplicity Bias Leads to Amplified Performance DisparitiesConference on Fairness, Accountability and Transparency (FAccT), 2022 Samuel J. Bell Levent Sagun 202 13 0 13 Dec 2022
Fair Ranking with Noisy Protected AttributesNeural Information Processing Systems (NeurIPS), 2022 Anay Mehrotra Nisheeth K. Vishnoi 225 22 0 30 Nov 2022
A Keyword Based Approach to Understanding the Overpenalization of Marginalized Groups by English Marginal Abuse Models on Twitter Kyra Yee Alice Schoenauer Sebag Olivia Redfield Emily Sheng Matthias Eck Luca Belli 142 3 0 07 Oct 2022
Weak Proxies are Sufficient and Preferable for Fairness with Missing Sensitive AttributesInternational Conference on Machine Learning (ICML), 2022 Zhaowei Zhu Yuanshun Yao Jiankai Sun Hanguang Li Zehua Wang 287 27 0 06 Oct 2022
Representing Marginalized Populations: Challenges in Anthropographics Priya Dhawka H. He Jarin Thundathil 209 2 0 06 Oct 2022
From plane crashes to algorithmic harm: applicability of safety engineering frameworks for responsible MLInternational Conference on Human Factors in Computing Systems (CHI), 2022 Shalaleh Rismani Renee Shelby A. Smart Edgar W. Jatho Joshua A. Kroll AJung Moon Negar Rostamzadeh 200 48 0 06 Oct 2022
Metadata Archaeology: Unearthing Data Subsets by Leveraging Training DynamicsInternational Conference on Learning Representations (ICLR), 2022 Shoaib Ahmed Siddiqui Nitarshan Rajkumar Tegan Maharaj David M. Krueger Sara Hooker 254 33 0 20 Sep 2022
What-is and How-to for Fairness in Machine Learning: A Survey, Reflection, and PerspectiveACM Computing Surveys (ACM CSUR), 2022 Zeyu Tang Jiji Zhang Kun Zhang FaML 378 35 0 08 Jun 2022
Regulating Facial Processing Technologies: Tensions Between Legal and Technical Considerations in the Application of Illinois BIPAConference on Fairness, Accountability and Transparency (FAccT), 2022 Rui-Jie Yew Alice X. Xiang 146 13 0 15 May 2022
Exploring How Machine Learning Practitioners (Try To) Use Fairness ToolkitsConference on Fairness, Accountability and Transparency (FAccT), 2022 Wesley Hanwen Deng Manish Nagireddy M. S. Lee Jatinder Singh Zhiwei Steven Wu Kenneth Holstein Haiyi Zhu 193 112 0 13 May 2022
Evaluation Gaps in Machine Learning PracticeConference on Fairness, Accountability and Transparency (FAccT), 2022 Ben Hutchinson Negar Rostamzadeh Christina Greer Katherine A. Heller Vinodkumar Prabhakaran ELM 271 74 0 11 May 2022
Subverting Fair Image Search with Generative Adversarial PerturbationsConference on Fairness, Accountability and Transparency (FAccT), 2022 A. Ghosh Matthew Jagielski Chris L. Wilson 291 8 0 05 May 2022
Demographic-Reliant Algorithmic Fairness: Characterizing the Risks of Demographic Data Collection in the Pursuit of FairnessConference on Fairness, Accountability and Transparency (FAccT), 2022 Mckane Andrus Sarah Villeneuve FaML 244 56 0 18 Apr 2022
Model Positionality and Computational Reflexivity: Promoting Reflexivity in Data ScienceInternational Conference on Human Factors in Computing Systems (CHI), 2022 S. Cambo Darren Gergle 140 48 0 08 Mar 2022
Language technology practitioners as language managers: arbitrating data bias and predictive bias in ASRInternational Conference on Language Resources and Evaluation (LREC), 2022 Nina Markl S. McNulty 158 14 0 25 Feb 2022
Fair ranking: a critical review, challenges, and future directionsConference on Fairness, Accountability and Transparency (FAccT), 2022 Gourab K. Patro Lorenzo Porcaro Laura Mitchell Qiuyue Zhang Meike Zehlike Nikhil Garg 216 65 0 29 Jan 2022
Assessing the Fairness of AI Systems: AI Practitioners' Processes, Challenges, and Needs for Support Michael A. Madaio Lisa Egede Hariharan Subramonyam Jennifer Wortman Vaughan Hanna M. Wallach 270 171 0 10 Dec 2021
Causal-BALD: Deep Bayesian Active Learning of Outcomes to Infer Treatment-Effects from Observational DataNeural Information Processing Systems (NeurIPS), 2021 Andrew Jesson P. Tigas Joost R. van Amersfoort Andreas Kirsch Uri Shalit Y. Gal CML 276 37 0 03 Nov 2021
Measuring Fairness Under Unawareness of Sensitive Attributes: A Quantification-Based Approach Alessandro Fabris Andrea Esuli Alejandro Moreo Fabrizio Sebastiani 328 25 0 17 Sep 2021