Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2011.02282
Cited By
v1
v2 (latest)
"What We Can't Measure, We Can't Understand": Challenges to Demographic Data Procurement in the Pursuit of Fairness
Conference on Fairness, Accountability and Transparency (FAccT), 2020
30 October 2020
Mckane Andrus
Elena Spitzer
Jeffrey Brown
Alice Xiang
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
""What We Can't Measure, We Can't Understand": Challenges to Demographic Data Procurement in the Pursuit of Fairness"
50 / 59 papers shown
Near-Exponential Savings for Mean Estimation with Active Learning
Julian M. Morimoto
Jacob Goldin
Daniel E. Ho
72
0
0
07 Nov 2025
Demographic-Agnostic Fairness without Harm
Zhongteng Cai
Mohammad Mahdi Khalili
Xueru Zhang
121
0
0
28 Sep 2025
Beyond Internal Data: Bounding and Estimating Fairness from Incomplete Data
Varsha Ramineni
Hossein A. Rahmani
Emine Yilmaz
David Barber
125
0
0
18 Aug 2025
Beyond Internal Data: Constructing Complete Datasets for Fairness Testing
Varsha Ramineni
Hossein A. Rahmani
Emine Yilmaz
David Barber
139
0
0
24 Jul 2025
Fairness-in-the-Workflow: How Machine Learning Practitioners at Big Tech Companies Approach Fairness in Recommender Systems
Jing Nathan Yan
Emma Harvey
Junxiong Wang
Jeffrey M. Rzeszotarski
Allison Koenecke
FaML
304
0
0
26 May 2025
Talking About the Assumption in the Room
International Conference on Human Factors in Computing Systems (CHI), 2025
Ramaravind Kommiya Mothilal
Faisal M. Lalani
Syed Ishtiaque Ahmed
Shion Guha
Sharifa Sultana
286
2
0
20 Feb 2025
Auditing a Dutch Public Sector Risk Profiling Algorithm Using an Unsupervised Bias Detection Tool
Floris Holstege
Mackenzie Jorgensen
Kirtan Padh
Jurriaan Parie
Joel Persson
Krsto Prorokovic
Lukas Snoek
392
1
0
03 Feb 2025
Accurate and Data-Efficient Toxicity Prediction when Annotators Disagree
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2024
Harbani Jaggi
Kashyap Murali
Eve Fleisig
Erdem Bıyık
153
3
0
16 Oct 2024
Minimum Viable Ethics: From Institutionalizing Industry AI Governance to Product Impact
Archana Ahlawat
Amy Winecoff
Jonathan Mayer
220
1
0
11 Sep 2024
Position: Measure Dataset Diversity, Don't Just Claim It
Dora Zhao
Jerone T. A. Andrews
Orestis Papakyriakopoulos
Alice Xiang
275
31
0
11 Jul 2024
FairJob: A Real-World Dataset for Fairness in Online Systems
Mariia Vladimirova
Federico Pavone
Eustache Diemert
320
6
0
03 Jul 2024
A Taxonomy of Challenges to Curating Fair Datasets
Dora Zhao
M. Scheuerman
Pooja Chitre
Jerone T. A. Andrews
Georgia Panagiotidou
Shawn Walker
Kathleen H. Pine
Alice Xiang
277
4
0
10 Jun 2024
Addressing Discretization-Induced Bias in Demographic Prediction
Evan Dong
Aaron Schein
Yixin Wang
Nikhil Garg
219
6
0
27 May 2024
Interpretability Needs a New Paradigm
Andreas Madsen
Himabindu Lakkaraju
Siva Reddy
Sarath Chandar
201
7
0
08 May 2024
Lazy Data Practices Harm Fairness Research
Jan Simson
Alessandro Fabris
Christoph Kern
198
10
0
26 Apr 2024
Fairness Without Harm: An Influence-Guided Active Sampling Approach
Jinlong Pang
Jialu Wang
Zhaowei Zhu
Yuanshun Yao
Chen Qian
Yang Liu
TDI
264
8
0
20 Feb 2024
AboutMe: Using Self-Descriptions in Webpages to Document the Effects of English Pretraining Data Filters
Annual Meeting of the Association for Computational Linguistics (ACL), 2024
L. Lucy
Suchin Gururangan
Luca Soldaini
Emma Strubell
David Bamman
Lauren Klein
Jesse Dodge
346
18
0
12 Jan 2024
Modeling subjectivity (by Mimicking Annotator Annotation) in toxic comment identification across diverse communities
Senjuti Dutta
Sid Mittal
Sherol Chen
Deepak Ramachandran
Ravi Rajakumar
Ian D Kivlichan
Sunny Mak
Alena Butryna
Praveen Paritosh University of Tennessee
276
8
0
01 Nov 2023
"One-Size-Fits-All"? Examining Expectations around What Constitute "Fair" or "Good" NLG System Behaviors
North American Chapter of the Association for Computational Linguistics (NAACL), 2023
Li Lucy
Su Lin Blodgett
Milad Shokouhi
Hanna M. Wallach
Alexandra Olteanu
302
12
0
23 Oct 2023
Estimating and Implementing Conventional Fairness Metrics With Probabilistic Protected Features
Hadi Elzayn
Emily Black
Patrick Vossler
Nathanael Jo
Jacob Goldin
Daniel E. Ho
142
7
0
02 Oct 2023
Beyond Skin Tone: A Multidimensional Measure of Apparent Skin Color
IEEE International Conference on Computer Vision (ICCV), 2023
William Thong
Przemyslaw K. Joniak
Alice Xiang
284
26
0
10 Sep 2023
TIDE: Textual Identity Detection for Evaluating and Augmenting Classification and Language Models
Emmanuel Klu
Sameer Sethi
190
0
0
07 Sep 2023
When Fair Classification Meets Noisy Protected Attributes
AAAI/ACM Conference on AI, Ethics, and Society (AIES), 2023
Avijit Ghosh
Pablo Kvitca
Chris L. Wilson
FaML
172
10
0
06 Jul 2023
Evaluating the Social Impact of Generative AI Systems in Systems and Society
Irene Solaiman
Zeerak Talat
William Agnew
Lama Ahmad
Dylan K. Baker
...
Marie-Therese Png
Shubham Singh
A. Strait
Lukas Struppek
Arjun Subramonian
ELM
EGVM
481
147
0
09 Jun 2023
Disentangling and Operationalizing AI Fairness at LinkedIn
Conference on Fairness, Accountability and Transparency (FAccT), 2023
Joaquin Quiñonero Candela
Yuwen Wu
Brian Hsu
Sakshi Jain
Jennifer Ramos
Jon Adams
R. Hallman
Kinjal Basu
220
11
0
30 May 2023
A View From Somewhere: Human-Centric Face Representations
International Conference on Learning Representations (ICLR), 2023
Jerone T. A. Andrews
Przemyslaw K. Joniak
Alice Xiang
CVBM
176
11
0
30 Mar 2023
Can Workers Meaningfully Consent to Workplace Wellbeing Technologies?
Conference on Fairness, Accountability and Transparency (FAccT), 2023
Shreyans Chowdhary
Anna Kawakami
Mary L. Gray
J. Suh
Alexandra Olteanu
Koustuv Saha
250
42
0
13 Mar 2023
Overwriting Pretrained Bias with Finetuning Data
IEEE International Conference on Computer Vision (ICCV), 2023
Angelina Wang
Olga Russakovsky
315
46
0
10 Mar 2023
Multi-dimensional discrimination in Law and Machine Learning -- A comparative overview
Conference on Fairness, Accountability and Transparency (FAccT), 2023
Arjun Roy
J. Horstmann
Eirini Ntoutsi
FaML
165
27
0
12 Feb 2023
Ethical Considerations for Responsible Data Curation
Neural Information Processing Systems (NeurIPS), 2023
Jerone T. A. Andrews
Dora Zhao
William Thong
Apostolos Modas
Orestis Papakyriakopoulos
Alice Xiang
418
30
0
07 Feb 2023
An Operational Perspective to Fairness Interventions: Where and How to Intervene
Brian Hsu
Xiaotong Chen
Ying Han
Hongseok Namkoong
Kinjal Basu
305
2
0
03 Feb 2023
Simplicity Bias Leads to Amplified Performance Disparities
Conference on Fairness, Accountability and Transparency (FAccT), 2022
Samuel J. Bell
Levent Sagun
214
13
0
13 Dec 2022
Fair Ranking with Noisy Protected Attributes
Neural Information Processing Systems (NeurIPS), 2022
Anay Mehrotra
Nisheeth K. Vishnoi
245
22
0
30 Nov 2022
A Keyword Based Approach to Understanding the Overpenalization of Marginalized Groups by English Marginal Abuse Models on Twitter
Kyra Yee
Alice Schoenauer Sebag
Olivia Redfield
Emily Sheng
Matthias Eck
Luca Belli
149
3
0
07 Oct 2022
Weak Proxies are Sufficient and Preferable for Fairness with Missing Sensitive Attributes
International Conference on Machine Learning (ICML), 2022
Zhaowei Zhu
Yuanshun Yao
Jiankai Sun
Hanguang Li
Zehua Wang
303
27
0
06 Oct 2022
Representing Marginalized Populations: Challenges in Anthropographics
Priya Dhawka
H. He
Jarin Thundathil
222
2
0
06 Oct 2022
From plane crashes to algorithmic harm: applicability of safety engineering frameworks for responsible ML
International Conference on Human Factors in Computing Systems (CHI), 2022
Shalaleh Rismani
Renee Shelby
A. Smart
Edgar W. Jatho
Joshua A. Kroll
AJung Moon
Negar Rostamzadeh
230
50
0
06 Oct 2022
Metadata Archaeology: Unearthing Data Subsets by Leveraging Training Dynamics
International Conference on Learning Representations (ICLR), 2022
Shoaib Ahmed Siddiqui
Nitarshan Rajkumar
Tegan Maharaj
David M. Krueger
Sara Hooker
255
33
0
20 Sep 2022
What-is and How-to for Fairness in Machine Learning: A Survey, Reflection, and Perspective
ACM Computing Surveys (ACM CSUR), 2022
Zeyu Tang
Jiji Zhang
Kun Zhang
FaML
412
35
0
08 Jun 2022
Regulating Facial Processing Technologies: Tensions Between Legal and Technical Considerations in the Application of Illinois BIPA
Conference on Fairness, Accountability and Transparency (FAccT), 2022
Rui-Jie Yew
Alice X. Xiang
154
13
0
15 May 2022
Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkits
Conference on Fairness, Accountability and Transparency (FAccT), 2022
Wesley Hanwen Deng
Manish Nagireddy
M. S. Lee
Jatinder Singh
Zhiwei Steven Wu
Kenneth Holstein
Haiyi Zhu
195
112
0
13 May 2022
Evaluation Gaps in Machine Learning Practice
Conference on Fairness, Accountability and Transparency (FAccT), 2022
Ben Hutchinson
Negar Rostamzadeh
Christina Greer
Katherine A. Heller
Vinodkumar Prabhakaran
ELM
280
74
0
11 May 2022
Subverting Fair Image Search with Generative Adversarial Perturbations
Conference on Fairness, Accountability and Transparency (FAccT), 2022
A. Ghosh
Matthew Jagielski
Chris L. Wilson
334
8
0
05 May 2022
Demographic-Reliant Algorithmic Fairness: Characterizing the Risks of Demographic Data Collection in the Pursuit of Fairness
Conference on Fairness, Accountability and Transparency (FAccT), 2022
Mckane Andrus
Sarah Villeneuve
FaML
248
56
0
18 Apr 2022
Model Positionality and Computational Reflexivity: Promoting Reflexivity in Data Science
International Conference on Human Factors in Computing Systems (CHI), 2022
S. Cambo
Darren Gergle
141
48
0
08 Mar 2022
Language technology practitioners as language managers: arbitrating data bias and predictive bias in ASR
International Conference on Language Resources and Evaluation (LREC), 2022
Nina Markl
S. McNulty
159
14
0
25 Feb 2022
Fair ranking: a critical review, challenges, and future directions
Conference on Fairness, Accountability and Transparency (FAccT), 2022
Gourab K. Patro
Lorenzo Porcaro
Laura Mitchell
Qiuyue Zhang
Meike Zehlike
Nikhil Garg
224
66
0
29 Jan 2022
Assessing the Fairness of AI Systems: AI Practitioners' Processes, Challenges, and Needs for Support
Michael A. Madaio
Lisa Egede
Hariharan Subramonyam
Jennifer Wortman Vaughan
Hanna M. Wallach
273
171
0
10 Dec 2021
Causal-BALD: Deep Bayesian Active Learning of Outcomes to Infer Treatment-Effects from Observational Data
Neural Information Processing Systems (NeurIPS), 2021
Andrew Jesson
P. Tigas
Joost R. van Amersfoort
Andreas Kirsch
Uri Shalit
Y. Gal
CML
298
37
0
03 Nov 2021
Measuring Fairness Under Unawareness of Sensitive Attributes: A Quantification-Based Approach
Alessandro Fabris
Andrea Esuli
Alejandro Moreo
Fabrizio Sebastiani
349
25
0
17 Sep 2021
1
2
Next
