The Fallacy of AI Functionality

20 June 2022

Inioluwa Deborah Raji

Indra Elizabeth Kumar

Aaron Horowitz

Andrew D. Selbst

ArXiv PDF HTML

Papers citing "The Fallacy of AI Functionality"

50 / 63 papers shown

Title
One Bad NOFO? AI Governance in Federal Grantmaking Dan Bateyko Karen Levy 21 0 0 13 May 2025
In-House Evaluation Is Not Enough: Towards Robust Third-Party Flaw Disclosure for General-Purpose AI Shayne Longpre Kevin Klyman Ruth E. Appel Sayash Kapoor Rishi Bommasani ... Victoria Westerhoff Yacine Jernite Rumman Chowdhury Percy Liang Arvind Narayanan ELM 40 0 0 21 Mar 2025
Toward an Evaluation Science for Generative AI Systems Laura Weidinger Deb Raji Hanna M. Wallach Margaret Mitchell Angelina Wang Olawale Salaudeen Rishi Bommasani Sayash Kapoor Deep Ganguli Sanmi Koyejo EGVM ELM 65 4 0 07 Mar 2025
AI Mismatches: Identifying Potential Algorithmic Harms Before AI Development Devansh Saxena Ji-Youn Jung J. Forlizzi Kenneth Holstein J. Zimmerman 61 0 0 25 Feb 2025
Authenticated Delegation and Authorized AI Agents Tobin South Samuele Marro Thomas Hardjono Robert Mahari Cedric Deslandes Whitney Dazza Greenwood Alan Chan Alex Pentland 44 3 0 17 Jan 2025
Lessons From Red Teaming 100 Generative AI Products Blake Bullwinkel Amanda Minnich Shiven Chawla Gary Lopez Martin Pouliot ... Pete Bryan Ram Shankar Siva Kumar Yonatan Zunger Chang Kawaguchi Mark Russinovich AAML VLM 37 4 0 13 Jan 2025
Can Artificial Intelligence Embody Moral Values? T. Swoboda Lode Lauwaert 22 0 0 22 Aug 2024
Auditing of AI: Legal, Ethical and Technical Approaches Jakob Mokander 44 37 0 07 Jul 2024
A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms Gavin Abercrombie Djalel Benbouzid Paolo Giudici Delaram Golpayegani Julio Hernandez ... Ushnish Sengupta Arthit Suriyawongful Ruby Thelot Sofia Vei Laura Waltersdorfer 39 7 0 01 Jul 2024
Leveraging Ontologies to Document Bias in Data Mayra Russo Maria-Esther Vidal 33 1 0 29 Jun 2024
Data Debiasing with Datamodels (D3M): Improving Subgroup Robustness via Data Selection Saachi Jain Kimia Hamidieh Kristian Georgiev Andrew Ilyas Marzyeh Ghassemi Aleksander Madry 35 2 0 24 Jun 2024
IDs for AI Systems Alan Chan Noam Kolt Peter Wills Usman Anwar Christian Schroeder de Witt Nitarshan Rajkumar Lewis Hammond David M. Krueger Lennart Heim Markus Anderljung 41 6 0 17 Jun 2024
Ollabench: Evaluating LLMs' Reasoning for Human-centric Interdependent Cybersecurity Tam n. Nguyen ELM 39 2 0 11 Jun 2024
Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools Varun Magesh Faiz Surani Matthew Dahl Mirac Suzgun Christopher D. Manning Daniel E. Ho HILM ELM AILaw 27 66 0 30 May 2024
Lessons from the Trenches on Reproducible Evaluation of Language Models Stella Biderman Hailey Schoelkopf Lintang Sutawika Leo Gao J. Tow ... Xiangru Tang Kevin A. Wang Genta Indra Winata Franccois Yvon Andy Zou ELM ALM 130 53 3 23 May 2024
Unraveling overoptimism and publication bias in ML-driven science Pouria Saidi Gautam Dasarathy Visar Berisha 25 2 0 23 May 2024
Studying Up Public Sector AI: How Networks of Power Relations Shape Agency Decisions Around AI Design and Use Anna Kawakami Amanda Coston Hoda Heidari Kenneth Holstein Haiyi Zhu 44 8 0 21 May 2024
What is it for a Machine Learning Model to Have a Capability? Jacqueline Harding Nathaniel Sharadin ELM 31 3 0 14 May 2024
The Fall of an Algorithm: Characterizing the Dynamics Toward Abandonment Nari Johnson Sanika Moharana Christina Harrington Nazanin Andalibi Hoda Heidari Motahhare Eslami 26 7 0 21 Apr 2024
From Model Performance to Claim: How a Change of Focus in Machine Learning Replicability Can Help Bridge the Responsibility Gap Tianqi Kou 32 0 0 19 Apr 2024
The Necessity of AI Audit Standards Boards David Manheim Sammy Martin Mark Bailey Mikhail Samin Ross Greutzmacher 28 7 0 11 Apr 2024
The Situate AI Guidebook: Co-Designing a Toolkit to Support Multi-Stakeholder Early-stage Deliberations Around Public Sector AI Proposals Anna Kawakami Amanda Coston Haiyi Zhu Hoda Heidari Kenneth Holstein 36 23 0 29 Feb 2024
Beyond Predictive Algorithms in Child Welfare Erin Moon Devansh Saxena Tegan Maharaj Shion Guha 38 2 0 26 Feb 2024
Sketching AI Concepts with Capabilities and Examples: AI Innovation in the Intensive Care Unit Nur Yildirim Susanna Zlotnikov Deniz Sayar Jeremy M. Kahn L. Bukowski ... Venkatesh Sivaraman Adam Perer Sarah Preum James McCann John Zimmerman 31 14 0 21 Feb 2024
Towards Equitable Agile Research and Development of AI and Robotics Andrew Hundt Julia Schuller Severin Kacianka 17 0 0 13 Feb 2024
Are We Asking the Right Questions?: Designing for Community Stakeholders' Interactions with AI in Policing Md. Romael Haque Devansh Saxena Katherine Weathington Joseph Chudzik Shion Guha 33 9 0 08 Feb 2024
A Scoping Study of Evaluation Practices for Responsible AI Tools: Steps Towards Effectiveness Evaluations G. Berman Nitesh Goyal Michael A. Madaio ELM 34 20 0 30 Jan 2024
Not My Voice! A Taxonomy of Ethical and Safety Harms of Speech Generators Wiebke Hutiri Orestis Papakyriakopoulos Alice Xiang 21 16 0 25 Jan 2024
Information That Matters: Exploring Information Needs of People Affected by Algorithmic Decisions Timothée Schmude Laura M. Koesten Torsten Moller Sebastian Tschiatschek 23 3 0 24 Jan 2024
A Human-Centered Review of Algorithms in Homelessness Research Erin Moon Shion Guha 21 7 0 24 Jan 2024
Visibility into AI Agents Alan Chan Carson Ezell Max Kaufmann K. Wei Lewis Hammond ... Nitarshan Rajkumar David M. Krueger Noam Kolt Lennart Heim Markus Anderljung 15 31 0 23 Jan 2024
Diffusion Models for Generative Artificial Intelligence: An Introduction for Applied Mathematicians Catherine F. Higham Des J. Higham P. Grindrod DiffM VLM 21 3 0 21 Dec 2023
Evaluating and Mitigating Discrimination in Language Model Decisions Alex Tamkin Amanda Askell Liane Lovitt Esin Durmus Nicholas Joseph Shauna Kravec Karina Nguyen Jared Kaplan Deep Ganguli 36 66 0 06 Dec 2023
Responsible AI Research Needs Impact Statements Too Alexandra Olteanu Michael Ekstrand Carlos Castillo Jina Suh 33 7 0 20 Nov 2023
"One-Size-Fits-All"? Examining Expectations around What Constitute "Fair" or "Good" NLG System Behaviors Li Lucy Su Lin Blodgett Milad Shokouhi Hanna M. Wallach Alexandra Olteanu 31 7 0 23 Oct 2023
An International Consortium for Evaluations of Societal-Scale Risks from Advanced AI Ross Gruetzemacher Alan Chan Kevin Frazier Christy Manning Stepán Los ... Clíodhna Ní Ghuidhir Mark M. Bailey Daniel Eth Toby D. Pilditch Kyle A. Kilian 24 5 0 22 Oct 2023
Deepfakes, Phrenology, Surveillance, and More! A Taxonomy of AI Privacy Risks Hao-Ping Lee Yu-Ju Yang Thomas Serban Von Davier J. Forlizzi Sauvik Das 26 53 0 11 Oct 2023
The AI Incident Database as an Educational Tool to Raise Awareness of AI Harms: A Classroom Exploration of Efficacy, Limitations, & Future Improvements Michael Feffer Nikolas Martelaro Hoda Heidari 29 14 0 10 Oct 2023
Toward Operationalizing Pipeline-aware ML Fairness: A Research Agenda for Developing Practical Guidelines and Tools Maximilian Schambach Rakshit Naidu Rayid Ghani Kit T. Rodolfa Daniel E. Ho Hoda Heidari FaML 35 14 0 29 Sep 2023
REFORMS: Reporting Standards for Machine Learning Based Science Sayash Kapoor Emily F. Cantrell Kenny Peng Thanh Hien Pham C. Bail ... Matthew J. Salganik Marta Serra-Garcia Brandon M Stewart Gilles Vandewiele Arvind Narayanan 8 19 0 15 Aug 2023
Algorithmic Harms in Child Welfare: Uncertainties in Practice, Organization, and Street-level Decision-Making Devansh Saxena Shion Guha 22 19 0 09 Aug 2023
VisAlign: Dataset for Measuring the Degree of Alignment between AI and Humans in Visual Perception Jiyoung Lee Seung Wook Kim Seunghyun Won Joonseok Lee Marzyeh Ghassemi James Thorne Jaeseok Choi O.-Kil Kwon E. Choi 18 1 0 03 Aug 2023
Beneficent Intelligence: A Capability Approach to Modeling Benefit, Assistance, and Associated Moral Failures through AI Systems A. London Hoda Heidari 9 12 0 01 Aug 2023
AHA!: Facilitating AI Impact Assessment by Generating Examples of Harms Zana Buçinca Chau Minh Pham Maurice Jakesch Marco Tulio Ribeiro Alexandra Olteanu Saleema Amershi 25 35 0 05 Jun 2023
Model evaluation for extreme risks Toby Shevlane Sebastian Farquhar Ben Garfinkel Mary Phuong Jess Whittlestone ... Vijay Bolina Jack Clark Yoshua Bengio Paul Christiano Allan Dafoe ELM 26 151 0 24 May 2023
Deep Learning and Ethics Travis LaCroix Simon J. D. Prince FaML 24 0 0 24 May 2023
Data AUDIT: Identifying Attribute Utility- and Detectability-Induced Bias in Task Models Michael F. Pavlak Nathan G. Drenkow N. Petrick M. M. Farhangi Mathias Unberath MLAU 27 4 0 06 Apr 2023
Recentering Validity Considerations through Early-Stage Deliberations Around AI and Policy Design Anna Kawakami Amanda Coston Haiyi Zhu Hoda Heidari Kenneth Holstein 26 1 0 26 Mar 2023
A multidomain relational framework to guide institutional AI research and adoption Vince J. Straub Deborah Morgan Youmna Hashem John Francis Saba Esnaashari Jonathan Bright 18 8 0 17 Mar 2023
Can Workers Meaningfully Consent to Workplace Wellbeing Technologies? Shreyans Chowdhary Anna Kawakami Mary L. Gray J. Suh Alexandra Olteanu Koustuv Saha 36 30 0 13 Mar 2023