"Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference Letters

13 October 2023

Papers citing ""Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference Letters"

50 / 101 papers shown

Title
Decoding Biases: Automated Methods and LLM Judges for Gender Bias Detection in Language Models Shachi H. Kumar Saurav Sahay Sahisnu Mazumder Eda Okur R. Manuvinakurike Nicole Beckage Hsuan Su Hung-yi Lee L. Nachman ELM 24 15 0 07 Aug 2024
Blockchain for Large Language Model Security and Safety: A Holistic Survey Caleb Geren Amanda Board Gaby G. Dagher Tim Andersen Jun Zhuang 44 5 0 26 Jul 2024
Fairness Definitions in Language Models Explained Thang Viet Doan Zhibo Chu Zichong Wang Wenbin Zhang ALM 50 10 0 26 Jul 2024
Perceptions of Linguistic Uncertainty by Language Models and Humans Catarina G Belém Markelle Kelly M. Steyvers Sameer Singh Padhraic Smyth 33 3 0 22 Jul 2024
No Size Fits All: The Perils and Pitfalls of Leveraging LLMs Vary with Company Size Ashok Urlana Charaka Vinayak Kumar B. Garlapati Ajeet Kumar Singh Rahul Mishra 33 1 0 21 Jul 2024
Representation Bias in Political Sample Simulations with Large Language Models Weihong Qi Hanjia Lyu Jiebo Luo 31 5 0 16 Jul 2024
Social and Ethical Risks Posed by General-Purpose LLMs for Settling Newcomers in Canada I. Nejadgholi Maryam Molamohammadi Samir Bakhtawar 43 0 0 15 Jul 2024
On LLM Wizards: Identifying Large Language Models' Behaviors for Wizard of Oz Experiments Jingchao Fang Nikos Aréchiga Keiichi Namaoshi N. Bravo Candice L Hogan David A. Shamma 20 3 0 10 Jul 2024
Listen and Speak Fairly: A Study on Semantic Gender Bias in Speech Integrated Large Language Models Yi-Cheng Lin T. Lin Chih-Kai Yang Ke-Han Lu Wei-Chih Chen Chun-Yi Kuan Hung-yi Lee 29 1 0 09 Jul 2024
When LLMs Play the Telephone Game: Cumulative Changes and Attractors in Iterated Cultural Transmissions Jérémy Perez Corentin Léger Grgur Kovač Cédric Colas Gaia Molinaro Maxime Derex Pierre-Yves Oudeyer Clément Moulin-Frier 38 5 0 05 Jul 2024
Breaking Bias, Building Bridges: Evaluation and Mitigation of Social Biases in LLMs via Contact Hypothesis Chahat Raj A. Mukherjee Aylin Caliskan Antonios Anastasopoulos Ziwei Zhu 30 8 0 02 Jul 2024
GenderAlign: An Alignment Dataset for Mitigating Gender Bias in Large Language Models Tao Zhang Ziqian Zeng Yuxiang Xiao Huiping Zhuang Cen Chen James R. Foulds Shimei Pan CVBM 41 3 0 20 Jun 2024
"You Gotta be a Doctor, Lin": An Investigation of Name-Based Bias of Large Language Models in Employment Recommendations H. Nghiem John J. Prindle Jieyu Zhao Hal Daumé III 30 11 0 18 Jun 2024
RUPBench: Benchmarking Reasoning Under Perturbations for Robustness Evaluation in Large Language Models Yuqing Wang Yun Zhao LRM AAML ELM 27 1 0 16 Jun 2024
Do Large Language Models Discriminate in Hiring Decisions on the Basis of Race, Ethnicity, and Gender? Haozhe An Christabel Acquaye Colin Wang Zongxia Li Rachel Rudinger 36 12 0 15 Jun 2024
Underneath the Numbers: Quantitative and Qualitative Gender Fairness in LLMs for Depression Prediction Micol Spitale Jiaee Cheong Hatice Gunes 29 3 0 12 Jun 2024
Ask LLMs Directly, "What shapes your bias?": Measuring Social Bias in Large Language Models Jisu Shin Hoyun Song Huije Lee Soyeong Jeong Jong C. Park 28 6 0 06 Jun 2024
Chaos with Keywords: Exposing Large Language Models Sycophantic Hallucination to Misleading Keywords and Evaluating Defense Strategies Aswin Rrv Nemika Tyagi Md Nayem Uddin Neeraj Varshney Chitta Baral 32 0 0 06 Jun 2024
Are AI-Generated Text Detectors Robust to Adversarial Perturbations? Guanhua Huang Yuchen Zhang Zhe Li Yongjian You Mingze Wang Zhouwang Yang DeLMO 40 3 0 03 Jun 2024
Subtle Biases Need Subtler Measures: Dual Metrics for Evaluating Representative and Affinity Bias in Large Language Models Abhishek Kumar Sarfaroz Yunusov Ali Emami 25 3 0 23 May 2024
Navigating LLM Ethics: Advancements, Challenges, and Future Directions Junfeng Jiao S. Afroogh Yiming Xu Connor Phillips AILaw 58 19 0 14 May 2024
Concerns on Bias in Large Language Models when Creating Synthetic Personae Helena A. Haxvig SyDa 21 1 0 08 May 2024
BiasKG: Adversarial Knowledge Graphs to Induce Bias in Large Language Models Chunyan Luo Ahmad Ghawanmeh Xiaodan Zhu Faiza Khan Khattak KELM 31 0 0 08 May 2024
Hire Me or Not? Examining Language Model's Behavior with Occupation Attributes Damin Zhang Yi Zhang Geetanjali Bihani Julia Taylor Rayz 46 2 0 06 May 2024
Identifying Fairness Issues in Automatically Generated Testing Content Kevin Stowe Benny Longwill Alyssa Francis Tatsuya Aoyama Debanjan Ghosh Swapna Somasundaran 22 1 0 23 Apr 2024
White Men Lead, Black Women Help? Benchmarking Language Agency Social Biases in LLMs Yixin Wan Kai-Wei Chang 27 3 0 16 Apr 2024
The Impact of Unstated Norms in Bias Analysis of Language Models Farnaz Kohankhaki D. B. Emerson David B. Emerson Laleh Seyyed-Kalantari Faiza Khan Khattak 50 1 0 04 Apr 2024
Towards detecting unanticipated bias in Large Language Models Anna Kruspe 28 3 0 03 Apr 2024
Fairness in Large Language Models: A Taxonomic Survey Zhibo Chu Zichong Wang Wenbin Zhang AILaw 41 31 0 31 Mar 2024
Evaluating LLMs for Gender Disparities in Notable Persons L. Rhue Sofie Goethals Arun Sundararajan 26 4 0 14 Mar 2024
Angry Men, Sad Women: Large Language Models Reflect Gendered Stereotypes in Emotion Attribution Flor Miriam Plaza del Arco A. C. Curry Alba Curry Gavin Abercrombie Dirk Hovy 16 23 0 05 Mar 2024
Gender Bias in Large Language Models across Multiple Languages Jinman Zhao Yitian Ding Chen Jia Yining Wang Zifan Qian 24 24 0 01 Mar 2024
Mysterious Projections: Multimodal LLMs Gain Domain-Specific Visual Capabilities Without Richer Cross-Modal Projections Gaurav Verma Minje Choi Kartik Sharma J. Watson-Daniels Sejoon Oh Srijan Kumar MLLM VLM 27 8 0 26 Feb 2024
Unintended Impacts of LLM Alignment on Global Representation Michael Joseph Ryan William B. Held Diyi Yang 35 39 0 22 Feb 2024
LLMs with Industrial Lens: Deciphering the Challenges and Prospects -- A Survey Ashok Urlana Charaka Vinayak Kumar Ajeet Kumar Singh B. Garlapati S. Chalamala Rahul Mishra 35 5 0 22 Feb 2024
What's in a Name? Auditing Large Language Models for Race and Gender Bias Amit Haim Alejandro Salinas Julian Nyarko 30 31 0 21 Feb 2024
Bias in Language Models: Beyond Trick Tests and Toward RUTEd Evaluation Kristian Lum Jacy Reese Anthis Chirag Nagpal Alex DÁmour Alexander D’Amour 29 13 0 20 Feb 2024
Evolving AI Collectives to Enhance Human Diversity and Enable Self-Regulation Shiyang Lai Yujin Potter Junsol Kim Richard Zhuang Dawn Song James Evans 48 3 0 19 Feb 2024
Search Engines Post-ChatGPT: How Generative Artificial Intelligence Could Make Search Less Reliable Shahan Ali Memon Jevin D. West 24 4 0 18 Feb 2024
I Am Not Them: Fluid Identities and Persistent Out-group Bias in Large Language Models Wenchao Dong Assem Zhunis Hyojin Chin Jiyoung Han Meeyoung Cha 13 2 0 16 Feb 2024
Measuring machine learning harms from stereotypes: requires understanding who is being harmed by which errors in what ways Angelina Wang Xuechunzi Bai Solon Barocas Su Lin Blodgett FaML 33 5 0 06 Feb 2024
Measuring Implicit Bias in Explicitly Unbiased Large Language Models Xuechunzi Bai Angelina Wang Ilia Sucholutsky Thomas L. Griffiths 100 27 0 06 Feb 2024
SemScore: Automated Evaluation of Instruction-Tuned LLMs based on Semantic Textual Similarity Ansar Aynetdinov Alan Akbik ALM 34 3 0 30 Jan 2024
Prompting open-source and commercial language models for grammatical error correction of English learner text Christopher Davis Andrew Caines Oistein Andersen Shiva Taslimipoor H. Yannakoudakis Zheng Yuan Christopher Bryant Marek Rei P. Buttery 27 13 0 15 Jan 2024
In Generative AI we Trust: Can Chatbots Effectively Verify Political Information? Elizaveta Kuznetsova M. Makhortykh Victoria Vziatysheva Martha Stolze Ani Baghumyan Aleksandra Urman 17 2 0 20 Dec 2023
A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Ugly Yifan Yao Jinhao Duan Kaidi Xu Yuanfang Cai Eric Sun Yue Zhang PILM ELM 24 463 0 04 Dec 2023
The Role of Inclusion, Control, and Ownership in Workplace AI-Mediated Communication Kowe Kadoma Marianne Aubin Le Quere Jenny Fu Christin Munsch D. Metaxa Mor Naaman 12 11 0 20 Sep 2023
Having Beer after Prayer? Measuring Cultural Bias in Large Language Models Tarek Naous Michael Joseph Ryan Alan Ritter Wei-ping Xu 24 82 0 23 May 2023
Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Models Oana Ignat Zhijing Jin Artem Abzaliev Laura Biester Santiago Castro ... Verónica Pérez-Rosas Siqi Shen Zekun Wang Winston Wu Rada Mihalcea LRM 24 6 0 21 May 2023
The Factual Inconsistency Problem in Abstractive Text Summarization: A Survey Yi-Chong Huang Xiachong Feng Xiaocheng Feng Bing Qin HILM 128 104 0 30 Apr 2021