Collecting a Large-Scale Gender Bias Dataset for Coreference Resolution and Machine Translation

8 September 2021

Gabriel Stanovsky

Papers citing "Collecting a Large-Scale Gender Bias Dataset for Coreference Resolution and Machine Translation"

46 / 46 papers shown

Title
Exposing Product Bias in LLM Investment Recommendation Yuhan Zhi Xiaoyu Zhang Longtian Wang Shumin Jiang Shiqing Ma Xiaohong Guan Chao Shen 51 0 0 11 Mar 2025
Implicit Bias in LLMs: A Survey Xinru Lin Luyang Li 47 0 0 04 Mar 2025
Auto-Search and Refinement: An Automated Framework for Gender Bias Mitigation in Large Language Models Yue Xu Chengyan Fu Li Xiong Sibei Yang Wenjie Wang 37 0 0 17 Feb 2025
LangFair: A Python Package for Assessing Bias and Fairness in Large Language Model Use Cases Dylan Bouchard Mohit Singh Chauhan David Skarbrevik Viren Bajaj Zeya Ahmad 23 0 0 06 Jan 2025
Current State-of-the-Art of Bias Detection and Mitigation in Machine Translation for African and European Languages: a Review Catherine Ikae Mascha Kurpicz-Briki 13 0 0 28 Oct 2024
Large Language Models Still Exhibit Bias in Long Text Wonje Jeung Dongjae Jeon Ashkan Yousefpour Jonghyun Choi ALM 19 0 0 23 Oct 2024
Collapsed Language Models Promote Fairness Jingxuan Xu Wuyang Chen Linyi Li Yao Zhao Yunchao Wei 39 0 0 06 Oct 2024
What the Harm? Quantifying the Tangible Impact of Gender Bias in Machine Translation with a Human-centered Study Beatrice Savoldi Sara Papi Matteo Negri Ana Guerberof L. Bentivogli 28 6 0 01 Oct 2024
WinoPron: Revisiting English Winogender Schemas for Consistency, Coverage, and Grammatical Case Vagrant Gautam Julius Steuer Eileen Bingert Ray Johns Anne Lauscher Dietrich Klakow 28 0 0 09 Sep 2024
Mining Path Association Rules in Large Property Graphs (with Appendix) Yuya Sasaki Panagiotis Karras 16 0 0 04 Aug 2024
Fairness in Large Language Models in Three Hours Thang Doan Viet Zichong Wang Minh Nhat Nguyen Wenbin Zhang 25 8 0 02 Aug 2024
The power of Prompts: Evaluating and Mitigating Gender Bias in MT with LLMs Aleix Sant Carlos Escolano Audrey Mash Francesca de Luca Fornaciari Maite Melero 23 4 0 26 Jul 2024
Beyond Binary Gender: Evaluating Gender-Inclusive Machine Translation with Ambiguous Attitude Words Yijie Chen Yijin Liu Fandong Meng Jinan Xu Yufeng Chen Jie Zhou 21 1 0 23 Jul 2024
Social Bias Evaluation for Large Language Models Requires Prompt Variations Rem Hida Masahiro Kaneko Naoaki Okazaki 25 2 0 03 Jul 2024
CEB: Compositional Evaluation Benchmark for Fairness in Large Language Models Song Wang Peng Wang Tong Zhou Yushun Dong Zhen Tan Jundong Li CoGe 36 6 0 02 Jul 2024
Towards Massive Multilingual Holistic Bias Xiaoqing Ellen Tan Prangthip Hansanti Carleigh Wood Bokai Yu C. Ropers Marta R. Costa-jussá 20 1 0 29 Jun 2024
Akal Badi ya Bias: An Exploratory Study of Gender Bias in Hindi Language Technology Rishav Hada Safiya Husain Varun Gumma Harshita Diddee Aditya Yadavalli ... Nidhi Kulkarni U. Gadiraju Aditya Vashistha Vivek Seshadri Kalika Bali 25 1 0 10 May 2024
Are Models Biased on Text without Gender-related Language? Catarina G Belém P. Seshadri Yasaman Razeghi Sameer Singh 25 5 0 01 May 2024
Robust Pronoun Fidelity with English LLMs: Are they Reasoning, Repeating, or Just Biased? Vagrant Gautam Eileen Bingert D. Zhu Anne Lauscher Dietrich Klakow 20 8 0 04 Apr 2024
Fairness in Large Language Models: A Taxonomic Survey Zhibo Chu Zichong Wang Wenbin Zhang AILaw 22 5 0 31 Mar 2024
RuBia: A Russian Language Bias Detection Dataset Veronika Grigoreva Anastasiia Ivanova I. Alimova Ekaterina Artemova 19 1 0 26 Mar 2024
Your Large Language Model is Secretly a Fairness Proponent and You Should Prompt it Like One Tianlin Li Xiaoyu Zhang Chao Du Tianyu Pang Qian Liu Qing-Wu Guo Chao Shen Yang Liu ALM 18 9 0 19 Feb 2024
A Note on Bias to Complete Jia Xu Mona Diab 31 1 0 18 Feb 2024
Fairness-Aware Structured Pruning in Transformers A. Zayed Gonçalo Mordido Samira Shabanian Ioana Baldini Sarath Chandar 14 15 0 24 Dec 2023
Tackling Bias in Pre-trained Language Models: Current Trends and Under-represented Societies Vithya Yogarajan Gillian Dobbie Te Taka Keegan R. Neuwirth ALM 16 11 0 03 Dec 2023
Women Are Beautiful, Men Are Leaders: Gender Stereotypes in Machine Translation and Language Modeling Matúš Pikuliak Andrea Hrckova Stefan Oresko Marián Simko 10 2 0 30 Nov 2023
''Fifty Shades of Bias'': Normative Ratings of Gender Bias in GPT Generated English Text Rishav Hada Agrima Seth Harshita Diddee Kalika Bali 11 13 0 26 Oct 2023
Identifying and Adapting Transformer-Components Responsible for Gender Bias in an English Language Model Abhijith Chintam Rahel Beloch Willem H. Zuidema Michael Hanna Oskar van der Wal 15 16 0 19 Oct 2023
A Tale of Pronouns: Interpretability Informs Gender Bias Mitigation for Fairer Instruction-Tuned Machine Translation Giuseppe Attanasio Flor Miriam Plaza del Arco Debora Nozza Anne Lauscher 11 18 0 18 Oct 2023
Gender-specific Machine Translation with Large Language Models Eduardo Sánchez Pierre Yves Andrews Pontus Stenetorp Mikel Artetxe Marta R. Costa-jussá 17 2 0 06 Sep 2023
Bias and Fairness in Large Language Models: A Survey Isabel O. Gallegos Ryan A. Rossi Joe Barrow Md Mehrab Tanjim Sungchul Kim Franck Dernoncourt Tong Yu Ruiyi Zhang Nesreen Ahmed AILaw 12 205 0 02 Sep 2023
A Survey on Fairness in Large Language Models Yingji Li Mengnan Du Rui Song Xin Wang Ying Wang ALM 14 34 0 20 Aug 2023
VisoGender: A dataset for benchmarking gender bias in image-text pronoun resolution S. Hall F. G. Abrantes Hanwen Zhu Grace A. Sodunke Aleksandar Shtedritski Hannah Rose Kirk CoGe 6 20 0 21 Jun 2023
Good, but not always Fair: An Evaluation of Gender Bias for three commercial Machine Translation Systems Silvia Alma Piazzolla Beatrice Savoldi L. Bentivogli 20 1 0 09 Jun 2023
What about em? How Commercial Machine Translation Fails to Handle (Neo-)Pronouns Anne Lauscher Debora Nozza Archie Crowley E. Miltersen Dirk Hovy 11 12 0 25 May 2023
Comparing Humans and Models on a Similar Scale: Towards Cognitive Gender Bias Evaluation in Coreference Resolution Gili Lior Gabriel Stanovsky 16 4 0 24 May 2023
Multilingual Holistic Bias: Extending Descriptors and Patterns to Unveil Demographic Biases in Languages at Scale Marta R. Costa-jussá Pierre Yves Andrews Eric Michael Smith Prangthip Hansanti C. Ropers Elahe Kalbassi Cynthia Gao Daniel Licht Carleigh Wood 19 10 0 22 May 2023
Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling Stella Biderman Hailey Schoelkopf Quentin G. Anthony Herbie Bradley Kyle O'Brien ... USVSN Sai Prashanth Edward Raff Aviya Skowron Lintang Sutawika Oskar van der Wal 8 780 0 03 Apr 2023
Inseq: An Interpretability Toolkit for Sequence Generation Models Gabriele Sarti Nils Feldhus Ludwig Sickert Oskar van der Wal Malvina Nissim Arianna Bisazza 12 64 0 27 Feb 2023
Evaluating and Improving the Coreference Capabilities of Machine Translation Models Asaf Yehudai Arie Cattan Omri Abend Gabriel Stanovsky LRM ELM 14 2 0 16 Feb 2023
The Tail Wagging the Dog: Dataset Construction Biases of Social Bias Benchmarks Nikil Selvam Sunipa Dev Daniel Khashabi Tushar Khot Kai-Wei Chang ALM 4 21 0 18 Oct 2022
Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Survey Sachin Kumar Vidhisha Balachandran Lucille Njoo Antonios Anastasopoulos Yulia Tsvetkov ELM 52 59 0 14 Oct 2022
LingMess: Linguistically Informed Multi Expert Scorers for Coreference Resolution Shon Otmazgin Arie Cattan Yoav Goldberg LRM 34 25 0 25 May 2022
How sensitive are translation systems to extra contexts? Mitigating gender bias in Neural Machine Translation models through relevant contexts Shanya Sharma Manan Dey Koustuv Sinha 11 9 0 22 May 2022
Under the Morphosyntactic Lens: A Multifaceted Evaluation of Gender Bias in Speech Translation Beatrice Savoldi Marco Gaido L. Bentivogli Matteo Negri Marco Turchi 20 26 0 18 Mar 2022
A Survey on Bias and Fairness in Machine Learning Ninareh Mehrabi Fred Morstatter N. Saxena Kristina Lerman Aram Galstyan SyDa FaML 283 4,143 0 23 Aug 2019