Re-contextualizing Fairness in NLP: The Case of India

25 September 2022

Vinodkumar Prabhakaran

ArXiv PDF HTML

Papers citing "Re-contextualizing Fairness in NLP: The Case of India"

38 / 38 papers shown

Title
Fairness through Difference Awareness: Measuring Desired Group Discrimination in LLMs Angelina Wang Michelle Phan Daniel E. Ho Sanmi Koyejo 54 2 0 04 Feb 2025
Ethics Whitepaper: Whitepaper on Ethical Research into Large Language Models Eddie L. Ungless Nikolas Vitsakis Zeerak Talat James Garforth Bjorn Ross Arno Onken Atoosa Kasirzadeh Alexandra Birch 33 1 0 17 Oct 2024
With a Grain of SALT: Are LLMs Fair Across Social Dimensions? Samee Arif Zohaib Khan Agha Ali Raza Awais Athar 27 0 0 16 Oct 2024
Controllable Safety Alignment: Inference-Time Adaptation to Diverse Safety Requirements Jingyu Zhang Ahmed Elgohary Ahmed Magooda Daniel Khashabi Benjamin Van Durme 138 2 0 11 Oct 2024
GIEBench: Towards Holistic Evaluation of Group Identity-based Empathy for Large Language Models Leyan Wang Yonggang Jin Tianhao Shen Tianyu Zheng Xinrun Du ... Jiaheng Liu Shi Wang Ge Zhang Liuyu Xiang Zhaofeng He VLM AI4MH 36 0 0 21 Jun 2024
Extrinsic Evaluation of Cultural Competence in Large Language Models Shaily Bhatt Fernando Diaz ELM EGVM 47 4 0 17 Jun 2024
Ethical Reasoning and Moral Value Alignment of LLMs Depend on the Language we Prompt them in Utkarsh Agarwal Kumar Tanmay Aditi Khandelwal Monojit Choudhury LRM 31 7 0 29 Apr 2024
GeniL: A Multilingual Dataset on Generalizing Language Aida Mostafazadeh Davani S. Gubbi Sunipa Dev Shachi Dave Vinodkumar Prabhakaran 35 1 0 08 Apr 2024
SafetyPrompts: a Systematic Review of Open Datasets for Evaluating and Improving Large Language Model Safety Paul Röttger Fabio Pernisi Bertie Vidgen Dirk Hovy ELM KELM 58 31 0 08 Apr 2024
IndiBias: A Benchmark Dataset to Measure Social Biases in Language Models for Indian Context Nihar Ranjan Sahoo Pranamya Prashant Kulkarni Narjis Asad Arif Ahmad Tanu Goyal Aparna Garimella Pushpak Bhattacharyya 36 8 0 29 Mar 2024
ChatGPT Rates Natural Language Explanation Quality Like Humans: But on Which Scales? Fan Huang Haewoon Kwak Kunwoo Park Jisun An ALM ELM AI4MH 40 12 0 26 Mar 2024
SeeGULL Multilingual: a Dataset of Geo-Culturally Situated Stereotypes Mukul Bhutani Kevin Robinson Vinodkumar Prabhakaran Shachi Dave Sunipa Dev 44 11 0 08 Mar 2024
InSaAF: Incorporating Safety through Accuracy and Fairness \| Are LLMs ready for the Indian Legal Domain? Yogesh Tripathi Raghav Donakanti Sahil Girhepuje Ishan Kavathekar Bhaskara Hanuma Vedula Gokul S Krishnan Shreya Goyal Anmol Goel Balaraman Ravindran Ponnurangam Kumaraguru ALM AILaw ELM 19 1 0 16 Feb 2024
A Scoping Study of Evaluation Practices for Responsible AI Tools: Steps Towards Effectiveness Evaluations G. Berman Nitesh Goyal Michael A. Madaio ELM 45 20 0 30 Jan 2024
Tackling Bias in Pre-trained Language Models: Current Trends and Under-represented Societies Vithya Yogarajan Gillian Dobbie Te Taka Keegan R. Neuwirth ALM 43 11 0 03 Dec 2023
AART: AI-Assisted Red-Teaming with Diverse Data Generation for New LLM-powered Applications Bhaktipriya Radharapu Kevin Robinson Lora Aroyo Preethi Lahoti 18 37 0 14 Nov 2023
Global Voices, Local Biases: Socio-Cultural Prejudices across Languages A. Mukherjee Chahat Raj Ziwei Zhu Antonios Anastasopoulos 29 15 0 26 Oct 2023
Bias and Fairness in Large Language Models: A Survey Isabel O. Gallegos Ryan A. Rossi Joe Barrow Md Mehrab Tanjim Sungchul Kim Franck Dernoncourt Tong Yu Ruiyi Zhang Nesreen Ahmed AILaw 26 490 0 02 Sep 2023
Building Socio-culturally Inclusive Stereotype Resources with Community Engagement Sunipa Dev J. Goyal Dinesh Tewari Shachi Dave Vinodkumar Prabhakaran 27 22 0 20 Jul 2023
Llama 2: Open Foundation and Fine-Tuned Chat Models Hugo Touvron Louis Martin Kevin R. Stone Peter Albert Amjad Almahairi ... Sharan Narang Aurelien Rodriguez Robert Stojnic Sergey Edunov Thomas Scialom AI4MH ALM 108 11,007 0 18 Jul 2023
On Evaluating and Mitigating Gender Biases in Multilingual Settings Aniket Vashishtha Kabir Ahuja Sunayana Sitaram 21 23 0 04 Jul 2023
Sociodemographic Bias in Language Models: A Survey and Forward Path Vipul Gupta Pranav Narayanan Venkit Shomir Wilson R. Passonneau 42 20 0 13 Jun 2023
Having Beer after Prayer? Measuring Cultural Bias in Large Language Models Tarek Naous Michael Joseph Ryan Alan Ritter Wei-ping Xu 37 85 0 23 May 2023
This Prompt is Measuring <MASK>: Evaluating Bias Evaluation in Language Models Seraphina Goldfarb-Tarrant Eddie L. Ungless Esma Balkir Su Lin Blodgett 37 9 0 22 May 2023
SeeGULL: A Stereotype Benchmark with Broad Geo-Cultural Coverage Leveraging Generative Models Akshita Jha Aida Mostafazadeh Davani Chandan K. Reddy Shachi Dave Vinodkumar Prabhakaran Sunipa Dev 26 40 0 19 May 2023
PaLM 2 Technical Report Rohan Anil Andrew M. Dai Orhan Firat Melvin Johnson Dmitry Lepikhin ... Ce Zheng Wei Zhou Denny Zhou Slav Petrov Yonghui Wu ReLM LRM 110 1,148 0 17 May 2023
Globalizing Fairness Attributes in Machine Learning: A Case Study on Health in Africa M. Asiedu Awa Dieng Abigail Oppong Margaret Nagawa Sanmi Koyejo Katherine A. Heller 54 7 0 05 Apr 2023
Fairness in Language Models Beyond English: Gaps and Challenges Krithika Ramesh Sunayana Sitaram Monojit Choudhury 32 23 0 24 Feb 2023
Hyper-parameter Tuning for Fair Classification without Sensitive Attribute Access A. Veldanda Ivan Brugere Sanghamitra Dutta Alan Mishler S. Garg 39 5 0 02 Feb 2023
Cultural Re-contextualization of Fairness Research in Language Technologies in India Shaily Bhatt Sunipa Dev Partha P. Talukdar Shachi Dave Vinodkumar Prabhakaran 37 3 0 21 Nov 2022
Scaling Instruction-Finetuned Language Models Hyung Won Chung Le Hou Shayne Longpre Barret Zoph Yi Tay ... Jacob Devlin Adam Roberts Denny Zhou Quoc V. Le Jason W. Wei ReLM LRM 64 2,989 0 20 Oct 2022
The Tail Wagging the Dog: Dataset Construction Biases of Social Bias Benchmarks Nikil Selvam Sunipa Dev Daniel Khashabi Tushar Khot Kai-Wei Chang ALM 24 25 0 18 Oct 2022
Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reduction Renee Shelby Shalaleh Rismani Kathryn Henne AJung Moon Negar Rostamzadeh ... N'Mah Yilla-Akbari Jess Gallegos A. Smart Emilio Garcia Gurleen Virk 36 188 0 11 Oct 2022
Multilingual CheckList: Generation and Evaluation Karthikeyan K Shaily Bhatt Pankaj Singh Somak Aditya Sandipan Dandapat Sunayana Sitaram Monojit Choudhary ELM 19 1 0 24 Mar 2022
Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Text Sebastian Gehrmann Elizabeth Clark Thibault Sellam ELM AI4CE 69 183 0 14 Feb 2022
Whose Language Counts as High Quality? Measuring Language Ideologies in Text Data Selection Suchin Gururangan Dallas Card Sarah K. Drier E. K. Gade Leroy Z. Wang Zeyu Wang Luke Zettlemoyer Noah A. Smith 175 73 0 25 Jan 2022
Socially Aware Bias Measurements for Hindi Language Representations Vijit Malik Sunipa Dev A. Nishi Nanyun Peng Kai-Wei Chang 69 37 0 15 Oct 2021
Learning to Recognize Dialect Features Dorottya Demszky D. Sharma J. Clark Vinodkumar Prabhakaran Jacob Eisenstein 114 38 0 23 Oct 2020