177

Analyzing values about gendered language reform in LLMs' revisions

Main:7 Pages
2 Figures
Bibliography:4 Pages
12 Tables
Appendix:4 Pages
Abstract

Within the common LLM use case of text revision, we study LLMs' revision of gendered role nouns (e.g., outdoorsperson/woman/man) and their justifications of such revisions. We evaluate their alignment with feminist and trans-inclusive language reforms for English. Drawing on insight from sociolinguistics, we further assess if LLMs are sensitive to the same contextual effects in the application of such reforms as people are, finding broad evidence of such effects. We discuss implications for value alignment.

View on arXiv
Comments on this paper