Multilingual HateCheck: Functional Tests for Multilingual Hate Speech
Detection Models

Multilingual HateCheck: Functional Tests for Multilingual Hate Speech Detection Models

20 June 2022

Paul Röttger

Haitham Seelawi

Papers citing "Multilingual HateCheck: Functional Tests for Multilingual Hate Speech Detection Models"

10 / 10 papers shown

Title
Can Prompting LLMs Unlock Hate Speech Detection across Languages? A Zero-shot and Few-shot Study Faeze Ghorbanpour Daryna Dementieva Alexander M. Fraser 38 0 0 09 May 2025
DefVerify: Do Hate Speech Models Reflect Their Dataset's Definition? Urja Khurana Eric T. Nalisnick Antske Fokkens 44 1 0 21 Oct 2024
AustroTox: A Dataset for Target-Based Austrian German Offensive Language Detection Pia Pachinger Janis Goldzycher A. Planitzer Wojciech Kusa Allan Hanbury Julia Neidhardt 42 2 0 12 Jun 2024
XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models Paul Röttger Hannah Rose Kirk Bertie Vidgen Giuseppe Attanasio Federico Bianchi Dirk Hovy ALM ELM AILaw 21 122 0 02 Aug 2023
Sociocultural knowledge is needed for selection of shots in hate speech detection tasks Antonis Maronikolakis Abdullatif Köksal Hinrich Schütze 28 0 0 04 Apr 2023
Automated Sentiment and Hate Speech Analysis of Facebook Data by Employing Multilingual Transformer Models Ritumbra Manuvie Saikat Chatterjee 13 2 0 31 Jan 2023
CoRAL: a Context-aware Croatian Abusive Language Dataset Ravi Shekhar Mladen Karan Matthew Purver 30 5 0 11 Nov 2022
Data-Efficient Strategies for Expanding Hate Speech Detection into Under-Resourced Languages Paul Röttger Debora Nozza Federico Bianchi Dirk Hovy 18 10 0 20 Oct 2022
Hatemoji: A Test Suite and Adversarially-Generated Dataset for Benchmarking and Detecting Emoji-based Hate Hannah Rose Kirk B. Vidgen Paul Röttger Tristan Thrush Scott A. Hale 65 57 0 12 Aug 2021
Are We Modeling the Task or the Annotator? An Investigation of Annotator Bias in Natural Language Understanding Datasets Mor Geva Yoav Goldberg Jonathan Berant 237 319 0 21 Aug 2019