v1v2 (latest)
UNITYAI-GUARD: Pioneering Toxicity Detection Across Low-Resource Indian Languages
Main:4 Pages
7 Figures
Bibliography:3 Pages
5 Tables
Appendix:2 Pages
Abstract
This work introduces UnityAI-Guard, a framework for binary toxicity classification targeting low-resource Indian languages. While existing systems predominantly cater to high-resource languages, UnityAI-Guard addresses this critical gap by developing state-of-the-art models for identifying toxic content across diverse Brahmic/Indic scripts. Our approach achieves an impressive average F1-score of 84.23% across seven languages, leveraging a dataset of 567k training instances and 30k manually verified test instances. By advancing multilingual content moderation for linguistically diverse regions, UnityAI-Guard also provides public API access to foster broader adoption and application.
View on arXivComments on this paper
