HOTTEST: Hate and Offensive content identification in Tamil using Transformers and Enhanced STemming. (March 2023)

• Record Type: Journal Article
• Authors: Rajalakshmi, Ratnavel; Selvaraj, Srivarshan; R., Faerie Mattins; Vasudevan, Pavitra; M., Anand Kumar
• Is Part Of: Computer speech & language. Volume 78(2023)
• Publication Date: 2023-03
• Subjects: Offensive content identification in Tamil -- Hate Speech in Tamil YouTube comments -- Stop word removal and enhanced stemming for Tamil text -- Tamil text data pre-processing -- Deep learning -- MuRIL -- Transformers for Tamil; Speech processing systems -- Periodicals; Automatic speech recognition -- Periodicals; Computers -- Periodicals; Linguistics -- Periodicals; Speech-Language Pathology -- Periodicals; Traitement automatique de la parole -- Périodiques; Reconnaissance automatique de la parole -- Périodiques; Automatic speech recognition; Speech processing systems; Electronic journals; Periodicals; 006.454
• DOI: 10.1016/j.csl.2022.101464
• Languages: English
• ISSNs: 0885-2308

Abstract

Abstract: Offensive content or hate speech is defined as any form of communication that aims to annoy, harass, disturb, or anger an individual or community based on factors such as faith, ethnicity, appearance, or sexuality. Nowadays, offensive content posted in regional languages increased due to the popularity of social networks and other apps usage by common people. This work proposes a method to detect and identify hate speech or offensive content in Tamil. We have used the HASOC 2021 data set that contains YouTube comments in Tamil language and written in Tamil script. In this research work, an attempt is made to find suitable embedding techniques for Tamil text representation by applying TF-IDF and pre-trained transformer models like BERT, XLM-RoBERTa, IndicBERT, mBERT, TaMillion, and MuRIL. As Tamil is a morphologically rich language, a detailed analysis is made to study the performance of hate speech detection in Tamil by applying enhanced stemming algorithms. An extensive experimental study was performed with different classifiers such as logistic regression, SVM, stochastic Gradient Descent, decision tree, and ensemble learning models in combination with the above techniques. The results of this detailed experimental study show that stop word removal produces mixed results and does not guarantee improvement in the performance of the classifier to detect offensive content for Tamil data. However, the performance on stemmed data shows a significant improvement over un-stemmed data in Tamil texts. As the data is highly imbalanced, we also combined an oversampling/downsampling technique to analyze its role in designing the best offensive classifier for Tamil text. The highest performance was achieved by a combination of stemming the text data, embedding it with the multi-lingual model MuRIL and using a majority voting ensemble as the downstream classifier. We have achieved the F 1 -score of 84% and accuracy of 86% for detecting offensive content in Tamil YouTube comments. Highlights: Effective pre-processing and text embedding to represent Tamil YouTube comments Enhanced stemming algorithm to handle the challenges in Tamil language data Detailed analysis to study the impact of Tamil stop words in Tamil text representation Extensive evaluation with machine learning and transformers on benchmark Tamil data Performance analysis with ensemble approach to identify offensive contents in Tamil