A Comparative Study of Some Automatic Arabic Text Diacritization Systems. (16th August 2022)

• Record Type: Journal Article
• Authors: Mijlad, Ali; El Younoussi, Yacine
• Other Names: Barreto Armando Bennet Academic Editor.
• Is Part Of: Advances in human-computer interaction. Volume 2022(2022)
• Publication Date: 2022-08-16
• Subjects: Human-computer interaction -- Periodicals; Human-computer interaction; Periodicals; Electronic journals; 004.019
• DOI: 10.1155/2022/3613710
• Languages: English
• ISSNs: 1687-5893

Abstract

Abstract : Arabic diacritization is the task of restoring diacritics or vowels for Arabic texts considering that they are mostly written without them. This task, when automated, shows better results for some natural language processing tasks; hence, it is necessary for the field of Arabic language processing. In this paper, we are going to present a comparative study of some automatic diacritization systems. One uses a variant of the hidden Markov model. The other one is a pipeline, which includes a Long Short-Term Memory deep learning model, a rule-based correction component, and a statistical-based component. Additionally, we are proposing some modifications to those systems. We have trained and tested those systems in the same benchmark dataset based on the same evaluation metrics proposed in previous work. The best system results are 9.42% and 22.82% for the diacritic error rate DER and the word error rate WER, respectively.