Transliteration recognition of Tibetan person name based on Tibetan cultural knowledge. (8th May 2020)

• Record Type: Journal Article
• Authors: Wang, Zhijuan; Fang, Wenguang; Zhao, Xiaobing; Song, Wei; Feng, Yinghui; Chang, Yining
• Is Part Of: International journal of computational science and engineering. Volume 22:Number 2/3(2020)
• Page Start: 305
• Page End: 312
• Publication Date: 2020-05-08
• Subjects: transliteration -- Tibetan person name -- Tibetan cultural knowledge -- discrimination -- reliability; Computer science -- Mathematics -- Periodicals; Computer simulation -- Mathematical aspects -- Periodicals; Computational intelligence -- Periodicals; 004.015105
• Languages: English
• ISSNs: 1742-7185

Abstract

Institute of Computing Technology, Chinese Lexical Analysis System (ICTCLAS) is a common tool for Chinese word segmentation and named entity recognition. With this tool, the F1 value of person name recognition from Chinese texts in Tibetan culture is only 40%. We propose a method for transliteration recognition of Tibetan person name based on Tibetan cultural knowledge. Firstly, we leverage Tibetan cultural dictionary to improve the word segmentation performance of ICTCLAS. Then, special contextual features and naming rules of Tibetan person name in their culture are adopted to determine the boundary of Chinese transliteration of Tibetan person name. Finally, the transliteration candidates of Tibetan person name are filtered based on discrimination and reliability. Experiments on a 1.2 M Tibetan text in Tibetan culture show that the method can increase the F1 value of Chinese transliteration recognition of Tibetan person name from 40.08% to 87.92% in ICTCLAS.