Multilingual author profiling on Facebook. Issue 4 (July 2017)

• Record Type: Journal Article
• Authors: Fatima, Mehwish; Hasan, Komal; Anwar, Saba; Nawab, Rao Muhammad Adeel
• Is Part Of: Information processing & management. Volume 53:Issue 4(2017:Jul.)
• Page Start: 886
• Page End: 904
• Publication Date: 2017-07
• Subjects: Authorship -- Author profiling -- Multilingual corpus -- Facebook -- Roman Urdu -- Stylometry -- N-gram; Information storage and retrieval systems -- Periodicals; Information science -- Periodicals; Systèmes d'information -- Périodiques; Sciences de l'information -- Périodiques; Information science; Information storage and retrieval systems; Periodicals; 658.4038
• DOI: 10.1016/j.ipm.2017.03.005
• Languages: English
• ISSNs: 0306-4573

Abstract

Highlights: Proposed a multilingual (Roman Urdu and English) author profiling corpus of Facebook profiles. Manually developed a bilingual dictionary (Roman Urdu to English) of 7749 entries and translated multilingual corpus using it. Applied 64 stylometry and 11 content based features on multilingual and translated corpora. Best results obtained using word bigram for age and word unigram, character 3 and 8 gram for gender identification. Abstract: Author profiling is the identification of demographic features of an author by examining his written text. Recently, it has attracted the attention of research community due to it's potential applications in forensic, security, marketing, fake profiles identification on online social networking sites, capturing sender of harassing messages etc. We need benchmark corpora to develop and evaluate techniques for author profiling. Majority of the existing corpora are for English and other European languages but not for under–resourced South Asian languages, like Roman Urdu (written using English alphabets). Roman Urdu is used in daily communication by a large number of native speakers of Urdu around the world particularly in Facebook posts/comments, Twitter tweets, blogs, chat blogs and SMS messaging. The construction of sentences of Urdu while using alphabets of English transforms the language properties of the text. We aim to investigate the behavior of existing author profiling techniques for multilingual text consisting of English and Roman Urdu, concretely for gender and age identification. We here focus on author profiling on Facebook by (i) developing a multilingual (Roman Urdu and English) corpus, (ii) manually building of a bilingual dictionary for translating Roman Urdu words into English, (iii) modeling existing state-of-the-art author profiling techniques by using content based features (word and character N–grams) and 64 different stylistic based features (11 lexical word based features, 47 lexical character based features and 6 vocabulary richness measures) for age and gender identification on multilingual and translated corpora, (iv) evaluating and comparing the behavior of above mentioned techniques on multilingual and translated corpora. Our extensive empirical evaluation shows that (i) existing author profiling techniques can be used for multilingual text (Roman Urdu + English) as well as monolingual text (corpus obtained after translating multilingual corpus using bilingual dictionary), (ii) content based methods outperform stylistic based methods for both gender and age identification task and (iii) translation of multilingual corpus to monolingual text does not improve results.