A language-model-based approach for subjectivity detection. (June 2017)

• Record Type: Journal Article
• Authors: Karimi, Samaneh; Shakery, Azadeh
• Is Part Of: Journal of information science. Volume 43:Number 3(2017)
• Page Start: 356
• Page End: 377
• Publication Date: 2017-06
• Subjects: Language model -- opinion mining -- opinion retrieval -- sentiment lexicon -- subjectivity detection; Information science -- Periodicals; Information science; Periodicals; 020.5
• DOI: 10.1177/0165551516641818
• Languages: English
• ISSNs: 0165-5515

Abstract

The rapid growth of opinionated text on the Web increases the demand for efficient methods for detecting subjective texts. In this paper, a subjectivity detection method is proposed which utilizes a language-model-based structure to define a subjectivity score for each document where the topic relevance of documents does not affect the subjectivity scores. In order to overcome the limited content in short documents, we further propose an expansion method to better estimate the language models. Since the lack of linguistic resources in resource-lean languages like Persian makes subjectivity detection difficult in these languages, the method is proposed in two versions: a semi-supervised version for resource-lean languages and a supervised version. Experimental evaluations on five datasets in two languages, English and Persian, demonstrate that the method performs well in distinguishing subjective documents from objective ones in both languages.