An efficient approach for mining web content sensitivity. (20th August 2009)

• Record Type: Journal Article
• Authors: Wang, Cheng; Liu, Ying; Jian, Liheng; Zhang, Peng
• Is Part Of: International journal of knowledge and web intelligence. Volume 1:Number 1/2(2009)
• Page Start: 95
• Page End: 109
• Publication Date: 2009-08-20
• Subjects: utility mining -- web content mining -- public opinion monitoring -- web content sensitivity -- two-phase algorithm -- internet -- sensitive web pages -- internet -- sensitivity keywords; Information retrieval -- Periodicals; Web site development -- Periodicals; Internet programming -- Periodicals; 004.67805
• Languages: English
• ISSNs: 1755-8255

Abstract

Abnormal remarks on the web, such as violence, threat, superstition, etc., may disturb the social order and public morality (referred as sensitive content). To provide a quantitative measure of the sensitivity of a webpage, we propose the concept of web content sensitivity which measures how sensitive a page is. We also propose a web content sensitivity mining approach. Our experiment identified a number of sensitive webpages that traditional frequency-based methods failed to find. By varying the sensitive values of the keywords, different sets of high sensitivity keywords were discovered as well as the corresponding webpages.