Finding and classifying web units in websites. (9th December 2005)

• Record Type: Journal Article
• Authors: Sun, Aixin; Lim, Ee-Peng
• Is Part Of: International journal of business intelligence and data mining. Volume 1:Number 2(2005)
• Page Start: 161
• Page End: 193
• Publication Date: 2005-12-09
• Subjects: web units -- web unit mining -- web classification -- web pages -- websites -- internet -- data mining -- world wide web; 006.312
• Languages: English
• ISSNs: 1743-8187

Abstract

In web classification, most researchers assume that the objects to be classified are individual web pages from one or more websites. In practice, the assumption is too restrictive since a web page itself may not carry sufficient information for it to be treated as an instance of some semantic class or concept. In this paper, we relax this assumption and allow a subgraph of web pages to represent an instance of the semantic concept. Such a subgraph of web pages is known as a web unit. To construct and classify web units, we formulate the web unit mining problem and propose an iterative web unit mining (iWUM) method. The iWUM method first finds subgraphs of web pages using knowledge about website structure and connectivity among the web pages. From these web subgraphs, web units are constructed and classified into categories in an iterative manner. Our experiments using the WebKB dataset showed that iWUM was able to construct web units and classify web units with high accuracy for the more structured parts of a website.