Content extraction from news web pages using tag tree. (2018)

• Record Type: Journal Article
• Authors: Arya, Chandrakala; Dwivedi, Sanjay K.
• Is Part Of: International journal of autonomic computing. Volume 3:Number 1(2018)
• Page Start: 34
• Page End: 51
• Publication Date: 2018
• Subjects: content extraction -- tag tree -- news web page -- information extraction -- pattern matching; Autonomic computing -- Periodicals; Computer science -- Periodicals; 004.05
• Languages: English
• ISSNs: 1741-8569

Abstract

As the web endures to develop, there is an enormous amount of information which is typically designed for its users, which makes it difficult to extract relevant data from numerous sources. In this paper, we propose an approach for extracting the main content from news web pages. Our approach is based on the concept of tokenisation of HTML page, these tokens construct the tag tree; web pages from different websites are parsed into Tag tree and generated a template from each web pages and discover matching patterns and multiple sequence alignment. It finds and removed shared token sequences from the web pages until the relevant information is extracted from them. We perform experiments on 500 web pages from ten different news websites. Experimental results show that our approach efficiently extracts the relevant information.