Breaking news detection from the web documents through text mining and seasonality. (2016)

• Record Type: Journal Article
• Authors: Jishan, Syed Tanveer; Monsur, Md. Nuruddin; Rahman, Hafiz Abdur
• Is Part Of: International journal of knowledge and web intelligence. Volume 5:Number 3(2016)
• Page Start: 190
• Page End: 207
• Publication Date: 2016
• Subjects: information extraction -- web mining -- data cleaning -- time series analysis -- Brill tagger -- breaking news -- news detection -- web documents -- text mining -- seasonality -- data mining -- news distribution -- online news sources -- HTML tags -- keywords -- keyword extraction -- online newspapers; Information retrieval -- Periodicals; Web site development -- Periodicals; Internet programming -- Periodicals; 004.67805
• Languages: English
• ISSNs: 1755-8255

Abstract

In recent years, news distribution through the internet has increased significantly and so does our growing dependency on online news sources. As vast numbers of web documents from different news websites are readily available, it is possible to extract information that can be used for various applications. One possible application is breaking news detection through text and property analysis of these web documents. In this paper, we presented an approach to detect breaking news from web documents by using keywords extraction through Brill's tagger and HTML tag attributes. Once the keywords are extracted, seasonality for each of the keywords are calculated by the ratio of the linear weighted moving averages (LWMA) at each point of the time series. Our approach has been validated and performance metrics have been evaluated with two online newspapers.