Grid-aware approach to data statistics, data understanding and data preprocessing. (8th June 2009)

• Record Type: Journal Article
• Authors: Wohrer, Alexander; Novakova, Lenka; Brezany, Peter; Tjoa, A. Min
• Is Part Of: International journal of high performance computing and networking. Volume 6:Number 1(2009)
• Page Start: 15
• Page End: 24
• Publication Date: 2009-06-08
• Subjects: data preprocessing -- grid computing -- data statistics -- database access; High performance computing -- Periodicals; Computer networks -- Periodicals; High performance computing; Periodicals; 004.05
• Languages: English
• ISSNs: 1740-0562

Abstract

In recent years the focus of grid computing shifted towards more data intensive applications, increasingly needing access to various public and private databases. Relocating the code for Data Preprocessing (DPP) closer towards the data source is the overall task of the D³Gframework. This paper presents the data service side architecture to gather Data Statistics (DS) on-the-fly, use them in remote DPP methods on query results and gather exact continuous DS for whole tables inside a database. The performance results are showing low running costs for the continuous DS and the feasibility of the service side DPP functionality.