Delta extraction in a limited collaborative environment. (2015)

• Record Type: Journal Article
• Authors: Lu, Zheng; Liu, Haijun; Yan, Jun
• Is Part Of: International journal of intelligent information and database systems. Volume 9:Number 1(2015)
• Page Start: 54
• Page End: 78
• Publication Date: 2015
• Subjects: delta extraction -- data integration -- data synchronisation -- snapshot differential algorithms -- limited collaboration -- collaborative environments -- database management systems -- DBMS -- relational tables -- data warehouses -- remote data -- optimisation; Database management -- Computer programs -- Periodicals; Information retrieval -- Computer programs -- Periodicals; Information storage and retrieval systems -- Computer programs -- Periodicals; Artificial intelligence -- Periodicals; Expert systems (Computer science) -- Periodicals; Intelligent agents (Computer software) -- Periodicals; 006.33
• Languages: English
• ISSNs: 1751-5858

Abstract

This work considers extracting delta in a distributed environment where the collaboration from highly autonomous operational database management systems is limited to granting read only access on a set of selected relational tables. In addition, due to possibly large volumes of remote source data involved, and consequently enormous overhead associated with data transfer, efficiency issues must been taken into consideration. This research is based on the observation that usually, there is a large amount of static data in relational tables. It is proposed to use some statistical techniques in data warehouse system to help us understand the essential characteristics of remote data. Based on the characteristics of remote data, some optimisation techniques are presented.