Introducing extreme data storage middleware of schema-free document stores using MapReduce. (2015)

• Record Type: Journal Article
• Authors: Ma, Kun; Yang, Bo
• Is Part Of: International journal of ad hoc and ubiquitous computing. Volume 20:Number 4(2015)
• Page Start: 274
• Page End: 284
• Publication Date: 2015
• Subjects: extreme data storage -- historical data -- CDC -- change data capture -- MapReduce -- NoSQL -- lifecycle tag -- data warehousing -- data redundancy -- data warehouse middleware -- schema-free document stores; Ubiquitous computing -- Periodicals; Embedded computer systems -- Periodicals; Electronic data processing -- Distributed processing -- Periodicals; Wireless communication systems -- Periodicals; Computer architecture -- Periodicals; 004.2
• Languages: English
• ISSNs: 1743-8225

Abstract

Data warehousing has been embraced by organisations of all sizes. However, there are few publications on data warehouse of NoSQL. In this paper, an extreme data storage middleware (EDSM) of schema-free document stores using MapReduce is presented to address the issue of formulating no redundant data warehouse with small amount of storage space for the purpose of their composition in a way that utilises the MapReduce framework. The experiment is shown to successfully build the NoSQL data warehouse reducing data redundancy compared with document with timestamp and lifecycle tag solutions. Our experiment also provides insight into some of the key challenges and shortcomings that researchers and engineers face when designing the data warehouse middleware.