Maintaining data integrity in cloud systems through version management. (17th June 2020)

• Record Type: Journal Article
• Authors: Yeh, Tsozen; Wang, Yipin; Tu, Yiming
• Is Part Of: International journal of ad hoc and ubiquitous computing. Volume 34:Number 2(2020)
• Page Start: 63
• Page End: 73
• Publication Date: 2020-06-17
• Subjects: big data -- data integrity -- cloud computing -- Hadoop -- Hadoop Distributed File System -- HDFS; Ubiquitous computing -- Periodicals; Embedded computer systems -- Periodicals; Electronic data processing -- Distributed processing -- Periodicals; Wireless communication systems -- Periodicals; Computer architecture -- Periodicals; 004.2
• Languages: English
• ISSNs: 1743-8225

Abstract

As the era of the big data arrives, the enormous amount of data collected has far exceeded what traditional computer systems can appropriately handle and process. Accordingly, cloud computing has been largely used to facilitate the processing of big data. Often individual data files contain data inserted at different time, which means they have chronological versions of contents since their creation. Hadoop is one of the most popular cloud systems used nowadays. Unfortunately, it does not support efficient schemes to conduct version management for files. Previously, we improved Hadoop by realising autonomous snapshot and extra duplication for files covered in snapshots. In this paper, we report our efforts to design and implement version management for files in snapshots. With the help of autonomous snapshot and extra file duplication, version management can further maintain data integrity for important files contained in snapshots.