A high performance redundancy scheme for cluster file systems. (6th February 2006)

• Record Type: Journal Article
• Authors: Pillai, Manoj; Lauria, Mario
• Is Part Of: International journal of high performance computing and networking. Volume 2:Number 2/3/4(2004)
• Page Start: 90
• Page End: 98
• Publication Date: 2006-02-06
• Subjects: parallel I/O -- fault tolerance -- partial redundancy -- distributed RAID -- cluster file systems; High performance computing -- Periodicals; Computer networks -- Periodicals; High performance computing; Periodicals; 004.05
• Languages: English
• ISSNs: 1740-0562

Abstract

A known issue in the design of striped file systems is their vulnerability to disk failures. In this paper, we address the challenges of augmenting an existing striped file system with traditional RAID redundancy, and propose a novel redundancy scheme designed to maximise disk throughput seen by applications. We implement our new scheme in CSAR, a proof-of-concept redundant file system based on the parallel virtual file system, along with two other well-known schemes. Our tests using both microbenchmarks and representative scientific applications show that our scheme consistently performs as well as the best of the other two schemes. The application-dependent, potentially larger storage occupation of our scheme is justified by current technological trends that put I/O bandwidth at a premium over disk space.