Enhancing hybrid parallel file system through performance and space-aware data layout. (November 2016)
- Record Type:
- Journal Article
- Title:
- Enhancing hybrid parallel file system through performance and space-aware data layout. (November 2016)
- Main Title:
- Enhancing hybrid parallel file system through performance and space-aware data layout
- Authors:
- He, Shuibing
Liu, Yan
Wang, Yang
Sun, Xian-He
Huang, Chuanhe - Abstract:
- Hybrid parallel file systems (PFSs), which consist of solid-state drive servers (SServer) and hard disk drive servers (HServer), have recently attracted growing attention. Compared to a traditional HServer, an SServer consistently provides improved storage performance but lacks storage space. However, most current data layout schemes do not consider the differences in performance and space between heterogeneous servers and may significantly degrade the performance of the hybrid PFSs. In this article, we propose performance and space-aware (PSA) scheme, a novel data layout scheme, which maximizes the hybrid PFSs' performance by applying adaptive varied-size file stripes. PSA dispatches data on heterogeneous file servers not only based on storage performance but also storage space. We have implemented PSA within OrangeFS, a popular PFS in the high-performance computing domain. Our extensive experiments with representative benchmarks, including IOR, HPIO, MPI-TILE-IO, and BTIO, show that PSA provides superior I/O throughput than the default and performance-aware file data layout schemes.
- Is Part Of:
- International journal of high performance computing applications. Volume 30:Number 4(2016:Winter)
- Journal:
- International journal of high performance computing applications
- Issue:
- Volume 30:Number 4(2016:Winter)
- Issue Display:
- Volume 30, Issue 4 (2016)
- Year:
- 2016
- Volume:
- 30
- Issue:
- 4
- Issue Sort Value:
- 2016-0030-0004-0000
- Page Start:
- 396
- Page End:
- 410
- Publication Date:
- 2016-11
- Subjects:
- Parallel I/O system -- parallel file system -- data layout -- solid-state drive -- hybrid I/O system
High performance computing -- Periodicals
Supercomputers -- Periodicals
004.1105 - Journal URLs:
- http://hpc.sagepub.com ↗
http://www.uk.sagepub.com/home.nav ↗
http://firstsearch.oclc.org ↗ - DOI:
- 10.1177/1094342016631610 ↗
- Languages:
- English
- ISSNs:
- 1094-3420
- Deposit Type:
- Legaldeposit
- View Content:
- Available online (eLD content is only available in our Reading Rooms) ↗
- Physical Locations:
- British Library DSC - BLDSS-3PM
British Library HMNTS - ELD Digital store - Ingest File:
- 7134.xml