Model‐based MPI‐IO tuning with Periscope tuning framework. (14th August 2015)

• Record Type: Journal Article
• Authors: Liu, Weifeng; Gerndt, Michael; Gong, Bin
• Is Part Of: Concurrency and computation. Volume 28:Number 1(2016)
• Page Start: 3
• Page End: 20
• Publication Date: 2015-08-14
• Subjects: parallel I/O -- automatic tuning -- MPI‐IO -- performance model -- high‐performance computing; Parallel processing (Electronic computers) -- Periodicals; Parallel computers -- Periodicals; 004.35
• DOI: 10.1002/cpe.3603
• Languages: English
• ISSNs: 1532-0626

Abstract

Summary: For many parallel applications, I/O performance is a major bottleneck. MPI‐IO, defined by the MPI forum, can help parallel applications overcome the performance and portability limitations of existing parallel I/O interfaces. Although autotuning has been used to improve the performance of computing kernels, MPI‐IO autotuning has rarely been studied. To automate MPI‐IO performance tuning, we designed and implemented an automatic tuner. The tuner relies on the Periscope tuning framework for transparently passing hints to the MPI‐IO library and for automatically collecting performance data. Unlike computational code, each MPI‐IO function takes a relatively long time to complete. Thus, exhaustively searching through the entire parameter space is impractical. So we developed a performance model that can direct us to shorten the tuning time. Copyright © 2015 John Wiley & Sons, Ltd.