DAME: Runtime-compilation for data movement. (September 2018)

• Record Type: Journal Article
• Authors: Prabhu, Tarun; Gropp, William
• Other Names: Bland Wesley guest-editor.; Erez Mattan guest-editor.; Hidalgo J Ignacio guest-editor.; Fernández de Vega Francisco guest-editor.; Mercier Guillaume guest-editor.
• Is Part Of: International journal of high performance computing applications. Volume 32:Number 5(2018)
• Page Start: 760
• Page End: 774
• Publication Date: 2018-09
• Subjects: MPI -- derived datatypes -- data movement -- Just In Time compilation -- High Performance Computing; High performance computing -- Periodicals; Supercomputers -- Periodicals; 004.1105
• DOI: 10.1177/1094342017695444
• Languages: English
• ISSNs: 1094-3420

Abstract

Modern machines consist of multiple compute devices and complex memory hierarchies. For many applications, it is imperative that any data movement between and within the various compute devices be done as efficiently as possible in order to obtain maximum performance. However, hand-optimizing code for one architecture will likely sacrifice both performance portability and software maintainability. In addition, some optimization decisions are best made at runtime. This suggests that the problem ought to be tackled on two fronts. First, provide the programmer with a declarative language to describe data layouts and data motion. This would allow the runtime system to be tuned for each architecture by a specialist and free the programmer to concentrate on the application itself. Second, exploit the execution time information to optimize the data movement code further. MPI derived datatypes accomplish the former task and Just In Time (JIT) compilation can be used for the latter. In this paper, we present DAME—a language and interpreter designed to be used as the backend for MPI derived datatypes. We also present DAME-L and DAME-X, two JIT-enabled implementations of DAME, all of which have been integrated into MPICH. We evaluate their performance on DDTBench and two mini-applications written with MPI derived datatypes and obtain communication speedups of up to 20× and mini-application speedups of up to 3×.