Extreme-scale computing services over MPI: Experiences, observations and features proposal for next-generation message passing interface. (November 2014)

• Record Type: Journal Article
• Authors: Zounmevo, Judicael A; Kimpe, Dries; Ross, Robert; Afsahi, Ahmad
• Is Part Of: International journal of high performance computing applications. Volume 28:Number 4(2014:Winter)
• Page Start: 435
• Page End: 449
• Publication Date: 2014-11
• Subjects: Message passing interface (MPI) -- distributed services -- storage -- fault-tolerance -- cancellation; High performance computing -- Periodicals; Supercomputers -- Periodicals; 004.1105
• DOI: 10.1177/1094342014548864
• Languages: English
• ISSNs: 1094-3420

Abstract

The message passing interface (MPI) is one of the most portable high-performance computing (HPC) programming models, with platform-optimized implementations typically delivered with new HPC systems. Therefore, for distributed services requiring portable, high-performance, user-level network access, MPI promises to be an attractive alternative to custom network portability layers, platform-specific methods, or portable but less performant interfaces such as BSD sockets. In this paper, we present our experiences in using MPI as a network transport for a large-scale distributed storage system. We discuss the features of MPI that facilitate adoption as well as aspects which require various workarounds. Based on use cases, we derive a wish list for both MPI implementations and the MPI forum to facilitate the adoption of MPI by large-scale persistent services. The proposals in the wish list go beyond the sole needs of distributed services; we contend that they will benefit mainstream HPC applications at extreme scales as well.