On the trade‐off of mixing scientific applications on capacity high‐performance computing systems. Issue 2 (1st March 2013)

• Record Type: Journal Article
• Authors: Jokanovic, Ana; Carlos Sancho, Jose; Rodriguez, German; Minkenberg, Cyriel; Beivide, Ramon; Labarta, Jesus
• Is Part Of: IET computers & digital techniques. Volume 7:Issue 2(2013)
• Page Start: 81
• Page End: 92
• Publication Date: 2013-03-01
• Subjects: natural sciences computing -- parallel processing -- pattern classification -- resource allocation; scientific applications -- capacity high‐performance computing systems -- interapplication network contention -- blocking networks -- system schedulers -- job allocation -- job fragmentation -- network resource sharing -- application performance variability -- topology connectivity -- application classification -- task allocation policy -- insensitive application -- first level switch -- sensitive application isolation; Computers -- Periodicals; Digital electronics -- Periodicals; Computer engineering -- Periodicals; Computer architecture -- Periodicals; Computer organization -- Periodicals; 621.39
• DOI: 10.1049/iet-cdt.2012.0059
• Languages: English
• ISSNs: 1751-8601

Abstract

Abstract : Network contention is seen as a major hurdle to achieve higher throughput in today's large‐scale high‐performance computing systems. Even more so with the current trend of employing blocking networks driven by the need of reducing cost. Additionally, the effect is aggravated by current system schedulers that allocate jobs as soon as nodes become available, thus producing job fragmentation, that is, the tasks of one job might be spread throughout the system instead of being allocated contiguously. This fragmentation increases the probability of sharing network resources with other applications, which produces higher inter‐application network contention. In this study, the authors perform a broad analysis of diverse applications' performance variability because of the topology connectivity and fragmentation and a classification of applications based on their sensitiveness to these two factors. Once they understood the inherent characteristics of applications, the authors analysed the applications performance in a shared environment, that is, when mixing with other applications. They show that inter‐application contention might be a significant factor of degradation even in the networks with high connectivity. Their results suggest different strategies on task allocation policies: grouping sensitive and insensitive applications, reducing the number of applications sharing the first level switch or isolation of sensitive applications.