A comparative study of black‐box optimization heuristics for online tuning of high performance computing I/O accelerators. (25th March 2021)

• Record Type: Journal Article
• Authors: Robert, Sophie; Zertal, Soraya; Vaumourin, Grégory; Couvée, Philippe
• Is Part Of: Concurrency and computation. Volume 33:Number 16(2021)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2021-03-25
• Subjects: adaptive computer system -- auto‐tuning -- black‐box optimization -- genetic algorithms -- I/O accelerators -- online tuning -- performance -- simulated annealing -- surrogate models; Parallel processing (Electronic computers) -- Periodicals; Parallel computers -- Periodicals; 004.35
• DOI: 10.1002/cpe.6274
• Languages: English
• ISSNs: 1532-0626

Abstract

Summary: High performance computing (HPC) applications' behaviors rely on highly configurable software environments and hardware devices. Finding their optimal parametrization is a complex task, as the size of their parametric space and the non‐linear behavior of HPC systems make hand‐tuning, theoretical modeling or exhaustive sampling unsuitable in most cases. In this article, we propose an online auto‐tuner that relies on black‐box optimization to find the optimal parametrization of input/output (I/O) accelerators for a given HPC application in a limited number of iterations, without making any assumption on the behavior of the tuned system. As many heuristics are available in the literature, we need to guarantee the quality of the tuning by selecting the most appropriate one. To do so, we provide a comparative study of the efficiency of three heuristics applied to tuning two I/O accelerators developed by the Atos company: a pure software accelerator (small read optimizer) and a mixed hardware‐software one (smart burst buffer). To select the most efficient heuristic for our use case, we define several new metrics to evaluate the quality of an auto‐tuner, in an online and offline settings. We find that genetic algorithms provide a faster convergence rate and a faster computation time but surrogate models provide a better score in terms of both distance to the optimum and trajectory stability. Overall, the obtained results show that auto‐tuning heuristics improve the execution time of applications used conjointly with both SRO and SBB accelerators.