Estimating the overhead and coupling of scientific computing clusters. (March 2023)

• Record Type: Journal Article
• Authors: Vivas, Aurelio; Castro, Harold
• Is Part Of: Simulation. Volume 99:Number 3(2023)
• Page Start: 245
• Page End: 261
• Publication Date: 2023-03
• Subjects: High-performance computing -- cluster computing -- performance evaluation -- parallel overhead -- cluster overhead -- coupling; Computer simulation -- Periodicals; 003.3
• DOI: 10.1177/00375497211064198
• Languages: English
• ISSNs: 0037-5497

Abstract

Since simulation became the third pillar of scientific research, several forms of computers have become available to drive computer aided simulations, and nowadays, clusters are the most popular type of computers supporting these tasks. For instance, cluster settings, such as the so-called supercomputers, cluster of workstations (COW), cluster of desktops (COD), and cluster of virtual machines (COV) have been considered in literature to embrace a variety of scientific applications. However, those scientific applications categorized as high-performance computing (HPC) are conceptually restricted to be addressed only by supercomputers. In this aspect, we introduce the notions of cluster overhead and cluster coupling to assess the capacity of non-HPC systems to handle HPC applications. We also compare the cluster overhead with an existing measure of overhead in computing systems, the total parallel overhead, to explain the correctness of our methodology. The evaluation of capacity considers the seven dwarfs of scientific computing, which are well-known, scientific computing building blocks considered in the development of HPC applications. The evaluation of these building blocks provides insights regarding the strengths and weaknesses of non-HPC systems to deal with future HPC applications developed with one or a combination of these algorithmic building blocks.