Supernode transformation on GPGPUs. Issue 2 (4th March 2019)

• Record Type: Journal Article
• Authors: Chen, Yong; Shang, Weijia
• Is Part Of: International journal of parallel, emergent and distributed systems. Volume 34:Issue 2(2019)
• Page Start: 181
• Page End: 202
• Publication Date: 2019-03-04
• Subjects: Supernode transformation -- tiling -- GPGPUs -- linear scheduling -- data locality -- parallel computing; Parallel computers -- Periodicals; Electronic data processing -- Distributed processing -- Periodicals; Computer algorithms -- Periodicals; 004.35
• DOI: 10.1080/17445760.2017.1296147
• Languages: English
• ISSNs: 1744-5760

Abstract

ABSTRACT: Supernode transformation, or tiling, is a technique that partitions algorithms to improve data locality and parallelism to achieve shortest running time. It groups multiple iterations of nested loops into supernodes to be assigned to processors for processing in parallel. A supernode transformation can be described by supernode size and shape. This paper focuses on supernode transformation on General Purpose Graphic Processing Units (GPGPUs), including supernode scheduling, supernode mapping to GPGPU blocks, and the finding of the optimal supernode size, for achieving the shortest total running time. The algorithms considered are two nested loops with regular data dependencies. The Longest Common Subsequence problem is used as an illustration. A novel mathematical model for the total running time is established as a function of the supernode size, algorithm parameters such as the problem size and the data dependence, the computation time of each loop iteration, architecture parameters such as the number of GPGPU blocks, and the communication cost. The optimal supernode size is derived from this closed form model. The model and the optimal supernode size provide better results than previous research and are verified by simulations on GPGPUs. Iterations in a two-dimensional uniform dependence algorithm iteration space ofM × N, shown as the intersections in the picture, can be grouped into rectangles ofw × h known as a tile or a supernode. This process is called supernode transformation or tiling. It reduces the inter-iteration communication cost thus improves the total execution time. The supernodes on the same wavefront may be scheduled on GPU to be processed at the same time, each by a GPU block. The size of the tile, w × h, plays an important role in this transformation. The optimal size can lead to minimal total execution time. Graphical Abstract: