Extending smart containers for data locality‐aware skeleton programming. (22nd October 2018)

• Record Type: Journal Article
• Authors: Ernstsson, August; Kessler, Christoph
• Other Names: Garcia J. Daniel guestEditor.; Llanos Diego R. guestEditor.
• Is Part Of: Concurrency and computation. Volume 31:Number 5(2019)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2018-10-22
• Subjects: lazy evaluation -- loop tiling -- skeleton programming -- SkePU -- smart containers; Parallel processing (Electronic computers) -- Periodicals; Parallel computers -- Periodicals; 004.35
• DOI: 10.1002/cpe.5003
• Languages: English
• ISSNs: 1532-0626

Abstract

Summary: We present an extension for the SkePU skeleton programming framework to improve the performance of sequences of transformations on smart containers. By using lazy evaluation, SkePU records skeleton invocations and dependencies as directed by smart container operands. When a partial result is required by a different part of the program, the run‐time system will process the entire lineage of skeleton invocations; tiling is applied to keep chunks of container data in the working set for the whole sequence of transformations. The approach is inspired by big data frameworks operating on large clusters where good data locality is crucial. We also consider benefits other than data locality with the increased run‐time information given by the lineage structures, such as backend selection for heterogeneous systems. Experimental evaluation of example applications shows potential for performance improvements due to better cache utilization, as long as the overhead of lineage construction and management is kept low.