Pipeline pattern in an object‐oriented, task‐parallel environment. (27th May 2014)

• Record Type: Journal Article
• Authors: Chow, Jonathan; Giacaman, Nasser; Sinnen, Oliver
• Is Part Of: Concurrency and computation. Volume 27:Number 5(2015:Apr.)
• Page Start: 1273
• Page End: 1291
• Publication Date: 2014-05-27
• Subjects: task parallelism -- parallel skeletons -- pipeline pattern; Parallel processing (Electronic computers) -- Periodicals; Parallel computers -- Periodicals; 004.35
• DOI: 10.1002/cpe.3305
• Languages: English
• ISSNs: 1532-0626

Abstract

Summary: Task parallelism is an approach to parallel programming that has recently gained traction because of its compatibility with the predominant object‐oriented languages and its low overhead compared to threading approaches. Parallel Task is an Open Source task‐parallel compiler and runtime system for object‐oriented languages, in particular Java. It is very flexible and expressive, demonstrated by the fact that it can be directly employed to implement most parallel computing patterns. The only notable exception has been the pipeline pattern where many data items are streamed through a number of processing stages. This is not surprising, as task parallelism is generally not compatible with the pipeline pattern. In this paper, we investigate how the pipeline pattern can be elegantly and efficiently implemented in a task‐parallel environment. To do so, we extend Parallel Task with the concept of implicit futures to allow creating pipelines in an intuitive and object‐oriented manner. Our experimental evaluation uses the extended Parallel Task to implement pipelines of different lengths and characteristics and compares with manual implementations. The evaluation demonstrates very good performance and scalability of the proposed task‐parallel pipeline approach. Copyright © 2014 John Wiley & Sons, Ltd.