DF‐DTM: Dynamic Task Memoization and reuse in dataflow. (3rd September 2018)

• Record Type: Journal Article
• Authors: Rouberte, Leandro; Sena, Alexandre C.; Nery, Alexandre S.; Marzulo, Leandro A. J.; Alves, Tiago A. O.; França, Felipe M. G.
• Other Names: Boeres Cristina guestEditor.; Bentes Cristiana guestEditor.; Moreno Edward guestEditor.; De Rose Cesar A. F. guestEditor.; Castrol Márcio guestEditor.
• Is Part Of: Concurrency and computation. Volume 31:Number 18(2019)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2018-09-03
• Subjects: dataflow -- memoization -- redundancy; Parallel processing (Electronic computers) -- Periodicals; Parallel computers -- Periodicals; 004.35
• DOI: 10.1002/cpe.4937
• Languages: English
• ISSNs: 1532-0626

Abstract

Summary: Instruction Reuse is a technique adopted in Von Neumann architectures that improves performance by avoiding redundant execution of instructions when the result to be produced can be obtained by searching an input/output memoization table for such instruction. Trace reuse can be applied to traces of instructions in a similar fashion. However, those techniques are yet to be studied in the context of the Dataflow model, which has been gaining traction in the high performance computing community due to its inherent parallelism. Dataflow programs are represented by directed graphs where nodes are instructions or tasks and edges denote data dependencies between tasks. This work presents Dataflow Dynamic Task Memoization (DF‐DTM), a technique that allows the reuse of both nodes and subgraphs in dataflow, which are analogous to instructions and traces, respectively. The potential of DF‐DTM is evaluated by a series of experiments that analyze the behavior of redundant tasks in five relevant benchmarks, where up to 99.70 % of the instantiated tasks could be reused. Moreover, this paper evaluates how reuse rates can be affected by limiting subgraph size, memoization table size, task granularity, and problem size, showing that DF‐DTM can yield good reuse rates in more realistic environments.