Incremental parallel computing for continuous queries in dynamic graphs using a transactional model. (4th May 2018)

• Record Type: Journal Article
• Authors: Tripathi, Anand; Sharma, Rahul R.; Khandelwal, Manu; Mehta, Tanmay
• Is Part Of: Concurrency and computation. Volume 30:Number 18(2018)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2018-05-04
• Subjects: cluster computing -- continuous queries -- distributed algorithms -- dynamic graphs -- incremental computing -- parallel computing -- transactional model; Parallel processing (Electronic computers) -- Periodicals; Parallel computers -- Periodicals; 004.35
• DOI: 10.1002/cpe.4500
• Languages: English
• ISSNs: 1532-0626

Abstract

Summary: In dynamically evolving graphs, one may be interested in continuously observing certain properties of the graph. One approach for continuous monitoring is to re‐execute the graph analytics program on the entire graph after it is updated. However, this approach can lead to high computation cost and latency in case of large graphs. An alternate approach, which we present in this paper, is to execute the analytics program only initially and then perform incremental computations for supporting continuous queries as the graph is modified. The goal of our work is to develop incremental parallel computing techniques to continuously monitor a graph as it is updated to check for the properties of interest. We present the results of our investigation of utilizing a transactional model of parallel programming for supporting continuous queries on dynamic and evolving graphs. In our model, the graph updates are performed as transactions, which trigger the execution of a set of transactional tasks to perform incremental computations. In our testbed system, the graph data is stored in the RAM of cluster nodes, and continuous queries involve the parallel execution of transactional tasks on the cluster nodes. Using a set of graph problems, we illustrate this approach and evaluate its performance.