DynamoGraph: extending the Pregel paradigm for large-scale temporal graph processing. (2016)

• Record Type: Journal Article
• Authors: Steinbauer, Matthias; Anderst-Kotsis, Gabriele
• Is Part Of: International journal of grid and utility computing. Volume 7:Number 2(2016)
• Page Start: 141
• Page End: 151
• Publication Date: 2016
• Subjects: distributed graphs -- temporal graphs -- social network analysis -- SNA -- big data -- online social networks -- Pregel paradigm -- temporal graph processing -- dynamic processes -- cloud computing; Electronic data processing -- Distributed processing -- Periodicals; Electronic commerce -- Management -- Computer programs -- Periodicals; 004.605
• Languages: English
• ISSNs: 1741-847X

Abstract

Large-scale temporal graphs can serve as a model in many application scenarios. Owing to the popularity of online social networks and increased research interest in gathering and analysing data about human behaviour and interaction (reality mining) temporal graphs gain attraction in social network analysis and more specifically in the analysis of dynamic processes in social networks. Originally developed for web-graph analysis, systems supporting a Pregel-style processing paradigm can be used to process large-scale social network data. However, current methods for social network analysis require data to be processed off-line, or lack support for temporal graphs, or support datasets of limited size only. In this work we present a cloud-based distributed processing framework extending the Pregel paradigm for large-scale temporal graphs. By using computing resources in the cloud this system is scalable and prepared to scale for the massive datasets that occur in social network analysis.