SSC: cloud-based data stream management in distributed environments. (2016)

• Record Type: Journal Article
• Authors: Ong, Kok-Leong; Goscinski, Andrzej; Han, Yuzhang; Brezany, Peter; Tari, Zahir; Yan, Lei
• Is Part Of: International journal of high performance computing and networking. Volume 9:Number 3(2016)
• Page Start: 171
• Page End: 189
• Publication Date: 2016
• Subjects: cloud computing -- distributed systems -- cloud application management -- data streams -- data stream management; High performance computing -- Periodicals; Computer networks -- Periodicals; High performance computing; Periodicals; 004.05
• Languages: English
• ISSNs: 1740-0562

Abstract

Stream-oriented applications account for one of the major types of today's computing practices. They deal with high-speed data streams. When it comes to stream-oriented distributed systems, some challenges arise: for one thing, processing capability of a single compute node might become the bottleneck of the entire system. For another, transmitting streams among physically dispersed nodes could incur both communication overhead and instability of a distributed application. In this paper, we discuss the potential of using cloud technology to respond to various challenges faced by stream-oriented distributed systems. We introduce our idea of a special cloud, the scientific streaming cloud (SSC), which supports stream management in distributed environments. We also present our design of a language and an algorithm which are used on the SSC to describe and optimise stream-related tasks, respectively. Furthermore, we demonstrate our prototype implementation and a real-world application of the SSC.