Cloud computing in a distributed e‐infrastructure using the web processing service standard. (10th July 2017)

• Record Type: Journal Article
• Authors: Coro, Gianpaolo; Panichi, Giancarlo; Scarponi, Paolo; Pagano, Pasquale
• Is Part Of: Concurrency and computation. Volume 29:Number 18(2017)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2017-07-10
• Subjects: big data processing -- cloud computing -- data mining -- distributed systems -- e‐Infrastructures -- parallel processing -- Science 2.0 -- WPS; Parallel processing (Electronic computers) -- Periodicals; Parallel computers -- Periodicals; 004.35
• DOI: 10.1002/cpe.4219
• Languages: English
• ISSNs: 1532-0626

Abstract

Summary: New Science paradigms have recently evolved to promote open publication of scientific findings as well as multi‐disciplinary collaborative approaches to scientific experimentation. These approaches can face modern scientific challenges but must deal with large quantities of data produced by industrial and scientific experiments. These data, so‐called Big Data, require to introduce new computer science systems to help scientists cooperate, extract information, and possibly produce new knowledge out of the data. E‐infrastructures are distributed computer systems that foster collaboration between users and can embed distributed and parallel processing systems to manage big data. However, in order to meet modern Science requirements, e‐Infrastructures impose several requirements to computational systems in turn, eg, being economically sustainable, managing community‐provided processes, using standard representations for processes and data, managing big data size and heterogeneous representations, supporting reproducible Science, collaborative experimentation, and cooperative online environments, managing security and privacy for data and services. In this paper, we present a cloud computing system (gCube DataMiner) that meets these requirements and operates in an e‐Infrastructure, while sharing characteristics with state‐of‐the‐art cloud computing systems. To this aim, DataMiner uses the web processing service standard of the open geospatial consortium and introduces features like collaborative experimental spaces, automatic installation of processes and services on top of a flexible and sustainable cloud computing architecture. We compare DataMiner with another mature cloud computing system and highlight the benefits our system brings, the new paradigms requirements it satisfies, and the applications that can be developed based on this system.