Cost-aware hybrid cloud scheduling of parameter sweep calculations using predictive algorithms. (2019)

• Record Type: Journal Article
• Authors: Bosmans, Stig; Maricaux, Glenn; Van Der Schueren, Filip; Hellinckx, Peter
• Is Part Of: International journal of grid and utility computing. Volume 10:Number 1(2019)
• Page Start: 63
• Page End: 75
• Publication Date: 2019
• Subjects: parameter sweep -- cloud computing -- Amazon AWS EC2 -- predictive algorithms -- OpenNebula -- Amazon spot market -- machine learning.; Electronic data processing -- Distributed processing -- Periodicals; Electronic commerce -- Management -- Computer programs -- Periodicals; 004.605
• Languages: English
• ISSNs: 1741-847X

Abstract

This paper investigates various techniques for scheduling the costs of parameter sweep calculations efficiently in a hybrid cloud environment. The combination of both a private and a public cloud environment integrates the advantages of being cost effective and having virtually unlimited scaling capabilities at the same time. To make an accurate estimate for the required resources, multiple prediction techniques are discussed. The estimation can be used to create an efficient scheduler which respects both deadline and cost. These findings have been implemented and tested in a Java-based cloud framework which operates on Amazon EC2 and OpenNebula. Also, we present a theoretical model to further optimise the cost by leveraging the Amazon Spot Market.