An incremental reinforcement learning scheduling strategy for data‐intensive scientific workflows in the cloud. (26th January 2021)

• Record Type: Journal Article
• Authors: Nascimento, André; Silva, Vítor; Paes, Aline; de Oliveira, Daniel
• Other Names: Wang Zhibo guestEditor.; Jiang Lin guestEditor.; Suman Bilial guestEditor.; Wyrzykowski Roman guestEditor.; Szymanski Boleslaw K. guestEditor.; Bentes Cristiana Barbosa guestEditor.; França Felipe M.G. guestEditor.; Marzulo Leandro Augusto Justen guestEditor.; Mencagli Gabriele guestEditor.; Pilla Mauricio Lima guestEditor.
• Is Part Of: Concurrency and computation. Volume 33:Number 11(2021)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2021-01-26
• Subjects: compute cloud -- parallelism -- reinforcement learning -- workflow scheduling; Parallel processing (Electronic computers) -- Periodicals; Parallel computers -- Periodicals; 004.35
• DOI: 10.1002/cpe.6193
• Languages: English
• ISSNs: 1532-0626

Abstract

Summary: Most scientific experiments can be modeled as workflows. These workflows are usually computing‐ and data‐intensive, demanding the use of high‐performance computing environments such as clusters, grids, and clouds. This latter offers the advantage of the elasticity, which allows for changing the number of virtual machines (VMs) on demand. Workflows are typically managed using scientific workflow management systems (SWfMS). Many existing SWfMSs offer support for cloud‐based execution. Each SWfMS has its scheduler that follows a well‐defined cost function. However, such cost functions should consider the characteristics of a dynamic environment, such as live migrations or performance fluctuations, which are far from trivial to model. This article proposes a novel scheduling strategy, named ReASSIgN, based on reinforcement learning (RL). By relying on an RL technique, one may assume that there is an optimal (or suboptimal) solution for the scheduling problem, and aims at learning the best scheduling based on previous executions in the absence of a mathematical model of the environment. For this, an extension of a well‐known workflow simulator WorkflowSim is proposed to implement an RL strategy for scheduling workflows. Once the scheduling plan is generated via simulation, the workflow is executed in the cloud using SciCumulus SWfMS. We conducted a throughout evaluation of the proposed scheduling strategy using a real astronomy workflow named Montage.