Deep‐Q learning‐based heterogeneous earliest finish time scheduling algorithm for scientific workflows in cloud. (14th February 2020)

• Record Type: Journal Article
• Authors: Kaur, Avinash; Singh, Parminder; Singh Batth, Ranbir; Peng Lim, Chee
• Other Names: Aujla Gagangeet Singh guestEditor.; Prodan Radu guestEditor.; Rawat Danda B. guestEditor.
• Is Part Of: Software, practice & experience. Volume 52:Number 3(2022)
• Page Start: 689
• Page End: 709
• Publication Date: 2020-02-14
• Subjects: cloud computing -- deep‐Q learning -- HEFT -- multiobjective optimization -- workflow scheduling; Computer software -- Periodicals; Computer programming -- Periodicals; Computer programs -- Periodicals; 005.3
• DOI: 10.1002/spe.2802
• Languages: English
• ISSNs: 0038-0644

Abstract

Summary: The complex and large‐scale scientific workflow applications are effectively executes on the cloud. The performance of cloud computing highly depends on the task scheduling. Optimal workflow scheduling is still a challenge that needs to be addressed due to the conflicting objectives and increasing demand for quality of service. Task scheduling is an NP‐hard problem due to its complexity. The newly introduced methods for resolving the problem of task scheduling are facing challenges to take the benefits of all aspects of cloud computing. In this article, we study the joint optimization of cost and makespan of scheduling workflows in infrastructure as a service clouds and propose a new workflow scheduling scheme using deep learning. In this scheme, a deep‐Q learning‐based heterogeneous earliest‐finish‐time (DQ‐HEFT) algorithm is developed, which closely integrates the deep learning mechanism with the task scheduling heuristic HEFT. The workflowsim simulator is used for the experiment of the real‐world and synthetic workflows. The experiment results demonstrate the efficiency of our proposed approach compared with existing algorithms. This technique can achieve significantly better makespan and speed metrics with a remarkably higher volume of data and can run faster compared with the existing workflow scheduling algorithms in cloud computing environment.