Cloud workflow scheduling algorithm based on reinforcement learning. (2018)

• Record Type: Journal Article
• Authors: Cui, Delong; Peng, Zhiping; Ke, Wende; Hong, Xiaoyu; Zuo, Jinglong
• Is Part Of: International journal of high performance computing and networking. Volume 11:Number 3(2018)
• Page Start: 181
• Page End: 190
• Publication Date: 2018
• Subjects: multiple DAGs -- reinforcement learning -- workflow scheduling -- cloud computing; High performance computing -- Periodicals; Computer networks -- Periodicals; High performance computing; Periodicals; 004.05
• Languages: English
• ISSNs: 1740-0562

Abstract

How to fairly schedule the multiple workflow with multiple priorities submitted at different times has become an increasing concern in workflow management system (WMS). To solve the problem, a novel workflow scheduling algorithm based on reinforcement learning is proposed in this study. In our scheme, we first define some basic concepts of reinforcement learning in cloud computing, such as state space, action space and immediate reward. Then single DAG and multiple DAG cloud workflow scheduling algorithm based on reinforcement learning are designed respectively. Reinforcement learning sets up a policy to maximise the cumulative rewards in the long-term through the repetition of trial-and-error interactions in cloud computing environment. Finally, we analyse algorithm performance by using queuing theory. We use real cloud workflow to test the proposed scheme. Our results, on the one hand, demonstrate the proposed scheme can reasonably schedule multiple DAGs with multiple priorities and improve utilisation rate of resources better and, on the other hand, show optimisation object function achieves fair workflow scheduling in cloud computing environment.