Workflow scheduling optimisation for distributed environment using artificial neural networks and reinforcement learning. (22nd December 2021)

• Record Type: Journal Article
• Authors: Naik, K. Jairam; Pedagandam, Mounish; Mishra, Amrita
• Is Part Of: International journal of computational science and engineering. Volume 24:Number 6(2021)
• Page Start: 653
• Page End: 670
• Publication Date: 2021-12-22
• Subjects: workflow -- scheduling -- tasks -- workload -- optimisation -- distributed environment -- ANN -- makespan time -- Q-learning -- resources; Computer science -- Mathematics -- Periodicals; Computer simulation -- Mathematical aspects -- Periodicals; Computational intelligence -- Periodicals; 004.015105
• Languages: English
• ISSNs: 1742-7185

Abstract

The growing volumes of information and multifaceted nature of information processing, workflow scheduling in distributed environment are a prominent component for computing operations to diminish the amount of information transferring, computation load allocation to resources, reducing the task's waiting time and execution time. The basic objective of this article is to find an optimal schedule (Sopt) which can reduce the makespan of workflow. Artificial intelligence and neural network (NN) systems are the main-stream, but they were not effectively employed nevertheless for workflow scheduling. Hence, we enhance the scheduling by realising artificial neural networks and reinforcement Q-learning standards. An optimised NN-based scheduling algorithm (WfSo_ANRL) that represents an agent which can effectively schedule the tasks among computational nodes was provided in this article. The agent interacts with the external environment, i.e., the computing environment and collects the current status of load encoded in the form of a state vector. The agent then predicts an action and efficiently allocates the tasks on to the attainable resources. The external computing environment then awards incentives to the agent. The agent then learns to produce optimal schedules for reducing the makespan. In this way, the WfSo_ANRL produces optimal solution for workload.