Decentralised hybrid workflow scheduling algorithm for minimum end-to-end delay in heterogeneous computing environment. (2015)

• Record Type: Journal Article
• Authors: Cao, Fei; Zhu, Michelle Mengxia
• Is Part Of: International journal of high performance computing and networking. Volume 8:Number 4(2015)
• Page Start: 324
• Page End: 336
• Publication Date: 2015
• Subjects: decentralised hybrid algorithms -- directed acyclic graph -- DAG -- distributed computing -- minimum EED -- end-to-end delay -- workflow mapping -- workflow scheduling -- heterogeneous computing -- scientific workflow -- iterative critical path search -- layer-based priority techniques -- HICPP -- simulation; High performance computing -- Periodicals; Computer networks -- Periodicals; High performance computing; Periodicals; 004.05
• Languages: English
• ISSNs: 1740-0562

Abstract

This paper considers a decentralised hybrid algorithm for scheduling scientific workflow applications onto an underlying distributed computing environment with heterogeneous resources for minimum end-to-end delay (EED). Distributed scientific workflow applications modelled as directed acyclic graphs (DAGs) are widely applied to various research areas to enable efficient knowledge discovery by automated data processing. Owing to the NP-hardness of this problem, heuristic algorithms are commonly proposed to achieve the EED. Our algorithm combines iterative critical path search and layer-based priority techniques (HICPP) to achieve the minimum EED. Four representative mapping and scheduling algorithms for minimum EED are compared with HICPP. Our simulation results illustrate that HICPP consistently achieves the smallest EED with a low algorithm running time observed from many different scales of simulated test cases.