A job submission manager for large-scale distributed systems based on job futurity predictor. (1st January 2014)

• Record Type: Journal Article
• Authors: Saadatfar, Hamid; Deldari, Hossein
• Is Part Of: International journal of grid and utility computing. Volume 5:Number 1(2014)
• Page Start: 50
• Page End: 59
• Publication Date: 2014-01-01
• Subjects: high performance computing -- distributed system -- unsuccessful job execution -- job submission manager -- job futurity predictor; Electronic data processing -- Distributed processing -- Periodicals; Electronic commerce -- Management -- Computer programs -- Periodicals; 004.605
• Languages: English
• ISSNs: 1741-847X

Abstract

As compared with supercomputers and PCs, the higher rate of unsuccessful job execution in today's distributed and large systems like clusters and grids is a significant reason behind squandering of their resources. Although many approaches have been proposed in order to make these environments more fault tolerant, their great overhead convinces the researchers to look for preventive methods. In this work, we employ a job futurity predictor to manage the arriving jobs efficiently. To this end, a novel meta-scheduler sub-component called Job Submission Manager (JSM) is proposed. The main role of JSM is to filter the incoming jobs according to some parameters such as current system load, job failure probability. The experimental results based on two different modelling approaches indicate that this managing component can effectively influence the system throughput and increase the utilisation of computing resources.