An adaptive meta-scheduler for data-intensive applications. (17th May 2005)

• Record Type: Journal Article
• Authors: Jin, Hai; Shi, Xuanhua; Qiang, Weizhong; Zou, Deqing
• Is Part Of: International journal of grid and utility computing. Volume 1:Number 1(2005)
• Page Start: 32
• Page End: 37
• Publication Date: 2005-05-17
• Subjects: grid computing -- adaptive scheduling -- task scheduling -- metascheduler -- replication -- computational grids -- data grids -- greedy scheduling algorithm -- scientific computing -- high-energy physics -- bioinformatics -- data storage -- network resources -- computational resources; Electronic data processing -- Distributed processing -- Periodicals; Electronic commerce -- Management -- Computer programs -- Periodicals; 004.605
• Languages: English
• ISSNs: 1741-847X

Abstract

In data-intensive applications, such as high-energy physics, bio-informatics, we encounter applications involving numerous jobs that access and generate large datasets. Effective scheduling of such applications is a challenge, due to the need to consider for both computational resources and data storage resources. In this paper, we describe an adaptive scheduling model that considers availability of computational, storage and network resources. Based on this model we implement a scheduler used in our campus grid. The results achieved by our scheduler have been analysed by comparing with greedy algorithm that is widely used in computational grids and some data grids.