Using a sparse promoting method in linear programming approximations to schedule parallel jobs. (30th July 2014)

• Record Type: Journal Article
• Authors: Chrétien, Stéphane; Nicod, Jean‐Marc; Philippe, Laurent; Rehn‐Sonigo, Veronika; Toch, Lamiel
• Is Part Of: Concurrency and computation. Volume 27:Number 14(2015:Sep.)
• Page Start: 3561
• Page End: 3586
• Publication Date: 2014-07-30
• Subjects: job folding, moldable mob -- scheduling -- makespan -- virtualization -- sparse integer linear programming; Parallel processing (Electronic computers) -- Periodicals; Parallel computers -- Periodicals; 004.35
• DOI: 10.1002/cpe.3350
• Languages: English
• ISSNs: 1532-0626

Abstract

Summary: In this paper, we tackle the well‐known problem of scheduling a collection of parallel jobs on a set of processors either in a cluster or in a multiprocessor computer. For the makespan objective, that is, the completion time of the last job, this problem has been shown to be NP‐hard, and several heuristics have already been proposed to minimize the execution time. In this paper, we consider both rigid and moldable jobs. Our main contribution is the introduction of a new approach to the scheduling problem, based on the recent discoveries in the field of compressed sensing. In the proposed approach, all possible positions and shapes of the jobs are encoded into a matrix, and the scheduling is performed by selecting the best columns under natural constraints. Thus, the solution to the new scheduling formulation is naturally sparse, and we may use appropriate relaxations to achieve the optimization task in the quickest possible way. Among many possible relaxation strategies, we choose to minimize the ℓ p ‐quasi‐norm for p ∈(0, 1). Minimization of the ℓ p ‐quasi‐norm is implemented via a successive linear programming approximation heuristic. We propose several new algorithms based on this approach, and we assess their efficiency through simulations. The experiments show that the scheme outperforms the classic Largest Task First list based algorithm for scheduling small to medium instances but needs improvements to compete on larger numbers of jobs. Copyright © 2014 John Wiley & Sons, Ltd.