Workload resampling for performance evaluation of parallel job schedulers. (14th March 2014)

• Record Type: Journal Article
• Authors: Zakay, Netanel; Feitelson, Dror G.; Amaral, J. N.; Field, A. J.
• Is Part Of: Concurrency and computation. Volume 26:Number 12(2014:Aug.)
• Page Start: 2079
• Page End: 2105
• Publication Date: 2014-03-14
• Subjects: Parallel processing (Electronic computers) -- Periodicals; Parallel computers -- Periodicals; 004.35
• DOI: 10.1002/cpe.3240
• Languages: English
• ISSNs: 1532-0626

Abstract

<abstract abstract-type="main" id="cpe3240-abs-0001"> <title>SUMMARY</title> <p id="cpe3240-para-0001">Evaluating the performance of a computer system is based on using representative workloads. Common practice is to either use real workload traces to drive simulations or use statistical workload models that are based on such traces. Such models allow various workload attributes to be manipulated, thus providing desirable flexibility, but may lose details of the workload's internal structure. To overcome this, we suggest to combine the benefits of real traces and flexible modeling. Focusing on the problem of evaluating the performance of parallel job schedulers, we partition the trace of submitted jobs into independent subtraces representing different users and then recombine them in various ways, while maintaining features such as long‐range dependence and the daily and weekly cycles of activity. This facilitates the creation of longer workload traces that enable longer simulations, the creation of multiple statistically similar workloads that can be used to gauge confidence intervals, the creation of workloads with different load levels, and increasing the frequency of specific events like large surges of activity. Copyright © 2014 John Wiley &amp; Sons, Ltd.</p> </abstract>