Autonomous return on investment analysis of additional processing resources. (7th May 2010)

• Record Type: Journal Article
• Authors: Wildstrom, Jonathan; Stone, Peter; Witchel, Emmett
• Is Part Of: International journal of autonomic computing. Volume 1:Number 3(2010)
• Page Start: 280
• Page End: 296
• Publication Date: 2010-05-07
• Subjects: resource allocation -- virtualisation -- machine learning -- supervised learning -- autonomic computing -- autonomous agents -- distributed systems -- online transactions -- computing resources -- return on investment -- ROI -- additional processing resources; Autonomic computing -- Periodicals; Computer science -- Periodicals; 004.05
• Languages: English
• ISSNs: 1741-8569

Abstract

As the use of virtualisation and partitioning grows, it becomes possible to deploy a multi-tier web-based application with a variable amount of computing power. This introduces the possibility of provisioning only for a minimum workload, with the intention of renting more resources as necessary, but it also creates the problem of quickly and accurately identifying when more resources are needed or unneeded resources are being paid for. This paper presents a machine learning based approach to handling this problem. An autonomous adaptive agent learns to predict the gain (or loss) that would result from more (or less) resources; this agent uses only low-level system statistics, rather than relying on custom instrumentation of the operating system or middleware. Our agent is fully implemented and evaluated on a publicly available multi-machine, multi-process distributed system (the online transaction processing benchmark TPC-W). We show that our adaptive agent is competitive with any static choice of computing resources over a variety of test workloads. We also show that the agent outperforms each static choice in at least one case, implying that it is well suited for a situation where the workload is unknown.