Niyama: Node scheduling for cloud workloads with resource isolation. (5th August 2022)

• Record Type: Journal Article
• Authors: Thiyyakat, Meghana; Kalambur, Subramaniam; Sitaram, Dinkar
• Is Part Of: Concurrency and computation. Volume 34:Number 23(2022)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2022-08-05
• Subjects: cgroups -- containers -- resource isolation; Parallel processing (Electronic computers) -- Periodicals; Parallel computers -- Periodicals; 004.35
• DOI: 10.1002/cpe.7196
• Languages: English
• ISSNs: 1532-0626

Abstract

Summary: Cloud providers place tasks from multiple applications on the same resource pool to improve the resource utilization of the infrastructure. The consequent resource contention has an undesirable effect on latency‐sensitive tasks. In this article, we present Niyama—a resource isolation approach that uses a modified version of deadline scheduling to protect latency‐sensitive tasks from CPU bandwidth contention. Conventionally, deadline scheduling has been used to schedule real‐time tasks with well‐defined deadlines. Therefore, it cannot be used directly when the deadlines are unspecified. In Niyama, we estimate deadlines in intervals and secure bandwidth required for the interval, thereby ensuring optimal job response times. We compare our approach with cgroups: Linux's default resource isolation mechanism used in containers today. Our experiments show that Niyama reduces the average delay in tasks by 3 × $$ \times $$ –20 × $$ \times $$ when compared to cgroups. Since Linux's deadline scheduling policy is work‐conserving in nature, there is a small drop in the server‐level CPU utilization when Niyama is used naively. We demonstrate how the use of core reservation and oversubscription in the inter‐node scheduler can be used to offset this drop; our experiments show a 1.3 × $$ \times $$ –2.24 × $$ \times $$ decrease in delay in job response time over cgroups while achieving high CPU utilization.