Container lifecycle‐aware scheduling for serverless computing. (9th July 2021)
- Record Type:
- Journal Article
- Title:
- Container lifecycle‐aware scheduling for serverless computing. (9th July 2021)
- Main Title:
- Container lifecycle‐aware scheduling for serverless computing
- Authors:
- Wu, Song
Tao, Zhiheng
Fan, Hao
Huang, Zhuo
Zhang, Xinmin
Jin, Hai
Yu, Chen
Cao, Chun - Abstract:
- Abstract: Elastic scaling in response to changes on demand is a main benefit of serverless computing. When bursty workloads arrive, a serverless platform launches many new containers and initializes function environments (known as cold starts), which incurs significant startup latency. To reduce cold starts, platforms usually pause a container after it serves a request, and reuse this container for subsequent requests. However, this reuse strategy cannot efficiently reduce cold starts because the schedulers are agnostic of container lifecycle. For example, it may ignore soon available containers or evict soon needed containers. We propose a container lifecycle‐aware scheduling strategy for serverless computing, CAS. The key idea is to control distribution of requests and determine creation or eviction of containers according to different lifecycle phases of containers. We implement a prototype of CAS on OpenWhisk. Our evaluation shows that CAS reduces 81% cold starts and therefore brings a 63% reduction at 95th percentile latency compared with native scheduling strategy in OpenWhisk when there is worker contention between workloads, and does not add significant performance overhead.
- Is Part Of:
- Software, practice & experience. Volume 52:Number 2(2022)
- Journal:
- Software, practice & experience
- Issue:
- Volume 52:Number 2(2022)
- Issue Display:
- Volume 52, Issue 2 (2022)
- Year:
- 2022
- Volume:
- 52
- Issue:
- 2
- Issue Sort Value:
- 2022-0052-0002-0000
- Page Start:
- 337
- Page End:
- 352
- Publication Date:
- 2021-07-09
- Subjects:
- cold start -- container -- elastic scaling -- scheduling -- serverless computing
Computer software -- Periodicals
Computer programming -- Periodicals
Computer programs -- Periodicals
005.3 - Journal URLs:
- http://onlinelibrary.wiley.com/ ↗
- DOI:
- 10.1002/spe.3016 ↗
- Languages:
- English
- ISSNs:
- 0038-0644
- Deposit Type:
- Legaldeposit
- View Content:
- Available online (eLD content is only available in our Reading Rooms) ↗
- Physical Locations:
- British Library DSC - 8321.453000
British Library DSC - BLDSS-3PM
British Library STI - ELD Digital store - Ingest File:
- 20392.xml