Characterizing and synthesizing the workflow structure of microservices in ByteDance Cloud. Issue 8 (1st June 2022)

• Record Type: Journal Article
• Authors: Wen, Yingying; Cheng, Guanjie; Deng, Shuiguang; Yin, Jianwei
• Is Part Of: Journal of software. Volume 34:Issue 8(2022)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2022-06-01
• Subjects: ByteDance Cloud -- microservice architecture -- production data characterization -- trace data analysis; Software engineering -- Periodicals; Computer software -- Development -- Periodicals; Software maintenance -- Periodicals; 005.1
• DOI: 10.1002/smr.2467
• Languages: English
• ISSNs: 2047-7473

Abstract

Abstract: Modern Cloud applications have evolved from monolithic systems to numerous distributed microservices whose workflows interact via Remote Procedure Calls (RPCs). The benchmarks focusing on individual microservice components are insufficient because the reference relationships between components, which form the microservice workflow structure, are another critical aspect of microservice applications. Unfortunately, understanding the characteristics of microservice workflow in the production Cloud remains a missing piece in the literature, which prevents the representative of microservice benchmarks. In this paper, we fill this gap by characterizing and synthesizing the microservice workflows based on the trace data of the Toutiao application that is running on ByteDance Cloud. We examine the microservice workflows starting from DAG graphs, introduce observed properties that are easy to ignore but important, show the artificiality of the workflow by statistic description, and explore the high cost of network overhead. We further synthesize the workflow following the characteristics observed. The extensive evaluations show that the synthesized microservice workflows have consistent statistical characteristics as the production ones. A case study applying the synthesized workflows proves its usability. Abstract : Based on the distributed tracing technique, we parse trace logs to be the source data of our analysis. We characterize the microservice workflows of the Toutiao application running on ByteDance Cloud to profile their structure shapes and runtime states. The workflow synthesis method is also introduced and validated to help researchers apply real‐world characteristics.