DeepSim: cluster level behavioural simulation model for deep learning. (4th June 2019)

• Record Type: Journal Article
• Authors: Shi, Yuankun; Long, Kevin J.; Balasubramanian, Kaushik; Bian, Zhaojuan; Procter, Adam; Illikkal, Ramesh
• Is Part Of: International journal of big data intelligence. Volume 6:Number 3/4(2019)
• Page Start: 224
• Page End: 233
• Publication Date: 2019-06-04
• Subjects: deep learning -- datacentre -- behavioural simulation -- AlexNet -- architecture analysis -- performance analysis -- server srchitecture; Big data -- Periodicals; 005.705
• Languages: English
• ISSNs: 2053-1389

Abstract

We are witnessing an explosion of AI use cases driving the computer industry, and especially datacentre and server architectures. As Intel faces fierce competition in this emerging technology space, it is critical that architecture definitions and directions are driven with data from proper tools and methodologies, and insights are drawn from end-to-end holistic analysis at the datacentre levels. In this paper, we introduce DeepSim, a cluster-level behavioural simulation model for deep learning. DeepSim, which is based on the Intel CoFluent simulation framework, uses timed behavioural models to simulate complex interworking between compute nodes, networking, and storage at the datacentre level, providing a realistic performance model of real-world image recognition applications based on the popular deep learning framework Caffe. The end-to-end simulation data from DeepSim provides insights which can be used for architecture analysis driving future datacentre architecture directions. DeepSim enables scalable system design, deployment, and capacity planning through accurate performance insights. Results from preliminary scaling studies (e.g., node scaling and network scaling) and what-if analyses (e.g., Xeon with HBM and Xeon Phi with dual OPA) are presented in this paper. The simulation results are correlated well with empirical measurements, achieving an accuracy of 95%.