Efficient neural networks for edge devices. (June 2021)

• Record Type: Journal Article
• Authors: Liu, Shiya; Ha, Dong Sam; Shen, Fangyang; Yi, Yang
• Is Part Of: Computers & electrical engineering. Volume 92(2021)
• Publication Date: 2021-06
• Subjects: Edge computing -- Cloud computing -- Neural network -- Edge devices -- Quantization -- Pruning; Computer engineering -- Periodicals; Electrical engineering -- Periodicals; Electrical engineering -- Data processing -- Periodicals; Ordinateurs -- Conception et construction -- Périodiques; Électrotechnique -- Périodiques; Électrotechnique -- Informatique -- Périodiques; Computer engineering; Electrical engineering; Electrical engineering -- Data processing; Periodicals; Electronic journals; 621.302854
• DOI: 10.1016/j.compeleceng.2021.107121
• Languages: English
• ISSNs: 0045-7906

Abstract

Abstract: Due to limited computation and storage resources of industrial internet of things (IoT) edge devices, many emerging intelligent industrial IoT applications based on deep neural networks (DNNs) heavily depend on cloud computing for computation and storage. However, cloud computing faces technical issues in long latency, poor reliability, and weak privacy, resulting in the need for on-device computation and storage. On-device computation is essential for many time-critical industrial IoT applications, which require real-time data processing. In this paper, we review three major research areas for on-device computation, specifically quantization, pruning, and network architecture design. The three techniques could enable a DNN model to be deployed on edge devices for real-time computation and storage, mainly due to the reduction of computation and space complexity. More importantly, these techniques could make DNNs applicable to industrial IoT devices.