Towards efficient quantized inference for convolutional neural network on edge system. Issue 1 (1st April 2022)

• Record Type: Journal Article
• Authors: Tan, Hai; Wang, Nan; Lei, Bo
• Is Part Of: Journal of physics. Volume 2234:Issue 1(2022)
• Publication Date: 2022-04-01
• Subjects: Physics -- Congresses; 530.5
• DOI: 10.1088/1742-6596/2234/1/012006
• Languages: English
• ISSNs: 1742-6588

Abstract

Abstract: Convolutional Neural Networks (CNN) have made splendid achievements in various object detection tasks. To extend the applications of CNN detection models, the implementation of model inference on edge platforms, such as ASIC, FPGA and other embedded systems, has been intensively investigated in recent years. However, the huge model size and its enormous overhead constrain the deployment of detection model on edge platform which always has limited computational capability. Quantized inference of CNN model is one of the efficient approach to running model on edge platform. In this paper, we develop a hardware-friendly quantized inference scheme of detection model that is used for efficient inference on embedded FPGA systems. The proposed method contains several techniques that are able to optimize the quantized inference of detection model on FPGA device. The experimental results demonstrate that not only make the detection model quantized inference more efficient but also maintain the accuracy of object detection.