A low‐cost compensated approximate multiplier for Bfloat16 data processing on convolutional neural network inference. Issue 4 (26th July 2021)

• Record Type: Journal Article
• Authors: Kim, HyunJin
• Is Part Of: ETRI journal. Volume 43:Issue 4(2021)
• Page Start: 684
• Page End: 693
• Publication Date: 2021-07-26
• Subjects: Approximate computing -- bfloat16 format -- convolutional neural network -- logarithmic multiplier -- Mitchell's algorithm; Telecommunication -- Periodicals; Electronics -- Periodicals; Electronics; Telecommunication; Periodicals; Periodicals; 621.38205
• DOI: 10.4218/etrij.2020-0370
• Languages: English
• ISSNs: 1225-6463

Abstract

Abstract: This paper presents a low‐cost two‐stage approximate multiplier for bfloat16 (brain floating‐point) data processing. For cost‐efficient approximate multiplication, the first stage implements Mitchell's algorithm that performs the approximate multiplication using only two adders. The second stage adopts the exact multiplication to compensate for the error from the first stage by multiplying error terms and adding its truncated result to the final output. In our design, the low‐cost multiplications in both stages can reduce hardware costs significantly and provide low relative errors by compensating for the error from the first stage. We apply our approximate multiplier to the convolutional neural network (CNN) inferences, which shows small accuracy drops with well‐known pre‐trained models for the ImageNet database. Therefore, our design allows low‐cost CNN inference systems with high test accuracy.