Systematic realization of a fully connected deep and convolutional neural network architecture on a field programmable gate array. (January 2022)

• Record Type: Journal Article
• Authors: Mukhopadhyay, Anand Kumar; Majumder, Sampurna; Chakrabarti, Indrajit
• Is Part Of: Computers & electrical engineering. Volume 97(2022)
• Publication Date: 2022-01
• Subjects: Deep neural network -- Fully connected -- Convolutional neural network -- Systolic array -- Inference system -- Very large scale integration -- Architecture -- Field programmable gate array; Computer engineering -- Periodicals; Electrical engineering -- Periodicals; Electrical engineering -- Data processing -- Periodicals; Ordinateurs -- Conception et construction -- Périodiques; Électrotechnique -- Périodiques; Électrotechnique -- Informatique -- Périodiques; Computer engineering; Electrical engineering; Electrical engineering -- Data processing; Periodicals; Electronic journals; 621.302854
• DOI: 10.1016/j.compeleceng.2021.107628
• Languages: English
• ISSNs: 0045-7906

Abstract

Abstract: A detailed methodology for implementing a fully connected (FC) deep neural network (DNN) and convolutional neural network (CNN) inference system on a field programming gate array (FPGA) is presented. Minimal computational units are used for the DNN. For the CNN, systolic array (SA) architecture endowed with parallel processing potential is utilized. Algorithmic analysis determines the optimum memory requirement for the fixed point trained parameters. The size of the trained parameters and the available memory on the target FPGA device govern the choice of on-chip memory to utilize. Experimental results indicate that the choice of block over distributed memory saves ≈ 62% look-up-tables (LUTs) for the DNN ([784-512-512-10]), and the choice of distributed over block memory saves ≈ 30% block random access memory (BRAM) for the LeNet-5 CNN unit. This study provides insights for developing FPGA-based digital systems for applications requiring DNN and CNN. Graphical abstract: Highlights: A methodological approach for mapping DNN and CNN inference unit on an FPGA. Serial processing for DNN and parallel systolic array processing for CNN. Detailed illustration of the VLSI modules used to build the inference architecture. Choice of distributed/block on-chip memory for the inference architectures and comparison with related works.