In‐Memory Vector‐Matrix Multiplication in Monolithic Complementary Metal–Oxide–Semiconductor‐Memristor Integrated Circuits: Design Choices, Challenges, and Perspectives. (23rd August 2020)

• Record Type: Journal Article
• Authors: Amirsoleimani, Amirali; Alibart, Fabien; Yon, Victor; Xu, Jianxiong; Pazhouhandeh, M. Reza; Ecoffey, Serge; Beilliard, Yann; Genov, Roman; Drouin, Dominique
• Is Part Of: Advanced intelligent systems. Volume 2:Number 11(2020)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2020-08-23
• Subjects: complementary metal–oxide–semiconductor -- inference -- in-memory computing -- memristors -- redox-based random access memories -- resistive switching memories -- vector-matrix multiplications; Artificial intelligence -- Periodicals; Robotics -- Periodicals; Control theory -- Periodicals; 006.3
• DOI: 10.1002/aisy.202000115
• Languages: English
• ISSNs: 2640-4567

Abstract

Abstract : The low communication bandwidth between memory and processing units in conventional von Neumann machines does not support the requirements of emerging applications that rely extensively on large sets of data. More recent computing paradigms, such as high parallelization and near‐memory computing, help alleviate the data communication bottleneck to some extent, but paradigm‐shifting concepts are required. In‐memory computing has emerged as a prime candidate to eliminate this bottleneck by colocating memory and processing. In this context, resistive switching (RS) memory devices is a key promising choice, due to their unique intrinsic device‐level properties, enabling both storing and computing with a small, massively‐parallel footprint at low power. Theoretically, this directly translates to a major boost in energy efficiency and computational throughput, but various practical challenges remain. A qualitative and quantitative analysis of several key existing challenges in implementing high‐capacity, high‐volume RS memories for accelerating the most computationally demanding computation in machine learning (ML) inference, that of vector‐matrix multiplication (VMM), is presented. The monolithic integration of RS memories with complementary metal–oxide–semiconductor (CMOS) integrated circuits is presented as the core underlying technology. The key existing design choices in terms of device‐level physical implementation, circuit‐level design, and system‐level considerations is reviewed and an outlook for future directions is provided. Abstract : The design considerations, challenges, and perspectives are discussed and recent advances in monolithically integrated complementary metal–oxide–semiconductor (CMOS)‐resistive switching (RS) memory vector‐matrix multiplication (VMM) hardware for accelerating modern neural network applications are elucidated. It devises a new perspective on the physical constraints, circuit‐level limitations, along with design flow for input and output circuits, and explains system‐level challenges and opportunities for these hardware platforms.