Memristors—From In‐Memory Computing, Deep Learning Acceleration, and Spiking Neural Networks to the Future of Neuromorphic and Bio‐Inspired Computing. (2nd August 2020)

• Record Type: Journal Article
• Authors: Mehonic, Adnan; Sebastian, Abu; Rajendran, Bipin; Simeone, Osvaldo; Vasilaki, Eleni; Kenyon, Anthony J.
• Is Part Of: Advanced intelligent systems. Volume 2:Number 11(2020)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2020-08-02
• Subjects: deep learning -- in-memory computing -- memristors -- neuromorphic systems -- power-efficient artificial intelligence -- spiking neural networks; Artificial intelligence -- Periodicals; Robotics -- Periodicals; Control theory -- Periodicals; 006.3
• DOI: 10.1002/aisy.202000085
• Languages: English
• ISSNs: 2640-4567

Abstract

Abstract : Machine learning, particularly in the form of deep learning (DL), has driven most of the recent fundamental developments in artificial intelligence (AI). DL is based on computational models that are, to a certain extent, bio‐inspired, as they rely on networks of connected simple computing units operating in parallel. The success of DL is supported by three factors: availability of vast amounts of data, continuous growth in computing power, and algorithmic innovations. The approaching demise of Moore's law, and the consequent expected modest improvements in computing power that can be achieved by scaling, raises the question of whether the progress will be slowed or halted due to hardware limitations. This article reviews the case for a novel beyond‐complementary metal–oxide–semiconductor (CMOS) technology—memristors—as a potential solution for the implementation of power‐efficient in‐memory computing, DL accelerators, and spiking neural networks. Central themes are the reliance on non‐von‐Neumann computing architectures and the need for developing tailored learning and inference algorithms. To argue that lessons from biology can be useful in providing directions for further progress in AI, an example‐based reservoir computing is briefly discussed. At the end, speculation is given on the "big picture" view of future neuromorphic and brain‐inspired computing systems. Abstract : Memristor technologies, with their remarkable diversity and richness of functional properties, can prove to be fundamental building blocks for the next generation of extraordinarily power‐efficient computing systems. Herein, it is discussed how memristors fit within the ever‐expanding field of hardware for artificial intelligence applications—from in‐memory computing, deep learning accelerators, and spiking neural networks to more bio‐inspired computing models.