Learning automata based energy-efficient AI hardware design for IoT applications. (14th September 2020)

• Record Type: Journal Article
• Authors: Wheeldon, Adrian; Shafik, Rishad; Rahman, Tousif; Lei, Jie; Yakovlev, Alex; Granmo, Ole-Christoffer
• Is Part Of: Philosophical transactions. Volume 378:Number 2182(2020)
• Publication Date: 2020-09-14
• Subjects: Tsetlin machines -- neural networks -- artificial intelligence hardware design -- energy efficiency; Physical sciences -- Periodicals; Engineering -- Periodicals; Mathematics -- Periodicals; 500
• DOI: 10.1098/rsta.2019.0593
• Languages: English
• ISSNs: 1364-503X

Abstract

Abstract : Energy efficiency continues to be the core design challenge for artificial intelligence (AI) hardware designers. In this paper, we propose a new AI hardware architecture targeting Internet of Things applications. The architecture is founded on the principle of learning automata, defined using propositional logic. The logic-based underpinning enables low-energy footprints as well as high learning accuracy during training and inference, which are crucial requirements for efficient AI with long operating life. We present the first insights into this new architecture in the form of a custom-designed integrated circuit for pervasive applications. Fundamental to this circuit is systematic encoding of binarized input data fed into maximally parallel logic blocks. The allocation of these blocks is optimized through a design exploration and automation flow using field programmable gate array-based fast prototypes and software simulations. The design flow allows for an expedited hyperparameter search for meeting the conflicting requirements of energy frugality and high accuracy. Extensive validations on the hardware implementation of the new architecture using single- and multi-class machine learning datasets show potential for significantly lower energy than the existing AI hardware architectures. In addition, we demonstrate test accuracy and robustness matching the software implementation, outperforming other state-of-the-art machine learning algorithms. This article is part of the theme issue 'Advanced electromagnetic non-destructive evaluation and smart monitoring'.