Self-aware artificial auditory neuron with a triboelectric sensor for spike-based neuromorphic hardware. (May 2023)

• Record Type: Journal Article
• Authors: Yun, Seong-Yun; Han, Joon-Kyu; Lee, Sang-Won; Yu, Ji-Man; Jeon, Seung-Bae; Choi, Yang-Kyu
• Is Part Of: Nano energy. Volume 109(2023)
• Publication Date: 2023-05
• Subjects: Triboelectric nanogenerator (TENG) -- Biristor neuron -- Artificial auditory neuron -- Spiking neural network (SNN) -- Pitch classification -- Sound pressure level (SPL); Nanoscience -- Periodicals; Nanotechnology -- Periodicals; Nanostructured materials -- Periodicals; Power resources -- Technological innovations -- Periodicals; Nanoscience; Nanostructured materials; Nanotechnology; Power resources -- Technological innovations; Periodicals; 621.042
• DOI: 10.1016/j.nanoen.2023.108322
• Languages: English
• ISSNs: 2211-2855

Abstract

Abstract: Auditory organs can detect and process sounds with the help of the organ of Corti located in the cochlea. The energy efficiency of biological processing for an input sound signal is very high due to the spike-based auditory neurons in auditory organs. Here, inspired by the biological auditory system, a self-aware artificial auditory neuron module is constructed by serially connecting a triboelectric nanogenerator (TENG) and a bi-stable resistor (biristor). The TENG serves as a sound sensor and a current source to feed current input so as to awaken the biristor, which acts as a device-level neuron that is dissimilar to a traditional circuit-based neuron. The proposed self-aware artificial neuron module simultaneously detects the sound pressure level (SPL) and encodes it into a spike form, after which it transmits these data to an artificial synapse as an input neuron for a spiking neural network (SNN). Like an auditory organ, the spiking frequency of the bio-inspired artificial neuron increases when the SPL increases. In addition, the self-aware artificial auditory system with a single-layer perceptron (SLP) for SNN is demonstrated for musical pitch classification. This artificial auditory system is configured by combining two artificial auditory neuron modules and four metal-oxide-semiconductor field-effect transistor (MOSFET) synapses. The biristor neuron and the MOSFET synapse are structurally identical but electrically different. Two artificial auditory neuron modules correspond to two different frequencies. This artificial auditory system distinguishes two sounds from a piano. It also identifies two similar sounds from a cello and a violin. The proposed artificial SNN-based auditory system is advantageous for low power consumption due to the event-driven spiking transmission scheme. The improved energy efficiency with the SNN as described here is attributed to the self-aware sensing capability for sound signals. Therefore, the self-aware SNN auditory system given its low power consumption is promising for a remote sensor, a wireless sensor, and for an Internet of Things (IoT) sensor system. Graphical Abstract: ga1 Highlights: A self-aware artificial auditory neuron module is demonstrated by combining a triboelectric sensor and a bi-stable resistor. The artificial auditory neuron module detects a sound pressure level and encodes it into a spike form. Spiking frequency of the artificial auditory neuron module increases with an increase in the sound pressure level. A spike-based hardware system for musical pitch classification is proposed with artificial synapses.