Deep Learning‐Enabled MXene/PEDOT:PSS Acoustic Sensor for Speech Recognition and Skin‐Vibration Detection. (25th September 2022)

• Record Type: Journal Article
• Authors: Ding, Huijun; Zeng, Zhenping; Wang, Ziwei; Li, Xiaolin; Yildirim, Tanju; Xie, Qinlin; Zhang, Han; Wageh, Swelm; Al-Ghamdi, Ahmed A.; Zhang, Xi; Wen, Bo
• Is Part Of: Advanced intelligent systems. Volume 4:Number 10(2022)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2022-09-25
• Subjects: acoustic sensor -- artificial throat -- composite film -- deep-learning -- micro-electronic structure; Artificial intelligence -- Periodicals; Robotics -- Periodicals; Control theory -- Periodicals; 006.3
• DOI: 10.1002/aisy.202200140
• Languages: English
• ISSNs: 2640-4567

Abstract

Abstract : Flexible acoustic sensors with high sensitivity, excellent mechanical strength, and easy integration are urgently needed for wearable electronics. MXene holds great promise as a sensing material for this application. However, low flexibility and stability limit the performance of MXene‐based composites. To alleviate the aforementioned issue, a flexible pressure sensor based on MXene/poly(3, 4‐ethylenediox‐ythiophene)‐poly(styrenesulfonate) (PEDOT:PSS) is fabricated and used as an acoustic sensor inhibiting high sensitivity, fast response time (57 ms), ultra‐thin thickness (30 μm), and remarkable stability. Excellent performance enables the sensor to detect and identify weak muscle movements and skin vibrations, such as word pronunciation and carotid artery pulse. Furthermore, by combining the proposed deep learning model based on number recognition convolutional neural network (NR‐CNN), speech recognition toward different pronunciations of numbers that appear frequently in daily conversations can be realized. High recognition accuracy (91%) is achieved by training and testing the proposed NR‐CNN with large amounts of data recorded by the sensor. Results demonstrate that the flexible and wearable MXene/PEDOT:PSS acoustic sensor accelerates intelligent artificial acoustics and possesses great potential for applications involving speech recognition and health monitoring. Abstract : A flexible and wearable MXene/PEDOT:PSS acoustic sensor with high sensitivity, excellent mechanical strength, and easy integration is fabricated for further intelligent artificial acoustics. By combining with the proposed deep learning model based on NR‐CNN, speech recognition toward different pronunciations of numbers that appear frequently in daily conversations can be realized.