Deep‐Learning‐Enabled MXene‐Based Artificial Throat: Toward Sound Detection and Speech Recognition. Issue 9 (6th July 2020)

• Record Type: Journal Article
• Authors: Jin, Yukun; Wen, Bo; Gu, Zixiong; Jiang, Xiantao; Shu, Xiaolan; Zeng, Zhenping; Zhang, Yupeng; Guo, Zhinan; Chen, Yun; Zheng, Tingting; Yue, Yutao; Zhang, Han; Ding, Huijun
• Is Part Of: Advanced materials technologies. Volume 5:Issue 9(2020)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2020-07-06
• Subjects: artificial throat -- deep‐learning -- MXenes -- speech recognition -- stretchable sensors; Materials science -- Periodicals; Technological innovations -- Periodicals; Materials science; Technological innovations; Periodicals; 620.1105
• DOI: 10.1002/admt.202000262
• Languages: English
• ISSNs: 2365-709X

Abstract

Abstract: Wearable sound detectors require strain sensors that are stretchable, sensitive, and capable of adhering conformably to the skin, and toward this end, 2D materials hold great promise. However, the vibration of vocal cords and muscle contraction are complex and changeable, which can compromise the sensing performance of devices. By combining deep learning and 2D MXenes, an MXene‐based sound detector is prepared successfully with improved recognition and sensitive response to pressure and vibration, which facilitate the production of a high‐recognition and resolution sound detector. By training and testing the deep learning network model with large amounts of data obtained by the MXene‐based sound detector, the long vowels and short vowels of human pronunciation are successfully recognized. The proposed scheme accelerates the application of artificial throat devices in biomedical fields and opens up practical applications in voice control, motion monitoring, and many other fields. Abstract : The flexible sensor based on MXene can detect the movement signal of neck muscles caused by human pronunciation. Combining a large number of detected signals with convolutional neural networks can classify and recognize different pronunciation contents, which is conducive to the development of advanced wearable artificial larynx.