Real time wearable speech recognition system for deaf persons. (May 2021)

• Record Type: Journal Article
• Authors: Yağanoğlu, Mete
• Is Part Of: Computers & electrical engineering. Volume 91(2021)
• Publication Date: 2021-05
• Subjects: Wearable processing -- Speech recognition -- Deaf -- Quality of life; Computer engineering -- Periodicals; Electrical engineering -- Periodicals; Electrical engineering -- Data processing -- Periodicals; Ordinateurs -- Conception et construction -- Périodiques; Électrotechnique -- Périodiques; Électrotechnique -- Informatique -- Périodiques; Computer engineering; Electrical engineering; Electrical engineering -- Data processing; Periodicals; Electronic journals; 621.302854
• DOI: 10.1016/j.compeleceng.2021.107026
• Languages: English
• ISSNs: 0045-7906

Abstract

Abstract: Numerous people around the world experience varying degrees of hearing difficulties. A sense of sound is critical for quality of life for people with hearing difficulties, including deaf people. Wearable devices have substantial potential for voice recognition applications owing to their low cost and light weight. They can assist deaf people perform their daily activities more easily without requiring assistance from others. I have designed and developed a wearable, vibration-based system that will enable deaf people to distinguish important sentences, thereby improving their quality of life. The device consists of a microphone and vibration motor and is mounted on the user's back. A study was conducted with the device in which speech was detected using Mel Frequency Cepstral Coefficients (MFCC), pre-processing, and Dynamic Time Warping (DTW). Tests were conducted in three different signal-to-noise ratio environments in real time with a typical computer setup. The results had 95% accuracy, 97% specificity and 76% sensitivity. Graphical abstract: Highlights: The paper presents a device is to improve the quality of life of deaf people. The proposed device communicates speech content to the deaf without the need for a hearing aid. The study aimed to design and develop an applied concept for wearable, intelligent technology. Testing of performance was conducted in three different signal-to-noise ratio environments in real time.