The development of an automatic speech recognition model using interview data from long-term care for older adults. (10th December 2022)

• Record Type: Journal Article
• Authors: Hacking, Coen; Verbeek, Hilde; Hamers, Jan P H; Aarts, Sil
• Is Part Of: Journal of the American Medical Informatics Association. Volume 30:Number 3(2023)
• Page Start: 411
• Page End: 417
• Publication Date: 2022-12-10
• Subjects: automatic speech recognition -- long-term care -- artificial intelligence -- older adults -- nursing homes; Medical informatics -- Periodicals; Information Services -- Periodicals; Medical Informatics -- Periodicals; Médecine -- Informatique -- Périodiques; Informatica; Geneeskunde; Informatique médicale; Computer network resources; Electronic journals; 610.285
• DOI: 10.1093/jamia/ocac241
• Languages: English
• ISSNs: 1067-5027

Abstract

Abstract: Objective: In long-term care (LTC) for older adults, interviews are used to collect client perspectives that are often recorded and transcribed verbatim, which is a time-consuming, tedious task. Automatic speech recognition (ASR) could provide a solution; however, current ASR systems are not effective for certain demographic groups. This study aims to show how data from specific groups, such as older adults or people with accents, can be used to develop an effective ASR. Materials and methods: An initial ASR model was developed using the Mozilla Common Voice dataset. Audio and transcript data (34 h) from interviews with residents, family, and care professionals on quality of care were used. Interview data were continuously processed to reduce the word error rate (WER). Results: Due to background noise and mispronunciations, an initial ASR model had a WER of 48.3% on interview data. After finetuning using interview data, the average WER was reduced to 24.3%. When tested on speech data from the interviews, a median WER of 22.1% was achieved, with residents displaying the highest WER (22.7%). The resulting ASR model was at least 6 times faster than manual transcription. Discussion: The current method decreased the WER substantially, verifying its efficacy. Moreover, using local transcription of audio can be beneficial to the privacy of participants. Conclusions: The current study shows that interview data from LTC for older adults can be effectively used to improve an ASR model. While the model output does still contain some errors, researchers reported that it saved much time during transcription.