Automatic screening of mild cognitive impairment and Alzheimer's disease by means of posterior-thresholding hesitation representation. (September 2022)

• Record Type: Journal Article
• Authors: Egas-López, José Vicente; Balogh, Réka; Imre, Nóra; Hoffmann, Ildikó; Szabó, Martina Katalin; Tóth, László; Pákáski, Magdolna; Kálmán, János; Gosztolya, Gábor
• Is Part Of: Computer speech & language. Volume 75(2022)
• Publication Date: 2022-09
• Subjects: Mild cognitive impairment -- Alzheimer's disease -- Dementia -- Automatic speech recognition -- Feature extraction -- Temporal speech parameters; Speech processing systems -- Periodicals; Automatic speech recognition -- Periodicals; Computers -- Periodicals; Linguistics -- Periodicals; Speech-Language Pathology -- Periodicals; Traitement automatique de la parole -- Périodiques; Reconnaissance automatique de la parole -- Périodiques; Automatic speech recognition; Speech processing systems; Electronic journals; Periodicals; 006.454
• DOI: 10.1016/j.csl.2022.101377
• Languages: English
• ISSNs: 0885-2308

Abstract

Abstract: Dementia is a chronic or progressive clinical syndrome, characterized by the deterioration of problem-solving skills, memory and language. In Mild Cognitive Impairment (MCI), which is often considered to be the prodromal stage of dementia, there is also a subtle deterioration of these cognitive functions; however, it does not affect the patients' ability to carry out simple everyday activities. The timely identification of MCI could provide more effective therapeutic interventions to delay progression, and to postpone the possible conversion to dementia. Since language changes in MCI are present even before the manifestation of other distinctive cognitive symptoms, a non-invasive way of early automatic screening could be the use of speech analysis. Earlier, our research team developed a set of temporal speech parameters that mainly focus on the amount of silence and hesitation, and demonstrated its applicability for MCI detection. However, for the automatic extraction of these attributes, the execution of a full Automatic Speech Recognition (ASR) process is necessary. In this study we propose a simpler feature extraction approach, which still quantifies the amount of silence and hesitation in the speech of the subject, but does not require the application of a full ASR system. We experimentally demonstrate that this approach, operating directly on the frame-level output of a HMM/DNN hybrid acoustic model, is capable of extracting attributes as useful as the ASR-based temporal parameter extraction workflow was able to. That is, on our corpus consisting of 25 healthy controls, 25 MCI and 25 mild AD subjects, we achieve a (three-class) classification accuracy of 70.7%, an F-measure score of 89.6 and a mean AUC score of 0.804. We also show that this approach can be applied on simpler, context-independent acoustic states with only a slight degradation of MCI and mild Alzheimer's detection performance. Lastly, we investigate the usefulness of the three speaker tasks which are present in our recording protocol. Highlights: Automatic diagnosis of dementia using a non-invasive way: the speech of the patient. DNN acoustic model gives an akin set of temporal speech parameters as an ASR system. Hesitation analysis in dementia-speech foster high-quality utterance-level features.