Modelling Errors in Automatic Speech Recognition for Dysarthric Speakers. (11th May 2009)

• Record Type: Journal Article
• Authors: Caballero Morales, Santiago Omar; Cox, Stephen J.
• Other Names: Godino-Llorente Juan I. Academic Editor.
• Is Part Of: EURASIP journal on advances in signal processing. Volume 2009(2009)
• Publication Date: 2009-05-11
• Subjects: Signal processing -- Periodicals; Traitement du signal; Signal processing; Periodicals; 621.3822
• DOI: 10.1155/2009/308340
• Languages: English
• ISSNs: 1687-6172

Abstract

Abstract : Dysarthria is a motor speech disorder characterized by weakness, paralysis, or poor coordination of the muscles responsible for speech. Although automatic speech recognition (ASR) systems have been developed for disordered speech, factors such as low intelligibility and limited phonemic repertoire decrease speech recognition accuracy, making conventional speaker adaptation algorithms perform poorly on dysarthric speakers. In this work, rather than adapting the acoustic models, we model the errors made by the speaker and attempt to correct them. For this task, two techniques have been developed: (1) a set of "metamodels" that incorporate a model of the speaker's phonetic confusion matrix into the ASR process; (2) a cascade of weighted finite-state transducers at the confusion matrix, word, and language levels. Both techniques attempt to correct the errors made at the phonetic level and make use of a language model to find the best estimate of the correct word sequence. Our experiments show that both techniques outperform standard adaptation techniques.