Öhman returns: New horizons in the collection and analysis of imaging data in speech production research. (September 2017)

• Record Type: Journal Article
• Authors: Hoole, Philip; Pouplier, Marianne
• Is Part Of: Computer speech & language. Volume 45(2017)
• Page Start: 253
• Page End: 277
• Publication Date: 2017-09
• Subjects: Articulatory data -- Imaging techniques -- Time series analysis -- Ultrasound -- Principal component analysis -- Coarticulation; Speech processing systems -- Periodicals; Automatic speech recognition -- Periodicals; Computers -- Periodicals; Linguistics -- Periodicals; Speech-Language Pathology -- Periodicals; Traitement automatique de la parole -- Périodiques; Reconnaissance automatique de la parole -- Périodiques; Automatic speech recognition; Speech processing systems; Electronic journals; Periodicals; 006.454
• DOI: 10.1016/j.csl.2017.03.002
• Languages: English
• ISSNs: 0885-2308

Abstract

Highlights: Advances in imaging technologies in speech production research are discussed. Principal component analysis is applied to entire ultrasound images. Time series of the 1st PC score can straightforwardly be analyzed statistically. The method is illustrated for coarticulation patterns in VCV syllables. Abstract: There have been enormous technical advances in the use of imaging techniques in speech production research in terms of resolution and frame rates. However, a major bottleneck lies in the lack of appropriate data reduction and quantification methods which allow for a parsimonious representation of the high-dimensional image data. Particularly the rapid increase in frame rates seen in data acquisition makes traditional, error-prone methods of contour tracking unwieldy due to the high amount of manual intervention required. We discuss recent developments in methods that obviate contour tracking but instead process the entire image. Specifically, we focus on one such approach by demonstrating the application of Principal Component Analysis to ultrasound images. This method not only exploits the information present in the entire image, but it also straightforwardly allows for the representation of the temporal evolution of an utterance by reducing a series of images to a time-varying single-value representation. In an illustrative example, inspired by the seminal work of Öhman (1966), we show how characteristic patterns of coarticulation between vowels and consonants can be captured in this way.