Analyzing speech in both time and space: Generalized additive mixed models can uncover systematic patterns of variation in vocal tract shape in real-time MRI. Issue 1 (18th March 2020)

• Record Type: Journal Article
• Authors: Carignan, Christopher; Hoole, Phil; Kunay, Esther; Pouplier, Marianne; Joseph, Arun; Voit, Dirk; Frahm, Jens; Harrington, Jonathan
• Is Part Of: Laboratory phonology. Volume 11:Issue 1(2020)
• Publication Date: 2020-03-18
• Subjects: real-time MRI -- GAMM -- FLMM -- speech dynamics -- speech imaging; Grammar, Comparative and general -- Phonology -- Periodicals; Phonetics -- Periodicals; Psycholinguistics -- Periodicals; Linguistic change -- Periodicals; 415.05
• DOI: 10.5334/labphon.214
• Languages: English
• ISSNs: 1868-6346

Abstract

We present a method of using generalized additive mixed models (GAMMs) to analyze midsagittal vocal tract data obtained from real-time magnetic resonance imaging (rt-MRI) video of speech production. Applied to rt-MRI data, GAMMs allow for observation of factor effects on vocal tract shape throughout two key dimensions: time (vocal tract change over the temporal course of a speech segment) and space (location of change within the vocal tract). Examples of this method are provided for rt-MRI data collected at a temporal resolution of 20 ms and a spatial resolution of 1.41 mm, for 36 native speakers of German. The rt-MRI data were quantified as 28-point semi-polar-grid aperture functions. Three test cases are provided as a way of observing vocal tract differences between: (1) /aː/ and /iː/, (2) /aː/ and /aɪ/, and (3) accentuated and unstressed /aː/. The results for each GAMM are independently validated using functional linear mixed models (FLMMs) constructed from data obtained at 20% and 80% of the vowel interval. In each case, the two methods yield similar results. In light of the method similarities, we propose that GAMMs are a robust, powerful, and interpretable method of simultaneously analyzing both temporal and spatial effects in rt-MRI video of speech.