Glottal features for classification of phonation type from speech and neck surface accelerometer signals. (November 2021)

• Record Type: Journal Article
• Authors: Kadiri, Sudarsana Reddy; Alku, Paavo
• Is Part Of: Computer speech & language. Volume 70(2021)
• Publication Date: 2021-11
• Subjects: Phonation type -- Voice quality -- Neck surface accelerometer -- Glottal source waveform -- Support vector machine; Speech processing systems -- Periodicals; Automatic speech recognition -- Periodicals; Computers -- Periodicals; Linguistics -- Periodicals; Speech-Language Pathology -- Periodicals; Traitement automatique de la parole -- Périodiques; Reconnaissance automatique de la parole -- Périodiques; Automatic speech recognition; Speech processing systems; Electronic journals; Periodicals; 006.454
• DOI: 10.1016/j.csl.2021.101232
• Languages: English
• ISSNs: 0885-2308

Abstract

Highlights: Speech and neck surface accelerometer (NSA) signals are compared in phonation type classification Three phonation types (breathy, modal, pressed) are classified. Glottal features are computed using quasi-closed phase (QCP) glottal inverse filtering and zero frequency filtering (ZFF) methods. Both scalar features and MFCCs derived from glottal waveforms are investigated. Experiments with the SVM classifier revealed that NSA signals discriminate phonation types better compared to speech signals. The combination of glottal and MFCC features showed improved classification accuracy for both speech and NSA signals. Abstract: Glottal source characteristics vary between phonation types due to the tension of laryngeal muscles with the respiratory effort. Previous studies in the classification of phonation type have mainly used speech signals recorded by microphone. Recently, two studies were published in the classification of phonation type using neck surface accelerometer (NSA) signals. However, there are no previous studies comparing the use of the acoustic speech signal vs. the NSA signal as input in classifying phonation type. Therefore, the current study investigates simultaneously recorded speech and NSA signals in the classification of three phonation types (breathy, modal, pressed). The general goal is to understand which of the two signals (speech vs. NSA) is more effective in the classification task. We hypothesize that by using the same feature set for both signals, classification accuracy is higher for the NSA signal, which is more closely related to the physical vibration of the vocal folds and less affected by the vocal tract compared to the acoustical speech signal. Glottal source waveforms were computed using two signal processing methods, quasi-closed phase (QCP) glottal inverse filtering and zero frequency filtering (ZFF), and a group of time-domain and frequency-domain scalar features were computed from the obtained waveforms. In addition, the study investigated the use of mel-frequency cepstral coefficients (MFCCs) derived from the glottal source waveforms computed by QCP and ZFF. Classification experiments with support vector machine classifiers revealed that the NSA signal showed better discrimination of the phonation types compared to the speech signal when the same feature set was used. Furthermore, it was observed that the glottal features showed complementary information with the conventional MFCC features resulting in the best classification accuracy both for the NSA signal (86.9%) and the speech signal (80.6%).