Locally learning heterogeneous manifolds for phonetic classification. (July 2016)

• Record Type: Journal Article
• Authors: Huang, Heyun; Liu, Yang; ten Bosch, Louis; Cranen, Bert; Boves, Lou
• Is Part Of: Computer speech & language. Volume 38(2016)
• Page Start: 28
• Page End: 45
• Publication Date: 2016-07
• Subjects: Manifold learning -- Dimensionality reduction -- Partial classification -- Classifier fusion -- Phone classification -- TIMIT; Speech processing systems -- Periodicals; Automatic speech recognition -- Periodicals; Computers -- Periodicals; Linguistics -- Periodicals; Speech-Language Pathology -- Periodicals; Traitement automatique de la parole -- Périodiques; Reconnaissance automatique de la parole -- Périodiques; Automatic speech recognition; Speech processing systems; Electronic journals; Periodicals; 006.454
• DOI: 10.1016/j.csl.2015.12.002
• Languages: English
• ISSNs: 0885-2308

Abstract

Abstract: Most state-of-the-art phone classifiers use the same features and decision criteria for all phones, despite the fact that different broad classes are characterized by different manners and place of articulation that result in different acoustic features. This paper uses manifold learning to address structure in the acoustic space. Previous approaches to dimensionality reduction based on manifold learning assumed that the acoustic space can be characterized by a uniform manifold structure. In this paper we relax this assumption by learning different manifold structures for broad phonetic classes. Because all known classifiers make confusions between broad classes, we designed a two-level classifier in which the top level consists of a number of partially overlapping broad classes. Since the resulting classifiers are not statistically independent, we propose a new method for fusing the classifiers. Experimental results show that our two-level classifier obtained slightly better results when broad-class specific manifolds were learned, compared to a uniform manifold. However, the accuracy is still considerably lower than what could be obtained with oracle knowledge about broad class membership. From this we infer that phones do not form compact clusters in acoustic space.