SVitchboard-II and FiSVer-I: Crafting high quality and low complexity conversational english speech corpora using submodular function optimization. (March 2017)

• Record Type: Journal Article
• Authors: Liu, Yuzong; Iyer, Rishabh; Kirchhoff, Katrin; Bilmes, Jeff
• Is Part Of: Computer speech & language. Volume 42(2017)
• Page Start: 122
• Page End: 142
• Publication Date: 2017-03
• Subjects: Submodular function optimization -- Automatic speech recognition -- Speech corpus; Speech processing systems -- Periodicals; Automatic speech recognition -- Periodicals; Computers -- Periodicals; Linguistics -- Periodicals; Speech-Language Pathology -- Periodicals; Traitement automatique de la parole -- Périodiques; Reconnaissance automatique de la parole -- Périodiques; Automatic speech recognition; Speech processing systems; Electronic journals; Periodicals; 006.454
• DOI: 10.1016/j.csl.2016.10.002
• Languages: English
• ISSNs: 0885-2308

Abstract

Highlights: We introduced a set of conversational English speech corpora with high acoustic quality and limited vocabulary derived from the Switchboard-I and Fisher datasets. We investigated numerous state-of-the-art submodular function optimization procedures, including SCSC/SCSK, DS and SFM optimization. We surveyed different submodular function instantiations, where both ''acoustic quality'' and vocabulary size are adeptly measured via various submodular functions. We provided baseline word recognition results on all of the resultant speech corpora for both Gaussian mixture model (GMM) and deep neural network (DNN)-based systems. We had released all of the corpora definitions and Kaldi training recipes for free in the public domain. Abstract: We introduce a set of benchmark corpora of conversational English speech derived from the Switchboard-I and Fisher datasets. Traditional automatic speech recognition (ASR) research requires considerable computational resources and has slow experimental turnaround times. Our goal is to introduce these new datasets to researchers in the ASR and machine learning communities in order to facilitate the development of novel speech recognition techniques on smaller but still acoustically rich, diverse, and hence interesting corpora. We select these corpora to maximize an acoustic quality criterion while limiting the vocabulary size (from 10 words up to 10, 000 words), where both "acoustic quality" and vocabulary size are adeptly measured via various submodular functions. We also survey numerous submodular functions that could be useful to measure both "acoustic quality" and "corpus complexity" and offer guidelines on when and why a scientist may wish use to one vs. another. The corpora selection process itself is naturally performed using various state-of-the-art submodular function optimization procedures, including submodular level-set constrained submodular optimization (SCSC/SCSK), difference-of-submodular (DS) optimization, and unconstrained submodular minimization (SFM), all of which are fully defined herein. While the focus of this paper is on the resultant speech corpora, and the survey of possible objectives, a consequence of the paper is a thorough empirical comparison of the relative merits of these modern submodular optimization procedures. We provide baseline word recognition results on all of the resultant speech corpora for both Gaussian mixture model (GMM) and deep neural network (DNN)-based systems, and we have released all of the corpora definitions and Kaldi training recipes for free in the public domain.