Affective and behavioural computing: Lessons learnt from the First Computational Paralinguistics Challenge. (January 2019)

• Record Type: Journal Article
• Authors: Schuller, Björn; Weninger, Felix; Zhang, Yue; Ringeval, Fabien; Batliner, Anton; Steidl, Stefan; Eyben, Florian; Marchi, Erik; Vinciarelli, Alessandro; Scherer, Klaus; Chetouani, Mohamed; Mortillaro, Marcello
• Is Part Of: Computer speech & language. Volume 53(2019)
• Page Start: 156
• Page End: 180
• Publication Date: 2019-01
• Subjects: Computational Paralinguistics -- Social Signals -- Conflict -- Emotion -- Autism -- Survey -- Challenge; Speech processing systems -- Periodicals; Automatic speech recognition -- Periodicals; Computers -- Periodicals; Linguistics -- Periodicals; Speech-Language Pathology -- Periodicals; Traitement automatique de la parole -- Périodiques; Reconnaissance automatique de la parole -- Périodiques; Automatic speech recognition; Speech processing systems; Electronic journals; Periodicals; 006.454
• DOI: 10.1016/j.csl.2018.02.004
• Languages: English
• ISSNs: 0885-2308

Abstract

Highlights: Review of the first Interspeech Challenge that actually ran under the label of Interspeech ComParE – the broadest to date – and the larger field. Original fusion results of the best winning systems to establish a new baseline. Additional novel analyses such as average confusion matrices of the participant's systems. Novel single feature baselines. In-depth discussion of the performance variation and algorithms used. Abstract: In this article, we review the INTERSPEECH 2013 Computational Paralinguistics ChallengE (ComParE) – the first of its kind– in light of the recent developments in affective and behavioural computing. The impact of the first ComParE instalment is manifold: first, it featured various new recognition tasks including social signals such as laughter and fillers, conflict in dyadic group discussions, and atypical communication due to pervasive developmental disorders, as well as enacted emotion; second, it marked the onset of the ComParE, subsuming all tasks investigated hitherto within the realm of computational paralinguistics; finally, besides providing a unified test-bed under well-defined and strictly comparable conditions, we present the definite feature vector used for computation of the baselines, thus laying the foundation for a successful series of follow-up Challenges. Starting with a review of the preceding INTERSPEECH Challenges, we present the four Sub-Challenges of ComParE 2013. In particular, we provide details of the Challenge databases and a meta-analysis by conducting experiments of logistic regression on single features and evaluating the performances achieved by the participants.