Deep Learning for Voice Gender Identification: Proof‐of‐concept for Gender‐Affirming Voice Care. (21st November 2020)

• Record Type: Journal Article
• Authors: Bensoussan, Yael; Pinto, Jeremy; Crowson, Matthew; Walden, Patrick R.; Rudzicz, Frank; Johns, Michael
• Is Part Of: Laryngoscope. Volume 131:Number 5(2021)
• Page Start: E1611
• Page End: E1615
• Publication Date: 2020-11-21
• Subjects: Voice -- gender -- artificial intelligence -- neural networks -- transgender; Otolaryngology -- Periodicals; 617.51005
• DOI: 10.1002/lary.29281
• Languages: English
• ISSNs: 0023-852X

Abstract

Abstract : Objectives/Hypothesis: The need for gender‐affirming voice care has been increasing in the transgender population in the last decade. Currently, objective treatment outcome measurements are lacking to assess the success of these interventions. This study uses neural network models to predict binary gender from short audio samples of "male" and "female" voices. This preliminary work is a proof‐of‐concept for further work to develop an AI‐assisted treatment outcome measure for gender‐affirming voice care. Study Design: Retrospective cohort study. Methods: Two hundred seventy‐eight voices from male and female speakers from the Perceptual Voice Qualities Database were used to train a deep neural network to classify voices as male or female. Each audio sample was mapped to the frequency domain using Mel spectrograms. To optimize model performance, we performed 10‐fold cross validation of the entire dataset. The dataset was split into 80% training, 10% validation, and 10% test. Results: Overall accuracy of 92% was obtained, both when considering the accuracy per spectrum and per patient metric. The accuracy of the model was higher for recognizing female voices (F1 score of 0.94) compared to male voices (F1 score of 0.87). Conclusions: This proof of concept study shows promising performance for further development of an AI‐assisted tool to provide objective treatment outcome measurements for gender affirming voice care. Level of evidence: 3 Laryngoscope, 131:E1611–E1615, 2021