Detection of speech playback attacks using robust harmonic trajectories. (January 2021)

• Record Type: Journal Article
• Authors: Shang, Wei; Stevenson, Maryhelen
• Is Part Of: Computer speech & language. Volume 65(2021)
• Publication Date: 2021-01
• Subjects: audio fingerprinting -- speech playback/replay attacks -- spoofing countermeasure -- automatic speaker verification; Speech processing systems -- Periodicals; Automatic speech recognition -- Periodicals; Computers -- Periodicals; Linguistics -- Periodicals; Speech-Language Pathology -- Periodicals; Traitement automatique de la parole -- Périodiques; Reconnaissance automatique de la parole -- Périodiques; Automatic speech recognition; Speech processing systems; Electronic journals; Periodicals; 006.454
• DOI: 10.1016/j.csl.2020.101133
• Languages: English
• ISSNs: 0885-2308

Abstract

Highlights: Unpredictable transmission paths make replay attack detection "non-trivial" Proposed voicedtracks (VT) feature set consists of robust harmonic trajectories VT captures the uniqueness of an utterances while withstanding unknown distortion Custom designed database consists of recordings made via telecommunication channels Good performance is obtained when using a global threshold Abstract: In this paper, a new feature set is proposed for use in a playback attack detector (PAD) aimed at safeguarding a passphrase and speaker-verified protected system that can be remotely accessed from an arbitrary location using an arbitrary telecommunication channel. The new feature set, termed VoicedTracks, is a time-frequency map of the most robust harmonic trajectories in an utterance and serves as an audio fingerprint that can uniquely identify an utterance despite a moderate amount of noise and channel distortion. Experimental results are obtained using a specially designed in-house database; the impact of various noise types and SNR levels is further investigated using a publicly available database. An analysis of playback scores across several combinations of telecommunication channel types, playback devices and additive noise demonstrates robustness of the feature set to channel distortion and additive noise, thus making it suitable for use in a copy-detection based PAD (cd-PAD) designed for applications such as telephone banking. Relative to other cd-PADs the proposed approach was better able to defend against playback attacks when telephone channels were involved. An analysis of its performance across the replay configurations used in the ASVspoof 2017 V2 evaluation set suggests that the proposed cd-PAD is highly effective in detecting those playback attacks that are most likely to spoof the speaker verification system.