Automated identification of avian vocalizations with deep convolutional neural networks. Issue 1 (3rd September 2019)

• Record Type: Journal Article
• Authors: Ruff, Zachary J.; Lesmeister, Damon B.; Duchac, Leila S.; Padmaraju, Bharath K.; Sullivan, Christopher M.
• Editors: Pettorelli, Nathalie; Lecours, Vincent
• Is Part Of: Remote sensing in ecology and conservation. Volume 6:Issue 1(2020)
• Page Start: 79
• Page End: 92
• Publication Date: 2019-09-03
• Subjects: Acoustic monitoring -- avian vocalization -- Bioacoustics -- machine learning -- neural networks -- spotted owls; Remote sensing -- Periodicals; Ecology -- Research -- Periodicals; Ecology -- Methodology -- Periodicals; Ecology -- Remote sensing -- Periodicals; Nature conservation -- Methodology -- Periodicals; 577.0723
• DOI: 10.1002/rse2.125
• Languages: English
• ISSNs: 2056-3485

Abstract

Abstract: Passive acoustic monitoring is an emerging approach to wildlife monitoring that leverages recent improvements in automated recording units and other technologies. A central challenge of this approach is the task of locating and identifying target species vocalizations in large volumes of audio data. To address this issue, we developed an efficient data processing pipeline using a deep convolutional neural network (CNN) to automate the detection of owl vocalizations in spectrograms generated from unprocessed field recordings. While the project was initially focused on spotted and barred owls, we also trained the network to recognize northern saw‐whet owl, great horned owl, northern pygmy‐owl, and western screech‐owl. Although classification performance varies across species, initial results are promising. Recall, or the proportion of calls in the dataset that are detected and correctly identified, ranged from 63.1% for barred owl to 91.5% for spotted owl based on raw network output. Precision, the rate of true positives among apparent detections, ranged from 0.4% for spotted owl to 77.1% for northern saw‐whet owl based on raw output. In limited tests, the CNN performed as well as or better than human technicians at detecting owl calls. Our model output is suitable for developing species encounter histories for occupancy models and other analyses. We believe our approach is sufficiently general to support long‐term, large‐scale monitoring of a broad range of species beyond our target species list, including birds, mammals, and others. Abstract : Passive acoustic monitoring is a powerful tool for wildlife conservation and research but depends on researchers' ability to isolate signals of interest in the resulting data. We developed a data‐processing pipeline to automate this task using a deep convolutional neural network to identify the calls of six owl species in field recordings, with precision ranging from <0.4 to 77.1% and recall ranging from 63.1 to 91.5% by species. Our approach is applicable to a variety of taxa and is suitable for developing species encounter histories for occupancy models and other analyses.