A general deep learning model for bird detection in high‐resolution airborne imagery. Issue 8 (10th August 2022)

• Record Type: Journal Article
• Authors: Weinstein, Ben G.; Garner, Lindsey; Saccomanno, Vienna R.; Steinkraus, Ashley; Ortega, Andrew; Brush, Kristen; Yenni, Glenda; McKellar, Ann E.; Converse, Rowan; Lippitt, Christopher D.; Wegmann, Alex; Holmes, Nick D.; Edney, Alice J.; Hart, Tom; Jessopp, Mark J.; Clarke, Rohan H.; Marchowski, Dominik; Senyondo, Henry; Dotson, Ryan; White, Ethan P.; Frederick, Peter; Ernest, S. K. Morgan
• Is Part Of: Ecological applications. Volume 32:Issue 8(2022)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2022-08-10
• Subjects: airborne monitoring -- bird detection -- computer vision -- deep learning -- unoccupied aerial vehicle; Ecology -- Periodicals; Environmental protection -- Periodicals; Biology, Economic -- Periodicals; 577.05
• DOI: 10.1002/eap.2694
• Languages: English
• ISSNs: 1051-0761

Abstract

Abstract: Advances in artificial intelligence for computer vision hold great promise for increasing the scales at which ecological systems can be studied. The distribution and behavior of individuals is central to ecology, and computer vision using deep neural networks can learn to detect individual objects in imagery. However, developing supervised models for ecological monitoring is challenging because it requires large amounts of human‐labeled training data, requires advanced technical expertise and computational infrastructure, and is prone to overfitting. This limits application across space and time. One solution is developing generalized models that can be applied across species and ecosystems. Using over 250, 000 annotations from 13 projects from around the world, we develop a general bird detection model that achieves over 65% recall and 50% precision on novel aerial data without any local training despite differences in species, habitat, and imaging methodology. Fine‐tuning this model with only 1000 local annotations increases these values to an average of 84% recall and 69% precision by building on the general features learned from other data sources. Retraining from the general model improves local predictions even when moderately large annotation sets are available and makes model training faster and more stable. Our results demonstrate that general models for detecting broad classes of organisms using airborne imagery are achievable. These models can reduce the effort, expertise, and computational resources necessary for automating the detection of individual organisms across large scales, helping to transform the scale of data collection in ecology and the questions that can be addressed.