Bird and whale species identification using sound images. Issue 2 (22nd December 2017)

• Record Type: Journal Article
• Authors: Nanni, Loris; Aguiar, Rafael L.; Costa, Yandre M.G.; Brahnam, Sheryl; Silla, Carlos N.; Brattin, Ricky L.; Zhao, Zhao
• Is Part Of: IET computer vision. Volume 12:Issue 2(2018)
• Page Start: 178
• Page End: 184
• Publication Date: 2017-12-22
• Subjects: image texture; sound images -- visual features -- percussion images -- harmonic images -- bird vocalisations -- texture features -- audio signal approaches -- image identification; Computer vision -- Periodicals; Pattern recognition systems -- Periodicals; 006.37
• DOI: 10.1049/iet-cvi.2017.0075
• Languages: English
• ISSNs: 1751-9632

Abstract

Abstract : Image identification of animals is mostly centred on identifying them based on their appearance, but there are other ways images can be used to identify animals, including by representing the sounds they make with images. In this study, the authors present a novel and effective approach for automated identification of birds and whales using some of the best texture descriptors in the computer vision literature. The visual features of sounds are built starting from the audio file and are taken from images constructed from different spectrograms and from harmonic and percussion images. These images are divided into sub‐windows from which sets of texture descriptors are extracted. The experiments reported in this study using a dataset of Bird vocalisations targeted for species recognition and a dataset of right whale calls targeted for whale detection (as well as three well‐known benchmarks for music genre classification) demonstrate that the fusion of different texture features enhances performance. The experiments also demonstrate that the fusion of different texture features with audio features is not only comparable with existing audio signal approaches but also statistically improves some of the stand‐alone audio features. The code for the experiments will be publicly available at https://www.dropbox.com/s/bguw035yrqz0pwp/ElencoCode.docx?dl=0 .