A deep 2D/3D Feature-Level fusion for classification of UAV multispectral imagery in urban areas. Issue 23 (2nd December 2022)

• Record Type: Journal Article
• Authors: Pourazar, Hossein; Samadzadegan, Farhad; Dadrass Javan, Farzaneh
• Is Part Of: Geocarto international. Volume 37:Issue 23(2023)
• Page Start: 6695
• Page End: 6712
• Publication Date: 2022-12-02
• Subjects: UAV -- multispectral imagery -- nDSM -- Deep CNN; Remote sensing -- Periodicals; Geographic information systems -- Periodicals; Geology -- Periodicals; Cartography -- Periodicals; 621.3678
• DOI: 10.1080/10106049.2021.1959655
• Languages: English
• ISSNs: 1010-6049

Abstract

Abstract: In this paper, a deep convolutional neural network (CNN) is developed to classify the Unmanned Aerial Vehicle (UAV) derived multispectral imagery and normalized digital surface model (DSM) data in urban areas. For this purpose, a multi-input deep CNN (MIDCNN) architecture is designed using 11 parallel CNNs; 10 deep CNNs to extract the features from all possible triple combinations of spectral bands as well as one deep CNN dedicated to the normalized DSM data. The proposed method is compared with the traditional single-input (SI) and double-input (DI) deep CNN designations and random forest (RF) classifier, and evaluated using two independent test datasets. The results indicate that increasing the CNN layers parallelly augmented the classifier's generalization and reduced overfitting risk. The overall accuracy and kappa value of the proposed method are 95% and 0.93, respectively, for the first test dataset, and 96% and 0.94, respectively, for the second test data set.