WaterSegformer: A lightweight model for water body information extraction from remote sensing images. Issue 3 (7th December 2022)

• Record Type: Journal Article
• Authors: Yang, Xiao; Chen, Mingwei; Yu, Chengjun; Huang, Haozhe; Yue, Xiaobin; Zhou, Bei; Ni, Ming
• Is Part Of: IET image processing. Volume 17:Issue 3(2023)
• Page Start: 862
• Page End: 871
• Publication Date: 2022-12-07
• Subjects: convolutional neural nets -- image segmentation -- learning (artificial intelligence) -- remote sensing; Image processing -- Periodicals; 621.36705
• DOI: 10.1049/ipr2.12678
• Languages: English
• ISSNs: 1751-9659

Abstract

Abstract: Accurate and efficient extraction of water body information from remote sensing images is of great help to monitor water resources at the macro level, natural disaster prediction, and water pollution detection and prevention. Although many large models have achieved extremely high accuracy in remote sensing image water segmentation tasks, lightweight models are still a non‐negligible choice for many application scenarios because of the limitation of computing and storage resources. Here, WaterSegformer is described, an efficient and powerful lightweight water body segmentation model based on Segformer‐b0. The Deepmask module is designed to make the model pay more attention to the details in the image and use Lovász loss to improve IoU. In addition, DeepLabv3+ is used as the teacher model to guide the training of the model in the way of relational knowledge distillation. WaterSegformer realizes 95.06% mIoU on the test set with only 6.38 G and 3.72 M of FLOPs and parameters, respectively. Experimental results show that WaterSegformer achieves an excellent balance between accuracy, computational complexity and model size, which is hardware‐friendly, easy to deploy and enables real‐time segmentation. This method provides a new idea for water body information extraction from remote sensing images in practical applications. Abstract : Although many large models have achieved extremely high accuracy in remote sensing image water segmentation tasks, due to the limitation of computing and storage resources, lightweight models are still a non‐negligible choice for many application scenarios. In this paper, we describe WaterSegformer, an efficient and powerful lightweight water body segmentation model based on Segformer‐b0. Experimental results show that WaterSegformer achieves an excellent balance between accuracy, computational complexity and model size, which is hardware‐friendly, easy to deploy and enables real‐time segmentation. Our method provides a new idea for water body information extraction from remote sensing images in practical applications.