Hybrid Convolutional-Transformer framework for drone-based few-shot weakly supervised object detection. (September 2022)

• Record Type: Journal Article
• Authors: Li, Shengming; Xue, Linsong; Feng, Lin; Yao, Cuili; Wang, Dong
• Is Part Of: Computers & electrical engineering. Volume 102(2022)
• Publication Date: 2022-09
• Subjects: Vision Transformer -- Few-shot learning -- Weakly supervised learning -- Object detection; Computer engineering -- Periodicals; Electrical engineering -- Periodicals; Electrical engineering -- Data processing -- Periodicals; Ordinateurs -- Conception et construction -- Périodiques; Électrotechnique -- Périodiques; Électrotechnique -- Informatique -- Périodiques; Computer engineering; Electrical engineering; Electrical engineering -- Data processing; Periodicals; Electronic journals; 621.302854
• DOI: 10.1016/j.compeleceng.2022.108154
• Languages: English
• ISSNs: 0045-7906

Abstract

Abstract: Drone delivery is becoming a new trend in the logistics system, but few researches are developed in this field. Locating the target buildings in the drone camera is a crucial technique. However, it is difficult to collect extensive drone-view images and their bounding box annotations for supervised training. Therefore, we address this problem by formulating it as a weakly supervised task and using small amount of category labels as supervision. To extract representative features of cross-view and cross-device images, we propose a Hybrid Convolutional-Transformer (HCT) framework for detection given the very few image-level annotated images. To better evaluate the proposed method in the realistic drone delivery task, we build a drone-view object detection dataset based on the University-1652 benchmark by annotating bounding boxes of target buildings. Extensive experimental results demonstrate the effectiveness of the proposed method. Graphical abstract: Highlights: A new drone-view detection dataset for evaluation. A Hybrid Convolutional-Transformer network for drone-view detection. The proposed method achieves SOTA performance.