SHREC'22 track: Open-Set 3D Object Retrieval. (October 2022)

• Record Type: Journal Article
• Authors: Feng, Yifan; Gao, Yue; Zhao, Xibin; Guo, Yandong; Bagewadi, Nihar; Bui, Nhat-Tan; Dao, Hieu; Gangisetty, Shankar; Guan, Ripeng; Han, Xie; Hua, Cong; Hunakunti, Chidambar; Jiang, Yu; Jiao, Shichao; Ke, Yuqi; Kuang, Liqun; Liu, Anan; Nguyen, Dinh-Huan; Nguyen, Hai-Dang; Nie, Weizhi; Pham, Bang-Dang; Raikar, Karthik; Tang, Qingmei; Tran, Minh-Triet; Wan, Jialong; Yan, Chenggang; You, Haoxuan; Zhu, Difei
• Is Part Of: Computers & graphics. Volume 107(2022)
• Page Start: 231
• Page End: 240
• Publication Date: 2022-10
• Subjects: SHREC'22 -- 3D Object Retrieval -- Open-Set -- Multi-Modal; Computer graphics -- Periodicals; 006.6
• DOI: 10.1016/j.cag.2022.07.020
• Languages: English
• ISSNs: 0097-8493

Abstract

Abstract: This paper reports the results of the SHREC'22 track: Open-Set 3D Object Retrieval, the goal of which is to evaluate the performance of different retrieval algorithms under the Open-Set setting and modality-missing setting, respectively. Since objects from unseen categories are very common in real-world applications, we design the open-set 3D object retrieval to expand the application of traditional 3D object retrieval. In this track, we generate open-set 3D object retrieval datasets OS-MN40 and OS-MN40-Miss based on the ModelNet40 dataset, which are collected for the open-set setting and both open-set setting and modality-missing setting, respectively. Both the two datasets include the training set (2822 objects from 8 categories) and the retrieval set (960 query objects and 8527 target objects from the other 32 categories). The categories of retrieval (query/target) sets are not seen in the training set. For each object in the OS-MN40, four types of modalities, including mesh, point cloud, multi-view, and voxel, are provided. Each object in the OS-MN40-Miss is represented with incomplete modality information, which is collected to simulate the retrieval task in the real world. This track attracted eight participants from four countries and 191 runs of all submissions. The evaluation results show a promising scenario about open-set retrieval on 3D objects with multi-modal and multi-resolution representation and reveal interesting insights in dealing with retrieving 3D objects in unknown-category objects. Graphical abstract: Highlights: This paper reports the results of the SHREC'22 track: Open-Set 3D Object Retrieval. Retrieve 3D objects with unknown categories. Multi-modal and multi-resolution 3D object retrieval. Modality miss problem in 3D object retrieval. Transfer Learning and Novelty Detection in 3D object retrieval.