A review on multimodal zero‐shot learning. (20th January 2023)

• Record Type: Journal Article
• Authors: Cao, Weipeng; Wu, Yuhao; Sun, Yixuan; Zhang, Haigang; Ren, Jin; Gu, Dujuan; Wang, Xingkai
• Is Part Of: Wiley interdisciplinary reviews. Volume 13:Number 2(2023)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2023-01-20
• Subjects: feature fusion -- feature representation -- multimodal learning -- multimodal ZSL -- zero‐shot learning; Data mining -- Periodicals; 006.31205
• DOI: 10.1002/widm.1488
• Languages: English
• ISSNs: 1942-4787

Abstract

Abstract: Multimodal learning provides a path to fully utilize all types of information related to the modeling target to provide the model with a global vision. Zero‐shot learning (ZSL) is a general solution for incorporating prior knowledge into data‐driven models and achieving accurate class identification. The combination of the two, known as multimodal ZSL (MZSL), can fully exploit the advantages of both technologies and is expected to produce models with greater generalization ability. However, the MZSL algorithms and applications have not yet been thoroughly investigated and summarized. This study fills this gap by providing an objective overview of MZSL's definition, typical algorithms, representative applications, and critical issues. This article will not only provide researchers in this field with a comprehensive perspective, but it will also highlight several promising research directions. This article is categorized under: Algorithmic Development > Multimedia Technologies > Classification Technologies > Machine Learning Abstract : The framework of the survey on Multi‐modal Zero‐Shot Learning