FIMF score‐CAM: Fast score‐CAM based on local multi‐feature integration for visual interpretation of CNNS. Issue 3 (8th December 2022)

• Record Type: Journal Article
• Authors: Li, Jing; Zhang, Dongbo; Meng, Bumin; Li, Yongxing; Luo, Lufeng
• Is Part Of: IET image processing. Volume 17:Issue 3(2023)
• Page Start: 761
• Page End: 772
• Publication Date: 2022-12-08
• Subjects: class activation mapping -- computer vision -- deep network -- model interpretation; Image processing -- Periodicals; 621.36705
• DOI: 10.1049/ipr2.12670
• Languages: English
• ISSNs: 1751-9659

Abstract

Abstract: The interpretability of the model is a hot issue in the field of computer vision. Score‐CAM is a kind of interpretable CAM method with good discrimination and gradient free calculation. It is a representative work in this field. However, it has the disadvantages of long calculation time and incomplete heatmap coverage. Therefore, this paper proposes an improved Score‐CAM method named FIMF Score‐CAM, which can fast integrate multiple features. Its contribution is reflected in two aspects: The weight of the feature map is directly calculated by using the feature template. Unlike Score‐CAM, this model greatly saves computation time because it only requires one convolutional calculation. Another contribution is that the feature map used to generate the heatmap integrates various semantic features of the local space, so that the heatmap of the object of interest can be generated with more complete coverage and better interpretation. The FIMF Score‐CAM is superior to the existing mainstream models in interpreting the visual performance and fairness indicators of the decision‐making, having more complete explanations of object classes and the advantage of faster calculation speed.