User‐guided global explanations for deep image recognition: A user study. Issue 4 (6th December 2021)

• Record Type: Journal Article
• Authors: Hamidi‐Haines, Mandana; Qi, Zhongang; Fern, Alan; Li, Fuxin; Tadepalli, Prasad
• Other Names: Gunning Dave guestEditor.; Vorm Eric guestEditor.; Wang Jennifer Yunyan guestEditor.; Turek Matt guestEditor.
• Is Part Of: Applied AI Letters. Volume 2:Issue 4(2021)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2021-12-06
• Subjects: computer vision -- explainable AI -- human‐computer interaction; 006.3
• DOI: 10.1002/ail2.42
• Languages: English
• ISSNs: 2689-5595

Abstract

Abstract: We study a user‐guided approach for producing global explanations of deep networks for image recognition. The global explanations are produced with respect to a test data set and give the overall frequency of different "recognition reasons" across the data. Each reason corresponds to a small number of the most significant human‐recognizable visual concepts used by the network. The key challenge is that the visual concepts cannot be predetermined and those concepts will often not correspond to existing vocabulary or have labeled data sets. We address this issue via an interactive‐naming interface, which allows users to freely cluster significant image regions in the data into visually similar concepts. Our main contribution is a user study on two visual recognition tasks. The results show that the participants were able to produce a small number of visual concepts sufficient for explanation and that there was significant agreement among the concepts, and hence global explanations, produced by different participants. Abstract : The interactive naming process allows users to attach meaningful semantics to image parts used by a deep neural network and to form explanations in terms of those parts.