Explainable deep convolutional learning for intuitive model development by non–machine learning domain experts. (2020)

• Record Type: Journal Article
• Authors: Singaravel, Sundaravelpandian; Suykens, Johan; Janssen, Hans; Geyer, Philipp
• Is Part Of: Design science. Volume 6(2020)
• Publication Date: 2020
• Subjects: model exploration, -- design space representation, -- reasoning; Design -- Research -- Periodicals; New products -- Management -- Periodicals; Design; Design -- Research; Electronic journals; Periodicals; 658.5752
• DOI: 10.1017/dsj.2020.22
• Languages: English
• ISSNs: 2053-4701

Abstract

Abstract: During the design stage, quick and accurate predictions are required for effective design decisions. Model developers prefer simple interpretable models for high computation speed. Given that deep learning (DL) has high computational speed and accuracy, it will be beneficial if these models are explainable. Furthermore, current DL development tools simplify the model development process. The article proposes a method to make the learning of the DL model explainable to enable non–machine learning (ML) experts to infer on model generalization and reusability. The proposed method utilizes dimensionality reduction (t-Distribution Stochastic Neighbour Embedding) and mutual information (MI). Results indicate that the convolutional layers capture design-related interpretations, and the fully connected layer captures performance-related interpretations. Furthermore, the global geometric structure within a model that generalized well and poorly is similar. The key difference indicating poor generalization is smoothness in the low-dimensional embedding. MI enables quantifying the reason for good and poor generalization. Such interpretation adds more information on model behaviour to a non-ML expert.