Ancient Mural Classification Method Based on Improved AlexNet Network. (2nd October 2020)

• Record Type: Journal Article
• Authors: Cao, Jianfang; Cui, Hongyan; Zhang, Qi; Zhang, Zibang
• Is Part Of: Studies in conservation. Volume 65:Number 7(2020)
• Page Start: 411
• Page End: 423
• Publication Date: 2020-10-02
• Subjects: Mural classification -- feature fusion -- AlexNet model -- convolutional neural network -- mural dataset; Art objects -- Conservation and restoration -- Periodicals; 700.288
• DOI: 10.1080/00393630.2019.1706304
• Languages: English
• ISSNs: 0039-3630

Abstract

ABSTRACT: As an important part of art and culture, ancient murals depict a variety of different artistic images, and these individual images have important research value. For research purposes, it is often important to first determine the type of objects represented in a painting. However, the mural painting environment makes datasets difficult to collect, and long-term exposure leads to underlying features that are not distinct, which makes this task challenging. This study proposes a convolutional neural network model based on the classic AlexNet network model and combines it with feature fusion to automatically classify ancient mural images. Due to the lack of large-scale mural datasets, the model first expands the dataset by applying image enhancement algorithms such as scaling, brightness conversion, noise addition, and flipping; then, it extracts the underlying features (such as fresco edges) shared by the first stage of a dual channel structure. Subsequently, a second-stage deep abstraction is conducted on the features extracted by the first stage using a two-channel network, each of which has a different structure. The obtained characteristics from both channels are merged, and a loss function is constructed to obtain the classification result. This approach improves the model's robustness and feature expression ability. The model achieves an accuracy of 84.24%, a recall rate of 84.15%, and an F1-measure of 84.13% when applied to a constructed mural image dataset. Compared with the AlexNet model and other improved convolutional neural network models, the proposed model improves each evaluation index by approximately 5%, verifying the rationality and effectiveness of the model for automatic mural image classification. The mural classification model proposed in this paper comprehensively considers the influences of network width and depth and can extract rich details from mural images from multiple local channels. An effective classification method could help researchers manage and protect mural images in an orderly fashion and quickly and effectively search for target images in a digital mural library based on a specified image category, aiding mural condition monitoring and restoration efforts as well as archaeological and art historical research.