Fine-tuning deep convolutional neural networks for distinguishing illustrations from photographs. (30th December 2016)

• Record Type: Journal Article
• Authors: Gando, Gota; Yamada, Taiga; Sato, Haruhiko; Oyama, Satoshi; Kurihara, Masahito
• Is Part Of: Expert systems with applications. Volume 66(2016)
• Page Start: 295
• Page End: 301
• Publication Date: 2016-12-30
• Subjects: Aggregation systems -- Machine learning -- Deep learning -- Illustrations; Expert systems (Computer science) -- Periodicals; Systèmes experts (Informatique) -- Périodiques; Electronic journals; 006.33
• DOI: 10.1016/j.eswa.2016.08.057
• Languages: English
• ISSNs: 0957-4174

Abstract

Highlights: Automatically detecting illustrations is needed for the target system. Deep Convolutional Neural Networks have been successful in computer vision tasks. DCNN with fine-tuning outperformed the other models including handcrafted features. Abstract: Systems for aggregating illustrations require a function for automatically distinguishing illustrations from photographs as they crawl the network to collect images. A previous attempt to implement this functionality by designing basic features that were deemed useful for classification achieved an accuracy of only about 58%. On the other hand, deep neural networks had been successful in computer vision tasks, and convolutional neural networks (CNNs) had performed good at extracting such useful image features automatically. We evaluated alternative methods to implement this classification functionality with focus on deep neural networks. As the result of experiments, the method that fine-tuned deep convolutional neural network (DCNN) acquired 96.8% accuracy, outperforming the other models including the custom CNN models that were trained from scratch. We conclude that DCNN with fine-tuning is the best method for implementing a function for automatically distinguishing illustrations from photographs.