Neural aesthetic image reviewer. Issue 8 (28th November 2019)

• Record Type: Journal Article
• Authors: Wang, Wenshan; Yang, Su; Zhang, Weishan; Zhang, Jiulong
• Is Part Of: IET computer vision. Volume 13:Issue 8(2019)
• Page Start: 749
• Page End: 758
• Publication Date: 2019-11-28
• Subjects: regression analysis -- image processing -- feature extraction -- image classification -- learning (artificial intelligence); Neural aesthetic image reviewer -- image aesthetics -- high- score -- low-aesthetic score -- Neural Aesthetic Image Reviewer -- plausible rating score -- shared aesthetically semantic layers -- AVA-Reviews dataset -- aesthetic images; Computer vision -- Periodicals; Pattern recognition systems -- Periodicals; 006.37
• DOI: 10.1049/iet-cvi.2019.0361
• Languages: English
• ISSNs: 1751-9632

Abstract

Abstract : Recently, there is a rising interest in perceiving image aesthetics. The existing works deal with image aesthetics as a classification or regression problem. To extend the cognition from rating to reasoning, a deeper understanding of aesthetics should be based on revealing why a high‐ or low‐aesthetic score should be assigned to an image. From such a point of view, the authors propose a model referred to as Neural Aesthetic Image Reviewer, which can not only give an aesthetic score for an image, but also generate a textual description explaining why the image leads to a plausible rating score. Specifically, they propose three models based on shared aesthetically semantic layers and task‐specific embedding layers at a high level for performance improvement on different tasks. To facilitate researches on this problem, they collect the AVA‐Reviews dataset, which contains 52, 118 images and 312, 708 comments in total. Through multi‐task learning, the proposed models can rate aesthetic images as well as produce comments in an end‐to‐end manner. It is confirmed that the proposed models outperform the baselines according to the performance evaluation on the AVA‐Reviews dataset. Moreover, they demonstrate experimentally that the authors' model can generate textual reviews related to aesthetics, which are consistent with human perception.