Learning from mixed datasets: A monotonic image quality assessment model. Issue 3 (26th January 2023)

• Record Type: Journal Article
• Authors: Feng, Zhaopeng; Zhang, Keyang; Jia, Shuyue; Chen, Baoliang; Wang, Shiqi
• Is Part Of: Electronics letters. Volume 59:Issue 3(2023)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2023-01-26
• Subjects: image and vision processing and display technology -- image processing; Electronics -- Periodicals; 621.381
• DOI: 10.1049/ell2.12698
• Languages: English
• ISSNs: 0013-5194

Abstract

Abstract: Deep learning based image quality assessment models usually learn to predict image quality from a single dataset, leading the model to overfit specific scenes. To account for this, mixed datasets training can be an effective way to enhance the generalization capability of the model. However, it is nontrivial to combine different image quality assessment datasets, as their quality evaluation criteria, score ranges, view conditions, as well as subjects are usually not shared during the image quality annotation. Instead of aligning the annotations, this paper proposes a monotonic neural network for image quality assessment model learning with different datasets combined. In particular, this model consists of a dataset‐shared quality regressor and several dataset‐specific quality transformers. The quality regressor aims to obtain the perceptual quality of each image of each dataset and the quality transformer maps the perceptual quality to the corresponding annotation monotonically. The experimental results verify the effectiveness of the proposed learning strategy and the code is available at https://github.com/fzp0424/MonotonicIQA . Abstract : We propose a monotonic neural network for IQA model learning with different datasets combined, getting rid of the laborious quality annotation alignment. Our model consists of a dataset‐shared quality regressor and several dataset‐specific quality transformers. The quality regressor aims to obtain the perceptual qualities of each dataset while each quality transformer maps the perceptual qualities to the corresponding dataset annotations with their monotonicity maintained.