Nonlinear kernel based feature maps for blur‐sensitive unsharp masking of JPEG images. Issue 4 (23rd November 2022)

• Record Type: Journal Article
• Authors: Bhattacharya, Jhilik; Marsi, Stefano; Ramponi, Giovanni
• Is Part Of: IET image processing. Volume 17:Issue 4(2023)
• Page Start: 1010
• Page End: 1028
• Publication Date: 2022-11-23
• Subjects: blur analysis -- deep learning -- image enhancement -- JPEG artifact detection; Image processing -- Periodicals; 621.36705
• DOI: 10.1049/ipr2.12692
• Languages: English
• ISSNs: 1751-9659

Abstract

Abstract: In this paper, a method for estimating the blur regions of an image is first proposed, resorting to a mixture of linear and nonlinear convolutional kernels. The blur map obtained is then utilized to enhance images such that the enhancement strength is an inverse function of the amount of measured blur. The blur map can also be used for tasks such as attention‐based object classification, low light image enhancement, and more. A CNN architecture is trained with nonlinear upsampling layers using a standard blur detection benchmark dataset, with the help of blur target maps. Further, it is proposed to use the same architecture to build maps of areas affected by the typical JPEG artifacts, ringing and blockiness. The blur map and the artifact map pair permit to build an activation map for the enhancement of a (possibly JPEG compressed) image. Extensive experiments on standard test images verify the quality of the maps obtained using the algorithm and their effectiveness in locally controlling the enhancement, for superior perceptual quality. Last but not least, the computation time for generating these maps is much lower than the one of other comparable algorithms. Abstract : We first propose a method for estimating the blur regions of an image, resorting to a mixture of linear and nonlinear convolutional kernels. The blur map we obtain is then utilized to enhance images such that the enhancement strength is an inverse function of the amount of measured blur. The blur map can also be used for tasks such as attention‐based object classification, low light image enhancement, and more.