Model-based view at multi-resolution image fusion methods and quality assessment measures. (2nd July 2016)

• Record Type: Journal Article
• Authors: Palubinskas, Gintautas
• Is Part Of: International journal of image and data fusion. Volume 7:Number 3(2016)
• Page Start: 203
• Page End: 218
• Publication Date: 2016-07-02
• Subjects: Remote sensing -- image processing -- multi-resolution image fusion -- pan-sharpening -- quality assessment -- model based; Image processing -- Periodicals; Multisensor data fusion -- Periodicals; Multisensor data fusion; Periodicals; 621.36705
• DOI: 10.1080/19479832.2016.1180326
• Languages: English
• ISSNs: 1947-9832

Abstract

ABSTRACT: We propose to look at multi-resolution image fusion or pan-sharpening task from a model-based perspective. Explicit definition of all models or assumptions used in the derivation of a fusion method allows us to understand the rationale or properties of existing methods and shows a way for a proper usage or proposal/selection of new methods better satisfying the needs of a particular application. Earlier mentioned property 'better' should be measurable quantitatively, e.g. by means of so-called quality measures. The difficulty of a quality assessment task in multi-resolution image fusion is that a reference image is missing. Existing measures or so-called protocols are still not satisfactory because quite often the rationale or assumptions are not valid or not fulfilled. From a model-based view, it follows naturally that a quality assessment measure can be defined as a combination of error model residuals using common or general models assumed in fusion methods. It is shown that most existing methods based on a spectral transformation or filtering are model-based methods. Unfortunately, it was found out that they are based additionally on a pure pixels assumption. Application of such methods for mixed pixels can lead to wrong fusion results. Model-based view analysis shows which methods respect models assumed and thus can help to select methods which deliver correct or physically justified fusion results.