Dynamic error spectrum for estimation performance evaluation: a case study on interacting multiple model algorithm. Issue 2 (1st April 2014)

• Record Type: Journal Article
• Authors: Mao, Yanhui; Han, Chongzhao; Duan, Zhansheng
• Is Part Of: IET signal processing. Volume 8:Issue 2(2014)
• Page Start: 202
• Page End: 210
• Publication Date: 2014-04-01
• Subjects: estimation theory -- mean square error methods; dynamic error spectrum -- estimation performance -- multiple model algorithm -- root‐mean‐square error -- performance evaluation -- dynamic systems -- interacting multiple model algorithm -- IMM algorithm -- DES metric; Signal processing -- Periodicals; 621.3822
• DOI: 10.1049/iet-spr.2013.0134
• Languages: English
• ISSNs: 1751-9675

Abstract

Abstract : The commonly used root‐mean‐square error for estimation performance evaluation is easily dominated by large error terms. So many new alternative absolute metrics have been provided in X. R. Li's work. However, each of these metrics only reflects one narrow aspect of estimation performance, respectively. A comprehensive measure, error spectrum, was presented aggregating all these incomprehensive measures. However, when being applied to dynamic systems, this measure will have three dimensions over the total time span, which is not intuitive and difficult to be analysed. To overcome its drawbacks, a new metric, dynamic error spectrum (DES), is proposed in this study to extend the error spectrum measure to dynamic systems. Three forms under different application backgrounds are given, one of which is balanced taking into account both good and bad behaviour of an estimator and so can provide more impartial evaluation results. It can be applied to a variety of dynamic systems directly. Then the challenge in performance evaluation of the interacting multiple model (IMM) algorithm is considered, and the IMM algorithm is chosen as the testing case to illustrate the superiority of the DES metric. The simulation results validate its utility and effectiveness.