Estimating model evidence using ensemble‐based data assimilation with localization – The model selection problem. (22nd March 2019)

• Record Type: Journal Article
• Authors: Metref, Sammy; Hannart, Alexis; Ruiz, Juan; Bocquet, Marc; Carrassi, Alberto; Ghil, Michael
• Is Part Of: Quarterly journal of the Royal Meteorological Society. Volume 145:Number 721(2019)
• Page Start: 1571
• Page End: 1588
• Publication Date: 2019-03-22
• Subjects: contextual model evidence -- detection and attribution -- ensemble Kalman filter -- localization -- parameter estimation; Meteorology -- Periodicals; 551.5
• DOI: 10.1002/qj.3513
• Languages: English
• ISSNs: 0035-9009

Abstract

Abstract : In recent years, there has been increased interest in applying data assimilation (DA) methods, originally designed for state estimation, to the model selection problem. In this setting, previous studies introduced the contextual formulation of model evidence, or contextual model evidence (CME), and showed that CME can be efficiently computed using a hierarchy of ensemble‐based DA procedures. Although these studies analysed the DA methods most commonly used for operational atmospheric and oceanic prediction worldwide, they did not study these methods in conjunction with localization to a specific domain. Yet, any application of ensemble DA methods to realistic, very high‐dimensional geophysical models requires the implementation of some form of localization. The present study extends CME estimation to ensemble DA methods with domain localization. Domain‐localized CME (DL‐CME) developed in this article is tested for model selection with two models: (a) the Lorenz 40‐variable midlatitude atmospheric dynamics model (Lorenz‐95); and (b) the simplified global atmospheric SPEEDY model. CME is compared to the root‐mean‐square error (RMSE) as a metric for model selection. The experiments show that CME systematically outperforms RMSE in model selection skill, and that this skill improvement is further enhanced by applying localization to the CME estimate using DL‐CME. The potential use and range of applications of CME and DL‐CME as a model selection metric are also discussed. Abstract : The present study extends the theory for estimating contextual model evidence (CME) to ensemble data assimilation methods with domain localization. Domain‐localized CME (DL‐CME) is introduced here and is used as a model selection metric against the root‐mean‐square error (RMSE). The figure shows the spatial difference between the model with correct and incorrect parameters, shown for humidity q and with an evidencing window of 6 hr, averaged over a 5‐month interval: (a) RMSE and (b) DL‐CME.