Model error covariance estimation in particle and ensemble Kalman filters using an online expectation–maximization algorithm. (2nd November 2020)

• Record Type: Journal Article
• Authors: Cocucci, Tadeo J.; Pulido, Manuel; Lucini, Magdalena; Tandeo, Pierre
• Is Part Of: Quarterly journal of the Royal Meteorological Society. Volume 147:Number 734(2021)
• Page Start: 526
• Page End: 543
• Publication Date: 2020-11-02
• Subjects: expectation‐maximization -- model error -- parameter estimation -- uncertainty quantification; Meteorology -- Periodicals; 551.5
• DOI: 10.1002/qj.3931
• Languages: English
• ISSNs: 0035-9009

Abstract

Abstract: The performance of ensemble‐based data assimilation techniques that estimate the state of a dynamical system from partial observations depends crucially on the prescribed uncertainty of the model dynamics and of the observations. These are not usually known and have to be inferred. Many approaches have been proposed to tackle this problem, including fully Bayesian, likelihood maximization and innovation‐based techniques. This work focuses on maximization of the likelihood function via the expectation–maximization (EM) algorithm to infer the model error covariance combined with ensemble Kalman filters and particle filters to estimate the state. The classical application of the EM algorithm in a data assimilation context involves filtering and smoothing a fixed batch of observations in order to complete a single iteration. This is an inconvenience when using sequential filtering in high‐dimensional applications. Motivated by this, an adaptation of the algorithm that can process observations and update the parameters on the fly, with some underlying simplifications, is presented. The proposed technique was evaluated and achieved good performance in experiments with the Lorenz‐63 and Lorenz‐96 dynamical systems designed to represent some common scenarios in data assimilation such as nonlinearity, chaoticity and model mis‐specification. Abstract : Data assimilation techniques require a good estimate of observational and model error to work properly. Optimally, these uncertainties should be inferred in an online fashion in sequential filtering. Here we propose an efficient EM‐based method to accomplish these goals. This method can be effectively coupled with particle and ensemble‐based filtering techniques.