Robust Evaluation of ENSO in Climate Models: How Many Ensemble Members Are Needed?. Issue 20 (19th October 2021)

• Record Type: Journal Article
• Authors: Lee, Jiwoo; Planton, Yann Y.; Gleckler, Peter J.; Sperber, Kenneth R.; Guilyardi, Eric; Wittenberg, Andrew T.; McPhaden, Michael J.; Pallotta, Giuliana
• Is Part Of: Geophysical research letters. Volume 48:Issue 20(2021)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2021-10-19
• Subjects: ENSO -- CMIP6 -- large ensemble -- CLIVAR ENSO metrics -- PCMDI metrics package (PMP) -- Monte‐Carlo sampling; Geophysics -- Periodicals; Planets -- Periodicals; Lunar geology -- Periodicals; 550
• DOI: 10.1029/2021GL095041
• Languages: English
• ISSNs: 0094-8276

Abstract

Abstract: Large ensembles of model simulations require considerable resources, and thus defining an appropriate ensemble size for a particular application is an important experimental design criterion. We estimate the ensemble size ( N ) needed to assess a model's ability to capture observed El Niño‐Southern Oscillation (ENSO) behavior by utilizing the recently developed International CLIVAR ENSO Metrics Package. Using the larger ensembles available from CMIP6 and the US CLIVAR Large Ensemble Working Group, we find that larger ensembles are needed to robustly capture baseline ENSO characteristics ( N > 50) and physical processes ( N > 50) than the background climatology ( N ≥ 12) and remote ENSO teleconnections ( N ≥ 6). While these results vary somewhat across metrics and models, our study quantifies how larger ensembles are required to robustly evaluate simulated ENSO behavior, thereby providing some guidance for the design of model ensembles. Plain Language Summary: To account for uncertainties arising from the chaotic nature of the climate system, Earth system models are often used to generate a large number of simulations under slightly different initial conditions. These large ensembles enable the consistency between models and observations to be addressed while accounting for the internal variability in the climate system. Creating a set of ensemble simulations requires substantial resources, and so in this study we diagnose what ensemble size is sufficient to robustly represent the simulated behavior of the El Niño/Southern Oscillation (ENSO), one of the most important modes of variability affecting climate worldwide. Key Points: To estimate the ensemble size required to characterize the ENSO simulation, ensemble members of CMIP6 and Large Ensemble models are analyzed A broad range in the relative performance of models exists with internal variability influencing the robustness of some ENSO characteristics The required ensemble size depends on metric, duration of observational record, and model; the size can be a small as 6 or greater than 50