Cluster‐Based Evaluation of Model Compensating Errors: A Case Study of Cloud Radiative Effect in the Southern Ocean. Issue 6 (28th March 2019)

• Record Type: Journal Article
• Authors: Schuddeboom, Alex; Varma, Vidya; McDonald, Adrian J.; Morgenstern, Olaf; Harvey, Mike; Parsons, Simon; Field, Paul; Furtado, Kalli
• Is Part Of: Geophysical research letters. Volume 46:Issue 6(2019)
• Page Start: 3446
• Page End: 3453
• Publication Date: 2019-03-28
• Subjects: model evaluation -- cloud simulation -- Southern Ocean -- compensating errors; Geophysics -- Periodicals; Planets -- Periodicals; Lunar geology -- Periodicals; 550
• DOI: 10.1029/2018GL081686
• Languages: English
• ISSNs: 0094-8276

Abstract

Abstract: Model evaluation is difficult and generally relies on analysis that can mask compensating errors. This paper defines new metrics, using clusters generated from a machine learning algorithm, to estimate mean and compensating errors in different model runs. As a test case, we investigate the Southern Ocean shortwave radiative bias using clusters derived by applying self‐organizing maps to satellite data. In particular, the effects of changing cloud phase parameterizations in the MetOffice Unified Model are examined. Differences in cluster properties show that the regional radiative biases are substantially different than the global bias, with two distinct regions identified within the Southern Ocean, each with a different signed bias. Changing cloud phase parameterizations can reduce errors at higher latitudes but increase errors at lower latitudes of the Southern Ocean. Ranking the parameterizations often shows a contrast in mean and compensating errors, notably in all cases large compensating errors remain. Key Points: A novel method for climate model evaluation is used to identify both mean errors and potential compensating errors As an example, we apply this methodology to investigate the quality of different cloud parameterizations over the Southern Ocean Changes to the cloud phase parameterizations can reduce shortwave radiative bias regionally, but large compensating errors remain