A system of metrics for the assessment and improvement of aquatic ecosystem models. (June 2020)

• Record Type: Journal Article
• Authors: Hipsey, Matthew R.; Gal, Gideon; Arhonditsis, George B.; Carey, Cayelan C.; Elliott, J. Alex; Frassl, Marieke A.; Janse, Jan H.; de Mora, Lee; Robson, Barbara J.
• Is Part Of: Environmental modelling & software. Volume 128(2020)
• Publication Date: 2020-06
• Subjects: AEM -- CSPS -- Ecological modelling -- Uncertainty -- Water quality -- Freshwater -- Marine; Environmental monitoring -- Computer programs -- Periodicals; Ecology -- Computer simulation -- Periodicals; Digital computer simulation -- Periodicals; Computer software -- Periodicals; Environmental Monitoring -- Periodicals; Computer Simulation -- Periodicals; Environnement -- Surveillance -- Logiciels -- Périodiques; Écologie -- Simulation, Méthodes de -- Périodiques; Simulation par ordinateur -- Périodiques; Logiciels -- Périodiques; Computer software; Digital computer simulation; Ecology -- Computer simulation; Environmental monitoring -- Computer programs; Periodicals; Electronic journals; 363.70015118
• DOI: 10.1016/j.envsoft.2020.104697
• Languages: English
• ISSNs: 1364-8152

Abstract

Abstract: In this paper, we introduce the CSPS framework for the hierarchical assessment of aquatic ecosystem models built on a range of metrics and characteristic signatures relevant to aquatic ecosystem condition. The framework is comprised of four levels: 0) conceptual validation; 1) comparison of simulated state variables with observations ('state validation'); 2) comparison of fluxes with measured process rates ('process validation'); and 3) assessment of system-level emergent properties, patterns and relationships ('system validation'). Of these, only levels 0 and 1 are routinely undertaken at present. To highlight a diverse range of contexts relevant to the aquatic ecosystem modelling community, we present several case studies of improved validation approaches using the level 0–3 assessment hierarchy. We envision that the community–driven adoption of these metrics will lead to more rigorously assessed models, ultimately accelerating advances in model structure and function, and improved confidence in model predictions. Graphical abstract: Image 1 Highlights: A hierarchical framework for advanced assessment of Aquatic Ecosystem Models (AEMs) is described. The framework challenges modellers to test AEMs across a diversity of standard and higher validation metrics. We distinguish between "state validation", "process validation" and "system validation". A catalogue of example metrics is presented to guide users for different application contexts.