Argument-based assessment of predictive uncertainty of data-driven environmental models. (December 2020)

• Record Type: Journal Article
• Authors: Knüsel, Benedikt; Baumberger, Christoph; Zumwald, Marius; Bresch, David N.; Knutti, Reto
• Is Part Of: Environmental modelling & software. Volume 134(2020)
• Publication Date: 2020-12
• Subjects: Uncertainty -- Data-driven models -- Argument analysis -- Predictions -- Decision-making; Environmental monitoring -- Computer programs -- Periodicals; Ecology -- Computer simulation -- Periodicals; Digital computer simulation -- Periodicals; Computer software -- Periodicals; Environmental Monitoring -- Periodicals; Computer Simulation -- Periodicals; Environnement -- Surveillance -- Logiciels -- Périodiques; Écologie -- Simulation, Méthodes de -- Périodiques; Simulation par ordinateur -- Périodiques; Logiciels -- Périodiques; Computer software; Digital computer simulation; Ecology -- Computer simulation; Environmental monitoring -- Computer programs; Periodicals; Electronic journals; 363.70015118
• DOI: 10.1016/j.envsoft.2020.104754
• Languages: English
• ISSNs: 1364-8152

Abstract

Abstract: Increasing volumes of data allow environmental scientists to use machine learning to construct data-driven models of phenomena. These models can provide decision-relevant predictions, but confident decision-making requires that the involved uncertainties are understood. We argue that existing frameworks for characterizing uncertainties are not appropriate for data-driven models because of their focus on distinct locations of uncertainty. We propose a framework for uncertainty assessment that uses argument analysis to assess the justification of the assumption that the model is fit for the predictive purpose at hand. Its flexibility makes the framework applicable to data-driven models. The framework is illustrated using a case study from environmental science. We show that data-driven models can be subject to substantial second-order uncertainty, i.e., uncertainty in the assessment of the predictive uncertainty, because they are often applied to ill-understood problems. We close by discussing the implications of the predictive uncertainties of data-driven models for decision-making. Highlights: Discusses the predictive uncertainty of data-driven environmental models. Shows that existing frameworks are not informative for this task. Introduces a new framework based on argument analysis. Illustrates how to apply the framework to a case study from environmental science.