Assessing the representational accuracy of data-driven models: The case of the effect of urban green infrastructure on temperature. (July 2021)

• Record Type: Journal Article
• Authors: Zumwald, Marius; Baumberger, Christoph; Bresch, David N.; Knutti, Reto
• Is Part Of: Environmental modelling & software. Volume 141(2021)
• Publication Date: 2021-07
• Subjects: Urban heat -- Machine learning -- Representational accuracy -- Interpretable machine learning -- Data-driven modelling; Environmental monitoring -- Computer programs -- Periodicals; Ecology -- Computer simulation -- Periodicals; Digital computer simulation -- Periodicals; Computer software -- Periodicals; Environmental Monitoring -- Periodicals; Computer Simulation -- Periodicals; Environnement -- Surveillance -- Logiciels -- Périodiques; Écologie -- Simulation, Méthodes de -- Périodiques; Simulation par ordinateur -- Périodiques; Logiciels -- Périodiques; Computer software; Digital computer simulation; Ecology -- Computer simulation; Environmental monitoring -- Computer programs; Periodicals; Electronic journals; 363.70015118
• DOI: 10.1016/j.envsoft.2021.105048
• Languages: English
• ISSNs: 1364-8152

Abstract

Abstract: Data-driven modelling with machine learning (ML) is already being used for predictions in environmental science. However, it is less clear to what extent data-driven models that successfully predict a phenomenon are representationally accurate and thus increase our understanding of the phenomenon. Besides empirical accuracy, we propose three criteria to indirectly assess the relationships learned by the ML algorithms and how they relate to a phenomenon under investigation: first, consistency of the outcomes with background knowledge; second, the adequacy of the measurements, datasets and methods used to construct a data-driven model; third, the robustness of interpretable machine learning analyses across different ML algorithms. We apply the three criteria with a case study modelling of the effect of different urban green infrastructure types on temperature and show that our approach improves the assessment of representational accuracy and reduces representational uncertainty, which can improve the understanding of modelled phenomena. Highlights: Discusses representational accuracy of data-driven models. Highlights relevance of representational accuracy for understanding phenomena. Introduces approach to assess representational accuracy of data-driven models. Applies the approach on a case study modelling urban heat distribution.