A modified F-test for evaluating model performance by including both experimental and simulation uncertainties. (June 2018)

• Record Type: Journal Article
• Authors: Sima, Nathan Q.; Harmel, R. Daren; Fang, Quan X.; Ma, Liwang; Andales, Allan A.
• Is Part Of: Environmental modelling & software. Volume 104(2018)
• Page Start: 236
• Page End: 248
• Publication Date: 2018-06
• Subjects: Uncertainty -- Model calibration -- RZWQM -- F-test -- Goodness of fit -- Maize; Environmental monitoring -- Computer programs -- Periodicals; Ecology -- Computer simulation -- Periodicals; Digital computer simulation -- Periodicals; Computer software -- Periodicals; Environmental Monitoring -- Periodicals; Computer Simulation -- Periodicals; Environnement -- Surveillance -- Logiciels -- Périodiques; Écologie -- Simulation, Méthodes de -- Périodiques; Simulation par ordinateur -- Périodiques; Logiciels -- Périodiques; Computer software; Digital computer simulation; Ecology -- Computer simulation; Environmental monitoring -- Computer programs; Periodicals; Electronic journals; 363.70015118
• DOI: 10.1016/j.envsoft.2018.03.011
• Languages: English
• ISSNs: 1364-8152

Abstract

Abstract: Experimental and simulation uncertainties have not been included in many of the statistics used in assessing agricultural model performance. The objectives of this study were to develop an F-test that can be used to evaluate model performance considering experimental and simulation uncertainties, and identify the best datasets to use for model calibration using different water stress functions in a cropping system model. Data on irrigated maize in Colorado, USA, and the Root Zone Water Quality Model (RZWQM) were used as an example to demonstrate model calibration using the modified F-test along with other commonly used statistics. Compared to the d-index, the F-test provided a statistical test under a certain confidence level that better distinguished the goodness of model prediction for both biomass and yield while considering uncertainty. To obtain robust model parameters, we recommend using multiple treatments across multiple years for model calibration, regardless of water stress functions used. Highlights: A modified F-test that considers both experimental and simulation uncertainties was developed. The modified F-test was more objective in evaluating model performance based on test cases. Data from multiple treatments across multiple years are recommended for obtaining more robust model parameters.