Replication of an agent-based model using the Replication Standard. (May 2021)

• Record Type: Journal Article
• Authors: Zhang, Jiaxin; Robinson, Derek T.
• Is Part Of: Environmental modelling & software. Volume 139(2021)
• Publication Date: 2021-05
• Subjects: Model replication -- Agent-based modelling -- Replication Standard -- Verification; Environmental monitoring -- Computer programs -- Periodicals; Ecology -- Computer simulation -- Periodicals; Digital computer simulation -- Periodicals; Computer software -- Periodicals; Environmental Monitoring -- Periodicals; Computer Simulation -- Periodicals; Environnement -- Surveillance -- Logiciels -- Périodiques; Écologie -- Simulation, Méthodes de -- Périodiques; Simulation par ordinateur -- Périodiques; Logiciels -- Périodiques; Computer software; Digital computer simulation; Ecology -- Computer simulation; Environmental monitoring -- Computer programs; Periodicals; Electronic journals; 363.70015118
• DOI: 10.1016/j.envsoft.2021.105016
• Languages: English
• ISSNs: 1364-8152

Abstract

Abstract: Despite the critical role that replication plays in the advancement of science, its presence in modelling literature is rare. To encourage others to conduct replication and report success and challenges that facilitate or hinder replication, we present the replication of an agent-based model (ABM) of residential sprawl using the Replication Standard. Replication results achieved relational equivalence. Through the replication process, issues with the original research were identified and corrected in an Improved model, which qualitatively supported original results. A specific challenge affecting alignment of original and Replicate models included capturing model output variability and publishing all original output data for statistical analysis. Through the replication of agent-based models, additional confidence in model behaviour can be garnered and replicated ABMs can become accredited for reuse by others. Future research in the development and refinement of replication methodology and assessments should be cultivated along with a culture of value for replication efforts. Highlights: The relevance and need for model replication is discussed. A methodology for model replication is presented. A case study illustrates application of the replication methodology. Replicate model outcomes are assessed using the Replication Standard. Replication challenges are highlighted and future directions suggested.