A review of performance criteria to validate simulation models. Issue 5 (14th May 2015)

• Record Type: Journal Article
• Authors: Hora, Joana; Campos, Pedro
• Is Part Of: Expert systems. Volume 32:Issue 5(2015)
• Page Start: 578
• Page End: 595
• Publication Date: 2015-05-14
• Subjects: Expert systems (Computer science); 006.33
• DOI: 10.1111/exsy.12111
• Languages: English
• ISSNs: 0266-4720

Abstract

<abstract abstract-type="main"> <title>Abstract</title> <p>This study reviews performance criteria adequate to validate simulation models through the comparison of two quantitative data sets, concerning historical and simulated data. The criteria reviewed were organized according to its characteristics into the groups: error‐based measures, information theory measures, information criteria, parametric tests, non‐parametric tests, distance‐based measures and combined measures. Each criterion is reviewed through its mathematic definition, its applications in literature and the identification of its advantages and drawbacks. The features assessed by each criterion are identified and discussed. This study provides a concise outline over the criteria reviewed, which can be used as a guide to help developers of simulation models into the decision on the most appropriate criteria to validate their models.</p> </abstract>