Application of ASTM D6589 to evaluate dispersion model performance. (11th May 2004)

• Record Type: Journal Article
• Authors: Irwin, John S.; Carruthers, David; Stocker, Jenny; Paumier, James
• Is Part Of: International journal of environment and pollution. Volume 20:Number 1-6(2003)
• Page Start: 4
• Page End: 10
• Publication Date: 2004-05-11
• Subjects: air dispersion modelling -- statistical evaluation -- model performance; Environmental policy -- Periodicals; Environmental engineering -- Periodicals; Environmental sciences -- Periodicals; Pollution -- Periodicals; 363.73
• Languages: English
• ISSNs: 0957-4352

Abstract

During the development phase of an air quality dispersion model and in subsequent upgrades, model performance is constantly evaluated. These evaluations generally compare simulation results using simple methods that do not account for the fact that models only predict a portion of the variability seen in the observations. To fill a part of this void, the US Environmental Protection Agency (EPA) developed a standard that has been adopted by the American Society for Testing and Materials (ASTM), designation D6589 Standard Guide for the Statistical Evaluation of Atmospheric Dispersion Model Performance. Within the annex to this standard is an "example" test method that tests the ability of dispersion models to simulate the average centreline concentration. The method involves grouping observed data into groups or regimes, in which the dispersion is expected to be somewhat similar. The average centerline concentration is then derived for each group using bootstrap resampling. It is this average centreline concentration that is then compared with the modeling results. By this means, the focus is on testing the ability of models to replicate the first moment (the average) of the centreline concentration distribution, which for most operational models is the only feature in the centerline concentration distribution they are capable of simulating. This paper will focus on recent work to further test the ASTM 'example' test method. This work involved the application of the test method to the results from ADMS (version 3.1), AERMOD (versions 98022 and 02161), HPDM (version 4.3, level 920605) and ISCST3 (version 00101). Three atmospheric dispersion field studies are analysed – Prairie Grass (in 1956, rural, low level release), Kincaid (1980, rural, elevated release) and Indianapolis (1985, urban, elevated release).