The Sequential Probability Ratio Test: An efficient alternative to exact binomial testing for Clean Water Act 303(d) evaluation. (1st May 2017)

• Record Type: Journal Article
• Authors: Chen, Connie; Gribble, Matthew O.; Bartroff, Jay; Bay, Steven M.; Goldstein, Larry
• Is Part Of: Journal of environmental management. Volume 192(2017)
• Page Start: 89
• Page End: 93
• Publication Date: 2017-05-01
• Subjects: Sequential probability ratio test -- Water quality -- Clean water act -- Study design -- Sediment quality objectives; Environmental policy -- Periodicals; Environmental management -- Periodicals; Environment -- Periodicals; Ecology -- Periodicals; 363.705
• DOI: 10.1016/j.jenvman.2017.01.039
• Languages: English
• ISSNs: 0301-4797

Abstract

Abstract: The United States's Clean Water Act stipulates in section 303(d) that states must identify impaired water bodies for which total maximum daily loads (TMDLs) of pollution inputs into water bodies are developed. Decision-making procedures about how to list, or delist, water bodies as impaired, or not, per Clean Water Act 303(d) differ across states. In states such as California, whether or not a particular monitoring sample suggests that water quality is impaired can be regarded as a binary outcome variable, and California's current regulatory framework invokes a version of the exact binomial test to consolidate evidence across samples and assess whether the overall water body complies with the Clean Water Act. Here, we contrast the performance of California's exact binomial test with one potential alternative, the Sequential Probability Ratio Test (SPRT). The SPRT uses a sequential testing framework, testing samples as they become available and evaluating evidence as it emerges, rather than measuring all the samples and calculating a test statistic at the end of the data collection process. Through simulations and theoretical derivations, we demonstrate that the SPRT on average requires fewer samples to be measured to have comparable Type I and Type II error rates as the current fixed-sample binomial test. Policymakers might consider efficient alternatives such as SPRT to current procedure. Graphical abstract: Highlights: Sequential Probability Ratio Test (SPRT) can mimic assumptions of California's test. SPRT needs fewer samples, on average, to obtain similar Type I and Type II errors. Sequential testing procedures may offer an efficient alternative to current methods.