Statistical Benchmarks for Health Care Provider Performance Assessment: A Comparison of Standard Approaches to a Hierarchical Bayesian Histogram‐Based Method. (24th January 2014)

• Record Type: Journal Article
• Authors: Paddock, Susan M.
• Is Part Of: Health services research. Volume 49:Number 3(2014)
• Page Start: 1056
• Page End: 1073
• Publication Date: 2014-01-24
• Subjects: Medical care -- Periodicals; Medical care -- Evaluation -- Periodicals; Hospital care -- Periodicals; Health services administration -- Periodicals; 362
• DOI: 10.1111/1475-6773.12149
• Languages: English
• ISSNs: 0017-9124

Abstract

<abstract abstract-type="main" id="hesr12149-abs-0001"> <title> <x xml:space="preserve">Abstract</x> </title> <sec id="hesr12149-sec-0001" sec-type="section"> <title>Objective</title> <p>Examine how widely used statistical benchmarks of health care provider performance compare with histogram‐based statistical benchmarks obtained via hierarchical Bayesian modeling.</p> </sec> <sec id="hesr12149-sec-0002" sec-type="section"> <title>Data Sources</title> <p>Publicly available data from 3, 240 hospitals during April 2009–March 2010 on two process‐of‐care measures reported on the Medicare Hospital Compare website.</p> </sec> <sec id="hesr12149-sec-0003" sec-type="section"> <title>Study Design</title> <p>Secondary data analyses of two process‐of‐care measures comparing statistical benchmark estimates and threshold exceedance determinations under various combinations of hospital performance measure estimates and benchmarking approaches.</p> </sec> <sec id="hesr12149-sec-0004" sec-type="section"> <title>Principal Findings</title> <p>Statistical benchmarking approaches for determining top 10 percent performance varied with respect to which hospitals exceeded the performance benchmark; such differences were not found at the 50 percent threshold. Benchmarks derived from the histogram of provider performance under hierarchical Bayesian modeling provide a compromise between benchmarks based on direct (raw) estimates, which are overdispersed relative to the true distribution of provider performance and prone to high variance for small providers, and posterior mean provider performance, for which over‐shrinkage and under‐dispersion relative to the true provider performance distribution is a concern.</p> </sec> <sec id="hesr12149-sec-0005" sec-type="section"> <title>Conclusions</title> <p>Given the rewards and penalties associated with characterizing top performance, the ability of statistical benchmarks to summarize key features of the provider performance distribution should be examined.</p> </sec> </abstract>