Administrative Data Are Unreliable for Ranking Hospital Performance Based on Serious Complications After Spine Fusion. Issue 17 (1st September 2021)

• Record Type: Journal Article
• Authors: Greenberg, Jacob K.; Olsen, Margaret A.; Poe, John; Dibble, Christopher F.; Yamaguchi, Ken; Kelly, Michael P.; Hall, Bruce L.; Ray, Wilson Z.
• Is Part Of: Spine. Volume 46:Issue 17(2021)
• Publication Date: 2021-09-01
• Subjects: administrative billing data -- quality measures -- reliability -- spine surgery; Spine -- Abnormalities -- Periodicals; Spine -- Diseases -- Periodicals; Spine -- Surgery -- Periodicals; 616.73005
• DOI: 10.1097/BRS.0000000000004017
• Languages: English
• ISSNs: 0362-2436

Abstract

Abstract : Study Design: Retrospective analysis of administrative billing data. Objective: To evaluate the extent to which a metric of serious complications determined from administrative data can reliably profile hospital performance in spine fusion surgery. Summary of Background Data: While payers are increasingly focused on implementing pay-for-performance measures, quality metrics must reliably reflect true differences in performance among the hospitals profiled. Methods: We used State Inpatient Databases from nine states to characterize serious complications after elective cervical and thoracolumbar fusion. Hierarchical logistic regression was used to risk-adjust differences in case mix, along with variability from low case volumes. The reliability of this risk-stratified complication rate (RSCR) was assessed as the variation between hospitals that was not due to chance alone, calculated separately by fusion type and year. Finally, we estimated the proportion of hospitals that had sufficient case volumes to obtain reliable (>0.7) complication estimates. Results: From 2010 to 2017 we identified 154, 078 cervical and 213, 133 thoracolumbar fusion surgeries. 4.2% of cervical fusion patients had a serious complication, and the median RSCR increased from 4.2% in 2010 to 5.5% in 2017. The reliability of the RSCR for cervical fusion was poor and varied substantially by year (range 0.04–0.28). Overall, 7.7% of thoracolumbar fusion patients experienced a serious complication, and the RSCR varied from 6.8% to 8.0% during the study period. Although still modest, the RSCR reliability was higher for thoracolumbar fusion (range 0.16–0.43). Depending on the study year, 0% to 4.5% of hospitals had sufficient cervical fusion case volume to report reliable (>0.7) estimates, whereas 15% to 36% of hospitals reached this threshold for thoracolumbar fusion. Conclusion: A metric of serious complications was unreliable for benchmarking cervical fusion outcomes and only modestly reliable for thoracolumbar fusion. When assessed using administrative datasets, these measures appear inappropriate for high-stakes applications, such as public reporting or pay-for-performance. Level of Evidence: 3 Abstract : Supplemental Digital Content is available in the textThis analysis of administrative billing data from nine states found that a composite metric of serious complications following cervical or thoracolumbar fusion was unreliable for profiling hospital performance. Therefore, when assessed using administrative datasets, this measure appears inappropriate for high-stakes applications, such as public reporting or pay-for-performance.