An Empirical Comparison of Tree‐Based Methods for Propensity Score Estimation. (23rd May 2013)

• Record Type: Journal Article
• Authors: Watkins, Stephanie; Jonsson‐Funk, Michele; Brookhart, M. Alan; Rosenberg, Steven A.; O'Shea, T. Michael; Daniels, Julie
• Is Part Of: Health services research. Volume 48:Number 5(2013:Oct.)
• Page Start: 1798
• Page End: 1817
• Publication Date: 2013-05-23
• Subjects: Medical care -- Periodicals; Medical care -- Evaluation -- Periodicals; Hospital care -- Periodicals; Health services administration -- Periodicals; 362
• DOI: 10.1111/1475-6773.12068
• Languages: English
• ISSNs: 0017-9124

Abstract

<abstract abstract-type="main" id="hesr12068-abs-0001"> <title> <x xml:space="preserve">Abstract</x> </title> <sec id="hesr12068-sec-0001" sec-type="section"> <title>Objective</title> <p>To illustrate the use of ensemble tree‐based methods (random forest classification [RFC] and bagging) for propensity score estimation and to compare these methods with logistic regression, in the context of evaluating the effect of physical and occupational therapy on preschool motor ability among very low birth weight (VLBW) children.</p> </sec> <sec id="hesr12068-sec-0002" sec-type="section"> <title>Data Source</title> <p>We used secondary data from the Early Childhood Longitudinal Study Birth Cohort (ECLS‐B) between 2001 and 2006.</p> </sec> <sec id="hesr12068-sec-0003" sec-type="section"> <title>Study Design</title> <p>We estimated the predicted probability of treatment using tree‐based methods and logistic regression (LR). We then modeled the exposure‐outcome relation using weighted LR models while considering covariate balance and precision for each propensity score estimation method.</p> </sec> <sec id="hesr12068-sec-0004" sec-type="section"> <title>Principal Findings</title> <p>Among approximately 500 VLBW children, therapy receipt was associated with moderately improved preschool motor ability. Overall, ensemble methods produced the best covariate balance (Mean Squared Difference: 0.03–0.07) and the most precise effect estimates compared to LR (Mean Squared Difference: 0.11). The overall magnitude of the effect estimates was similar between RFC and LR estimation methods.</p> </sec> <sec id="hesr12068-sec-0005" sec-type="section"> <title>Conclusion</title> <p>Propensity score estimation using RFC and bagging produced better covariate balance with increased precision compared to LR. Ensemble methods are a useful alterative to logistic regression to control confounding in observational studies.</p> </sec> </abstract>