Estimating Heterogeneous Treatment Effects and the Effects of Heterogeneous Treatments with Ensemble Methods. (4th September 2017)

• Record Type: Journal Article
• Authors: Grimmer, Justin; Messing, Solomon; Westwood, Sean J.
• Is Part Of: Political analysis. Volume 25:Number 4(2017)
• Page Start: 413
• Page End: 434
• Publication Date: 2017-09-04
• Subjects: Political science -- Methodology -- Periodicals; Electronic journals; 320.011
• DOI: 10.1017/pan.2017.15
• Languages: English
• ISSNs: 1047-1987

Abstract

Abstract : Randomized experiments are increasingly used to study political phenomena because they can credibly estimate the average effect of a treatment on a population of interest. But political scientists are often interested in how effects vary across subpopulations—heterogeneous treatment effects—and how differences in the content of the treatment affects responses—the response to heterogeneous treatments. Several new methods have been introduced to estimate heterogeneous effects, but it is difficult to know if a method will perform well for a particular data set. Rather than using only one method, we show how an ensemble of methods—weighted averages of estimates from individual models increasingly used in machine learning—accurately measure heterogeneous effects. Building on a large literature on ensemble methods, we show how the weighting of methods can contribute to accurate estimation of heterogeneous treatment effects and demonstrate how pooling models lead to superior performance to individual methods across diverse problems. We apply the ensemble method to two experiments, illuminating how the ensemble method for heterogeneous treatment effects facilitates exploratory analysis of treatment effects.