Estimating Partial Standardized Mean Differences from Regression Models. Issue 4 (13th July 2022)

• Record Type: Journal Article
• Authors: Aloe, Ariel M.; Thompson, Christopher G.; Liu, Zhijiang; Lin, Lifeng
• Is Part Of: Journal of experimental education. Volume 90:Issue 4(2022)
• Page Start: 898
• Page End: 915
• Publication Date: 2022-07-13
• Subjects: Effect size -- meta-analysis -- quasi-experimental design -- regression model; Education -- Experimental methods -- Periodicals; Educational psychology -- Periodicals; Education -- Periodicals; Psychology, Experimental -- Periodicals; 370.15
• DOI: 10.1080/00220973.2021.1966605
• Languages: English
• ISSNs: 0022-0973

Abstract

Abstract: The distribution of the standardized mean difference is well understood. However, in many situations, researchers need to estimate an effect size to represent the relationship between a continuous outcome and a dichotomous grouping variable, adjusting for the effect of a covariate (or a set of covariates). Typically, this adjustment takes place via regression models. In this article, we consider five different estimators of standardized mean differences that could arise from regression models with one or more covariates. We demonstrate that an existing correction, believed to recover the pooled standard deviation, is in fact an approximation. In addition, we compared the performance of each standardized mean difference index. The function used to generate the data for the simulation is available in the Supplemental Material. Implications for comparing results from primary studies, as well as for meta-analysis, are also considered.