Estimating Subgroup Differences in Staffing Research When the Selection Mechanism Is Unknown: A Response to Li's Case IV Correction. (April 2020)

• Record Type: Journal Article
• Authors: Fife, Dustin A.; Mendoza, Jorge; Day, Eric; Terry, Robert
• Is Part Of: Organizational research methods. Volume 23:Number 2(2020:Apr.)
• Page Start: 367
• Page End: 384
• Publication Date: 2020-04
• Subjects: missing data -- quantitative research -- criterion and predictive validity strategies -- reliability and validity -- ANOVA methods; Organization -- Research -- Methodology -- Periodicals; Organizational sociology -- Research -- Methodology -- Periodicals; Management -- Research -- Methodology -- Periodicals; 302.350721
• DOI: 10.1177/1094428118799492
• Languages: English
• ISSNs: 1094-4281

Abstract

When estimating subgroup differences on incumbents, range restriction may bias estimates. Bobko, Roth, and Bobko recognized this problem and developed a Case II and Case III correction for Cohen's d . Subsequently, Li developed a Case IV correction, which seeks to estimate group differences on a predictor using only incumbent data but must assume that group membership (e.g., ethnicity) plays no role in selection decisions. In this paper, we extend Li's correction and relax this assumption. In addition, this new correction allows for the estimation of subgroup differences on both the criterion and predictor. Using Monte Carlo simulation, we study the performance of both estimators under situations where Li's assumptions are violated and demonstrate that this new procedure almost always outperforms Li's Case IV correction and does so with greater precision. We also provide R code to assist applied researchers in using these corrections.