Using Pooled Heteroskedastic Ordered Probit Models to Improve Small-Sample Estimates of Latent Test Score Distributions. (February 2021)

• Record Type: Journal Article
• Authors: Shear, Benjamin R.; Reardon, Sean F.
• Is Part Of: Journal of educational and behavioral statistics. Volume 46:Number 1(2021)
• Page Start: 3
• Page End: 33
• Publication Date: 2021-02
• Subjects: coarsened data -- categorical data -- heteroskedastic ordered probit -- proficiency data; Educational statistics -- Periodicals; Social sciences -- Statistical methods -- Periodicals; 370.2
• DOI: 10.3102/1076998620922919
• Languages: English
• ISSNs: 1076-9986

Abstract

This article describes an extension to the use of heteroskedastic ordered probit (HETOP) models to estimate latent distributional parameters from grouped, ordered-categorical data by pooling across multiple waves of data. We illustrate the method with aggregate proficiency data reporting the number of students in schools or districts scoring in each of a small number of ordered "proficiency" levels. HETOP models can be used to estimate means and standard deviations of the underlying (latent) test score distributions but may yield biased or very imprecise estimates when group sample sizes are small. A simulation study demonstrates that the pooled HETOP models described here can reduce the bias and sampling error of standard deviation estimates when group sample sizes are small. Analyses of real test score data demonstrate the use of the models and suggest the pooled models are likely to improve estimates in applied contexts.