Examining the Reliability of Student Growth Percentiles Using Multidimensional IRT. Issue 4 (4th November 2015)

• Record Type: Journal Article
• Authors: Monroe, Scott; Cai, Li
• Is Part Of: Educational measurement. Volume 34:Issue 4(2015:Winter)
• Page Start: 21
• Page End: 30
• Publication Date: 2015-11-04
• Subjects: high‐stakes testing -- item response theory -- student growth percentiles -- teacher evaluation; Educational tests and measurements -- Periodicals; Educational tests and measurements -- United States -- Periodicals; 371.262
• DOI: 10.1111/emip.12092
• Languages: English
• ISSNs: 0731-1745

Abstract

Abstract : Student growth percentiles (SGPs, Betebenner, 2009) are used to locate a student's current score in a conditional distribution based on the student's past scores. Currently, following Betebenner (2009), quantile regression (QR) is most often used operationally to estimate the SGPs. Alternatively, multidimensional item response theory (MIRT) may also be used to estimate SGPs, as proposed by Lockwood and Castellano (2015). A benefit of using MIRT to estimate SGPs is that techniques and methods already developed for MIRT may readily be applied to the specific context of SGP estimation and inference. This research adopts a MIRT framework to explore the reliability of SGPs. More specifically, we propose a straightforward method for estimating SGP reliability. In addition, we use this measure to study how SGP reliability is affected by two key factors: the correlation between prior and current latent achievement scores, and the number of prior years included in the SGP analysis. These issues are primarily explored via simulated data. In addition, the QR and MIRT approaches are compared in an empirical application.