Calculating Conditional Reliability for Dynamic Measurement Model Capacity Estimates. Issue 4 (1st December 2018)

• Record Type: Journal Article
• Authors: McNeish, Daniel; Dumas, Denis
• Is Part Of: Journal of educational measurement. Volume 55:Issue 4(2018)
• Page Start: 614
• Page End: 634
• Publication Date: 2018-12-01
• Subjects: Educational tests and measurements -- Periodicals; 371.2605
• DOI: 10.1111/jedm.12195
• Languages: English
• ISSNs: 0022-0655

Abstract

Abstract: Dynamic measurement modeling (DMM) is a recent framework for measuring developing constructs whose manifestation occurs after an assessment is administered (e.g., learning capacity). Empirical studies have suggested that DMM may improve consequential validity of test scores because DMM learning capacity estimates were shown to be much less related to demographic factors like examinees' socioeconomic status compared to traditional single‐administration item response theory (IRT)–based estimates. Though promotion of DMM has hinged on improved validity, no methods for computing reliability (a prerequisite for validity) have been advanced and DMM is sufficiently different from classical test theory (CTT) and IRT that known methods cannot be directly imported. This article advances one method for computing conditional reliability for DMM so that precision of the estimates can be assessed.