Applying Evidence‐Centered Design in the Development of a Multidimensional Adaptive Reading Motivation Measure. Issue 4 (26th August 2021)

• Record Type: Journal Article
• Authors: Wang, Wenhao; Kingston, Neal M.; Davis, Marcia H.; Tiemann, Gail C.; Tonks, Stephen; Hock, Michael
• Is Part Of: Educational measurement. Volume 40:Issue 4(2021)
• Page Start: 91
• Page End: 100
• Publication Date: 2021-08-26
• Subjects: conceptual assessment framework -- evidence‐centered design -- multidimensional computer adaptive testing; Educational tests and measurements -- Periodicals; Educational tests and measurements -- United States -- Periodicals; 371.262
• DOI: 10.1111/emip.12468
• Languages: English
• ISSNs: 0731-1745

Abstract

Abstract: Adaptive tests are more efficient than fixed‐length tests through the use of item response theory; adaptive tests also present students questions that are tailored to their proficiency level. Although the adaptive algorithm is straightforward, developing a multidimensional computer adaptive test (MCAT) measure is complex. Evidence‐centered design (ECD) can provide a highly structured framework to guide the development of a MCAT. In this paper, the development of the adaptive reading motivation measure (ARMM) demonstrates the process of applying ECD to the development of a MCAT measure. This paper focuses on the conceptual assessment framework layer of the ECD that guides the technical aspects of MCAT development. The five models of conceptual assessment framework layer are student model, task model, evidence model, assembly model, and presentation model. How each model guided the development of the ARMM is described in detail. In this paper, we demonstrate how the conceptual assessment framework in ECD can provide a useful structure for developing MCAT measures.