An Investigation of Exposure Control Methods With Variable-Length CAT Using the Partial Credit Model. Issue 8 (November 2019)

• Record Type: Journal Article
• Authors: Leroux, Audrey J.; Waid-Ebbs, J. Kay; Wen, Pey-Shan; Helmer, Drew A.; Graham, David P.; O'Connor, Maureen K.; Ray, Kathleen
• Is Part Of: Applied psychological measurement. Volume 43:Issue 8(2019)
• Page Start: 624
• Page End: 638
• Publication Date: 2019-11
• Subjects: computerized adaptive testing -- stopping rule -- item exposure control -- partial credit model -- item response theory -- simulation; Psychometrics -- Periodicals; Psychological tests -- Periodicals; Psychology, Applied -- Periodicals; 150.1519505
• DOI: 10.1177/0146621618824856
• Languages: English
• ISSNs: 0146-6216

Abstract

The purpose of this simulation study was to investigate the effect of several different item exposure control procedures in computerized adaptive testing (CAT) with variable-length stopping rules using the partial credit model. Previous simulation studies on CAT exposure control methods with polytomous items rarely considered variable-length tests. The four exposure control techniques examined were the randomesque with a group of three items, randomesque with a group of six items, progressive-restricted standard error (PR-SE), and no exposure control. The two variable-length stopping rules included were the SE and predicted standard error reduction (PSER), along with three item pools of varied sizes (43, 86, and 172 items). Descriptive statistics on number of nonconvergent cases, measurement precision, testing burden, item overlap, item exposure, and pool utilization were calculated. Results revealed that the PSER stopping rule administered fewer items on average while maintaining measurement precision similar to the SE stopping rule across the different item pool sizes and exposure controls. The PR-SE exposure control procedure surpassed the randomesque methods by further reducing test overlap, maintaining maximum exposure rates at the target rate or lower, and utilizing all items from the pool with a minimal increase in number of items administered and nonconvergent cases.