A Comparative Study of Online Item Calibration Methods in Multidimensional Computerized Adaptive Testing. (October 2017)

• Record Type: Journal Article
• Authors: Chen, Ping
• Is Part Of: Journal of educational and behavioral statistics. Volume 42:Number 5(2017)
• Page Start: 559
• Page End: 590
• Publication Date: 2017-10
• Subjects: online calibration method -- multidimensional computerized adaptive testing -- Bayes modal estimation -- multidimensional two-parameter logistic model -- item replenishment; Educational statistics -- Periodicals; Social sciences -- Statistical methods -- Periodicals; 370.2
• DOI: 10.3102/1076998617695098
• Languages: English
• ISSNs: 1076-9986

Abstract

Calibration of new items online has been an important topic in item replenishment for multidimensional computerized adaptive testing (MCAT). Several online calibration methods have been proposed for MCAT, such as multidimensional "one expectation–maximization (EM) cycle" (M-OEM) and multidimensional "multiple EM cycles" (M-MEM). However, M-MEM often fails to converge when the correlations between dimensions are relatively high. To solve the nonconvergence issue and more accurately calibrate new items, this article combines Bayes modal estimation with M-OEM and M-MEM to make full use of the prior information from the item parameters of the new items. The obtained two new Bayesian methods were compared with the existing methods under several conditions, assuming the new items were assigned to examinees via random design or optimal Bayesian adaptive design. The simulation results showed that adding prior to the new item parameters was helpful to improve the calibration precision and efficiency of M-MEM but not so much for M-OEM, and the two online calibration designs exemplified very similar calibration precision.