Optimal designs for the generalized partial credit model. (19th November 2018)

• Record Type: Journal Article
• Authors: Bürkner, Paul‐Christian; Schwabe, Rainer; Holling, Heinz
• Is Part Of: British journal of mathematical & statistical psychology. Volume 72:Part 2(2019)
• Page Start: 271
• Page End: 293
• Publication Date: 2018-11-19
• Subjects: Bayesian design -- item response theory -- optimal design -- partial credit model -- Rasch model -- two‐parameter logistic model; Psychometrics -- Periodicals; Psychology -- Mathematical models -- Periodicals; Psychology -- Statistical methods -- Periodicals; 150.727
• DOI: 10.1111/bmsp.12148
• Languages: English
• ISSNs: 0007-1102

Abstract

Abstract : Analysing ordinal data is becoming increasingly important in psychology, especially in the context of item response theory. The generalized partial credit model (GPCM) is probably the most widely used ordinal model and has found application in many large‐scale educational assessment studies such as PISA. In the present paper, optimal test designs are investigated for estimating persons' abilities with the GPCM for calibrated tests when item parameters are known from previous studies. We find that local optimality may be achieved by assigning non‐zero probability only to the first and last categories independently of a person's ability. That is, when using such a design, the GPCM reduces to the dichotomous two‐parameter logistic (2PL) model. Since locally optimal designs require the true ability to be known, we consider alternative Bayesian design criteria using weight distributions over the ability parameter space. For symmetric weight distributions, we derive necessary conditions for the optimal one‐point design of two response categories to be Bayes optimal. Furthermore, we discuss examples of common symmetric weight distributions and investigate under what circumstances the necessary conditions are also sufficient. Since the 2PL model is a special case of the GPCM, all of these results hold for the 2PL model as well.