An Approach to Scoring and Equating Tests With Binary Items: Piloting With Large-Scale Assessments. (December 2016)

• Record Type: Journal Article
• Authors: Dimitrov, Dimiter M.
• Is Part Of: Educational and psychological measurement. Volume 76:Number 6(2016:Dec.)
• Page Start: 954
• Page End: 975
• Publication Date: 2016-12
• Subjects: test scoring -- equating -- scaling -- item response theory -- testing; Educational tests and measurements -- Periodicals; Psychological tests -- Periodicals; 151.205
• DOI: 10.1177/0013164416631100
• Languages: English
• ISSNs: 0013-1644

Abstract

This article describes an approach to test scoring, referred to as delta scoring ( D -scoring), for tests with dichotomously scored items. The D -scoring uses information from item response theory (IRT) calibration to facilitate computations and interpretations in the context of large-scale assessments. The D -score is computed from the examinee's response vector, which is weighted by the expected difficulties (not "easiness") of the test items. The expected difficulty of each item is obtained as an analytic function of its IRT parameters. The D -scores are independent of the sample of test-takers as they are based on expected item difficulties. It is shown that the D -scale performs a good bit better than the IRT logit scale by criteria of scale intervalness. To equate D -scales, it is sufficient to rescale the item parameters, thus avoiding tedious and error-prone procedures of mapping test characteristic curves under the method of IRT true score equating, which is often used in the practice of large-scale testing. The proposed D -scaling proved promising under its current piloting with large-scale assessments and the hope is that it can efficiently complement IRT procedures in the practice of large-scale testing in the field of education and psychology.