The Cut-Score Operating Function: A New Tool to Aid in Standard Setting. (June 2017)

• Record Type: Journal Article
• Authors: Grabovsky, Irina; Wainer, Howard
• Is Part Of: Journal of educational and behavioral statistics. Volume 42:Number 3(2017)
• Page Start: 251
• Page End: 263
• Publication Date: 2017-06
• Subjects: achievement -- assessment -- NAEP -- policy -- psychometrics -- testing; Educational statistics -- Periodicals; Social sciences -- Statistical methods -- Periodicals; 370.2
• DOI: 10.3102/1076998617696495
• Languages: English
• ISSNs: 1076-9986

Abstract

In this essay, we describe the construction and use of the Cut-Score Operating Function in aiding standard setting decisions. The Cut-Score Operating Function shows the relation between the cut-score chosen and the consequent error rate. It allows error rates to be defined by multiple loss functions and will show the behavior of each loss function. One strength of the Cut-Score Operating Function is that it shows how robust error rates are to the choice of cut-score and identifies the regions of extreme sensitivity relative to that choice.