Reduce, Reuse, Recycle: The Longitudinal Value of Local Cut Scores Using State Test Data. (October 2017)

• Record Type: Journal Article
• Authors: Nelson, Peter M.; Van Norman, Ethan R.; VanDerHeyden, Amanda
• Is Part Of: Journal of psychoeducational assessment. Volume 35:Number 7(2017)
• Page Start: 683
• Page End: 694
• Publication Date: 2017-10
• Subjects: universal screening -- math -- reading; Ability -- Testing -- Periodicals; Educational tests and measurements -- Periodicals; 371.713
• DOI: 10.1177/0734282916658567
• Languages: English
• ISSNs: 0734-2829

Abstract

We used existing reading ( n = 1, 498) and math ( n = 2, 260) data to evaluate state test scores for screening middle school students. In Phase 1, state test data were used to create a research-derived cut score that was optimal for predicting state test performance the following year. In Phase 2, those cut scores were applied with future cohorts. Diagnostic accuracy of the research-derived cut scores was compared with the state's proficiency benchmark from the previous year. Across grades and content areas, research-derived cut scores yielded higher sensitivity and lower specificity values relative to state-defined cut scores. Marked decreases in sensitivity and specificity were not observed in subsequent years. Results provide evidence for procedures in which previous state test data are repurposed for screening decisions.