An Independent Evaluation of the Diagnostic Accuracy of a Computer Adaptive Test to Predict Proficiency on an End of Year High-Stakes Assessment. (September 2022)

• Record Type: Journal Article
• Authors: Turner, Megan I.; Van Norman, Ethan R.; Hojnoski, Robin L.
• Is Part Of: Journal of psychoeducational assessment. Volume 40:Number 7(2022)
• Page Start: 911
• Page End: 916
• Publication Date: 2022-09
• Subjects: mathematics -- screening -- computer adaptive testing -- response to intervention; Ability -- Testing -- Periodicals; Educational tests and measurements -- Periodicals; 371.713
• DOI: 10.1177/07342829221110676
• Languages: English
• ISSNs: 0734-2829

Abstract

Star Math (SM) is a popular computer adaptive test (CAT) schools use to screen students for academic risk. Despite its popularity, few independent investigations of its diagnostic accuracy have been conducted. We evaluated the diagnostic accuracy of SM based upon vendor provided cut-scores (25 th and 40 th percentiles nationally) in predicting proficiency on an end of year state test in a sample of highly achieving grade three ( n = 210), four ( n = 217), and five ( n = 242) students. Specificity exceeded sensitivity across all grades and cut-scores. Acceptable levels of sensitivity and specificity were achieved in grade three and four but not grade five when using the 40 th percentile.