Supporting the Interpretive Validity of Student‐Level Claims in Science Assessment with Tiered Claim Structures. Issue 4 (6th August 2022)

• Record Type: Journal Article
• Authors: Student, Sanford R.; Gong, Brian
• Is Part Of: Educational measurement. Volume 41:Issue 4(2022)
• Page Start: 68
• Page End: 78
• Publication Date: 2022-08-06
• Subjects: evidence‐centered test design -- performance‐level descriptors -- science assessment -- score interpretation -- score reporting -- test design -- validation -- validity -- validity theory; Educational tests and measurements -- Periodicals; Educational tests and measurements -- United States -- Periodicals; 371.262
• DOI: 10.1111/emip.12523
• Languages: English
• ISSNs: 0731-1745

Abstract

Abstract: We address two persistent challenges in large‐scale assessments of the Next Generation Science Standards: (a) the validity of score interpretations that target the standards broadly and (b) how to structure claims for assessments of this complex domain. The NGSS pose a particular challenge for specifying claims about students that evidence from summative assessments can support. As a solution, we propose tiered claims, which explicitly distinguish between claims about what students have done or can do on test items—which are typically easier to support under current test designs—and claims about what students could do in the broader domain of performances described by the standards, for which novel evidence is likely required. We discuss the positive implications of tiered claims for test construction, validation, and reporting of results.