Adaptive Comparative Judgment as a Tool for Assessing Open-ended Design Problems and Model Eliciting Activities. Issue 2 (3rd April 2018)

• Record Type: Journal Article
• Authors: Bartholomew, Scott R.; Nadelson, Louis S.; Goodridge, Wade H.; Reeve, Edward M.
• Is Part Of: Educational assessment. Volume 23:Issue 2(2018)
• Page Start: 85
• Page End: 101
• Publication Date: 2018-04-03
• Subjects: Educational tests and measurements -- United States -- Periodicals; 371.26097305
• DOI: 10.1080/10627197.2018.1444986
• Languages: English
• ISSNs: 1062-7197

Abstract

ABSTRACT: We investigated the use of adaptive comparative judgment to evaluate the middle school student learning, engagement, and experience with the design process in an open-ended problem assigned in a technology and engineering education course. Our results indicate that the adaptive comparative judgment tool effectively facilitated the grading of the students' products and improved the judges' understanding of the processes the students used to arrive at their solutions. We found the reliability and validity of the tool to be acceptable and the outcomes of our study suggest that there is justification for the use of the adaptive comparative judgment method to assess student learning outcomes at multiple levels of Science, Technology, Engineering, and Math (STEM) education.