A tale of two tests: The role of topic and general academic knowledge in traditional versus contemporary scenario-based reading. (June 2021)

• Record Type: Journal Article
• Authors: Wang, Zuowei; O'Reilly, Tenaha; Sabatini, John; McCarthy, Kathryn S.; McNamara, Danielle S.
• Is Part Of: Learning and instruction. Volume 73(2021)
• Publication Date: 2021-06
• Subjects: Scenario-based reading -- Multiple text comprehension -- Basic reading skills -- Prior knowledge -- Assessment; Learning -- Periodicals; Teaching -- Periodicals; Apprentissage -- Périodiques; Enseignement -- Périodiques; Learning; Teaching; Periodicals; Electronic journals; 370.1
• DOI: 10.1016/j.learninstruc.2021.101462
• Languages: English
• ISSNs: 0959-4752

Abstract

Abstract: We compared high school students' performance in a traditional comprehension assessment requiring them to identify key information and draw inferences from single texts, and a scenario-based assessment (SBA) requiring them to integrate, evaluate and apply information across multiple sources. Both assessments focused on a non-academic topic. Performance on the two assessments were moderately correlated ( r = 0.57), but the SBA was more difficult (Study 1; n = 342). The two assessments similarly depended on basic reading skills but diverged in the relation to academic knowledge and (non-academic) topic knowledge (Study 2; n = 1107). Academic knowledge was highly predictive of traditional comprehension, but less so for SBA. Topic knowledge was more predictive of SBA than traditional comprehension. Thus, the two assessments tap into similar constructs related to comprehension; however, the level of topic knowledge is more important for performance on scenario-based, multiple-source reading tasks, whereas academic knowledge is more important for traditional reading comprehension tasks. Highlights: Scenario-based reading test is developed to represent reading from multiple sources. Scenario-based reading test is more difficult than traditional reading test. Scenario-based and traditional reading tests similarly require basic reading skills. Traditional reading test highly predicts academic knowledge. Scenario-based test is more dependent on topic knowledge than traditional test.