Assessing reading comprehension in adolescent low achievers: Subskills identification and task specificity. (January 2013)

• Record Type: Journal Article
• Authors: van Steensel, Roel; Oostdam, Ron; van Gelderen, Amos
• Is Part Of: Language testing. Volume 30:Number 1(2013)
• Page Start: 3
• Page End: 21
• Publication Date: 2013-01
• Subjects: Generalizability Theory -- low achievers -- reading assessment -- reading comprehension -- reading subskills -- Structural Equation Modeling -- task specificity; Language and languages -- Ability testing -- Periodicals; Language and languages -- Examinations -- Periodicals; 407.6
• DOI: 10.1177/0265532212440950
• Languages: English
• ISSNs: 0265-5322

Abstract

On the basis of a validation study of a new test for assessing low-achieving adolescents' reading comprehension skills – the SALT-reading – we analyzed two issues relevant to the field of reading test development. Using the test results of 200 seventh graders, we examined the possibility of identifying reading comprehension subskills and the effects of task specificity on test reliability. Regarding the former, we distinguished three subskills indicating different levels of understanding ('retrieving', 'interpreting', 'reflecting'). However, confirmatory factor analyses did not support the presence of these subskills. Task specificity refers to the situation that different tasks within a test are not uniformly difficult for individual test takers, which constitutes a form of error negatively influencing test reliability. However, Generalizability Theory analysis showed that such task-specific effects did not occur: the reliability of the SALT-reading was primarily affected by error associated with the score variance within tasks.