Evaluating item response theory linking and model fit for data from PISA 2000–2012. Issue 4 (4th July 2019)

• Record Type: Journal Article
• Authors: von Davier, Matthias; Yamamoto, Kentaro; Shin, Hyo Jeong; Chen, Henry; Khorramdel, Lale; Weeks, Jon; Davis, Scott; Kong, Nan; Kandathil, Mat
• Is Part Of: Assessment in education. Volume 26:Issue 4(2019)
• Page Start: 466
• Page End: 488
• Publication Date: 2019-07-04
• Subjects: Item response theory (IRT) -- scale linking approach -- Programme for International Student Assessment (PISA) -- item-by-group interactions; Educational tests and measurements -- Periodicals; Education -- Evaluation -- Periodicals; 371.26
• DOI: 10.1080/0969594X.2019.1586642
• Languages: English
• ISSNs: 0969-594X

Abstract

ABSTRACT: Based on concerns about the item response theory (IRT) linking approach used in the Programme for International Student Assessment (PISA) until 2012 as well as the desire to include new, more complex, interactive items with the introduction of computer-based assessments, alternative IRT linking methods were implemented in the 2015 PISA round. The new linking method represents a concurrent calibration using all available data, enabling us to find item parameters that maximize fit across all groups and allowing us to investigate measurement invariance across groups. Apart from the Rasch model that historically has been used in PISA operational analyses, we compared our method against more general IRT models that can incorporate item-by-country interactions. The results suggest that our proposed method holds promise not only to provide a strong linkage across countries and cycles but also to serve as a tool for investigating measurement invariance.