Are the tests scores of the Programme for International Student Assessment (PISA) and the National Educational Panel Study (NEPS) science tests comparable? An assessment of test equivalence in German Schools. (December 2018)

• Record Type: Journal Article
• Authors: Wagner, Helene; Hahn, Inga; Schöps, Katrin; Ihme, Jan Marten; Köller, Olaf
• Is Part Of: Studies in educational evaluation. Volume 59(2018)
• Page Start: 278
• Page End: 287
• Publication Date: 2018-12
• Subjects: Scientific literacy -- Missing data -- Linking study -- Equipercentile equating -- PISA -- NEPS; Curriculum evaluation -- Periodicals; Educational tests and measurements -- Periodicals; Programmes d'études -- Evaluation -- Périodiques; Tests et mesures en éducation -- Périodiques; 375.006
• DOI: 10.1016/j.stueduc.2018.09.002
• Languages: English
• ISSNs: 0191-491X

Abstract

Highlights: The science tests from PISA and NEPS are similar with regard to their constructs. The linking of the test scores showed a high classification consistency. The classification consistency was highest when missings were ignored in both tests. Abstract: The aim of this study is to link the science scale of the German National Educational Panel Study (NEPS) with the science scale of the Programme for International Student Assessment (PISA). One requirement for a strong linking of test scores from different studies is a sufficient similarity of the tests regarding their constructs. The present study aims to assess the similarity of the operationalized constructs of the NEPS and PISA scientific literacy tests with the aim to link the scales of the two tests. A linking study was carried out for this purpose in which 1079 students worked on the tasks of both studies. The results of the comparison between NEPS and PISA indicated a high overlap regarding their constructs. However, both studies deal with missing responses differently. The linking via equipercentile equating showed a high classification consistency which was highest when missing responses were ignored in both studies.