Do PISA data justify PISA-based education policy?. Issue 1 (13th February 2017)

• Record Type: Journal Article
• Authors: Araujo, Luisa; Saltelli, Andrea; Schnepf, Sylke V.
• Is Part Of: International journal of comparative education and development. Volume 19:Issue 1(2017)
• Page Start: 20
• Page End: 34
• Publication Date: 2017-02-13
• Subjects: Comparative education -- Evidence-based policy -- Educational measurement -- Programme for International Student Assessment (PISA); Comparative education -- Periodicals; Education -- Periodicals; 370.9
• DOI: 10.1108/IJCED-12-2016-0023
• Languages: English
• ISSNs: 2396-7404

Abstract

Abstract : Purpose: Since the publication of its first results in 2000, the Programme for International Student Assessment (PISA) implemented by the OECD has repeatedly been the subject of heated debate. In late 2014 controversy flared up anew, with the most severe critics going so far as to call for a halt to the programme. The purpose of this paper is to discuss the methodological design of PISA and the ideological basis of scientific and policy arguments invoked for and against it. Design/methodology/approach: The authors examine the soundness of the survey methodology and identify the conflicting interpretations and values fuelling the debate. Findings: The authors find that while PISA has promoted the focus on the important subject of children's education worldwide there are legitimate concerns about what PISA measures, and how. The authors conclude that the OECD should be more transparent in the documentation of the methodological choices that underlie the creation of the data and more explicit about the impact of these choices on the results. More broadly, the authors advise caution in the attempt to derive and apply evidence-based policy in the domain of education; the authors furthermore propose an alternative model of social inquiry that is sensitive and robust to the concerns of the various actors and stakeholders that may be involved in a given policy domain. Originality/value: The issues and tensions surrounding the PISA survey can be better understood in the framework of post-normal science (PNS), the application of which to the PISA controversy offers a potential solution to a stalemate.