How do policy evaluators understand complexity?. (July 2020)

• Record Type: Journal Article
• Authors: Barbrook-Johnson, Pete; Proctor, Amy; Giorgi, Sara; Phillipson, Jeremy
• Is Part Of: Evaluation. Volume 26:Number 3(2020:Jul.)
• Page Start: 315
• Page End: 332
• Publication Date: 2020-07
• Subjects: complexity -- evaluation -- government -- policy making -- United Kingdom; Evaluation research (Social action programs) -- Periodicals; 361.61068
• DOI: 10.1177/1356389020930053
• Languages: English
• ISSNs: 1356-3890

Abstract

There is a well-documented interest in how insights from the study of complexity can be applied to policy evaluation. However, important questions remain as to how complexity is understood and used by policy evaluators. We present findings from semi-structured interviews with 30 UK policy evaluators working in food, energy, water and environment policy domains. We explore how they understand, use and approach complexity, and consider the implications for evaluation research and practice. Findings reveal understandings of complexity arising from contextual factors, scale-related issues and perceptions of unpredictability. The evidence indicates terminological and analogical use of complexity and its concepts by policy evaluators, but limited evidence of its literal use. Priorities for the future include framing complexity more pragmatically and as an opportunity not a cost. Communicating this up the policy hierarchy is the key to progressing complexity-appropriate evaluation – this can be enabled by strengthening links between policy evaluation and academic communities.