Betterment, undermining, support and distortion: A heuristic model for the analysis of pressure on evaluators. (August 2018)

• Record Type: Journal Article
• Authors: Pleger, Lyn; Sager, Fritz
• Is Part Of: Evaluation and program planning. Volume 69(2018)
• Page Start: 166
• Page End: 172
• Publication Date: 2018-08
• Subjects: Pressure -- Evaluation -- Evidence-based policymaking -- Independence -- Heuristic BUSD-model; Health planning -- Periodicals; Medical care -- Evaluation -- Periodicals; 362.1068
• DOI: 10.1016/j.evalprogplan.2016.09.002
• Languages: English
• ISSNs: 0149-7189

Abstract

Highlights: Evaluators are often confronted with influence by different stakeholders. Influence is not negative per se. A heuristic model of influence on evaluations is proposed. The BUSD-model facilitates the distinction between different types of influence. Abstract: Evaluations can only serve as a neutral evidence base for policy decision-making as long as they have not been altered along non-scientific criteria. Studies show that evaluators are repeatedly put under pressure to deliver results in line with given expectations. The study of pressure and influence to misrepresent findings is hence an important research strand for the development of evaluation praxis. A conceptual challenge in the area of evaluation ethics research is the fact that pressure can be not only negative, but also positive. We develop a heuristic model of influence on evaluations that does justice to this ambivalence of influence: the BUSD-model (betterment, undermining, support, distortion). The model is based on the distinction of two dimensions, namely 'explicitness of pressure' and 'direction of influence'. We demonstrate how the model can be applied to understand pressure and offer a practical tool to distinguish positive from negative influence in the form of three so-called differentiators (awareness, accordance, intention). The differentiators comprise a practical component by assisting evaluators who are confronted with influence.