Outcome Evidencing: A Method for Enabling and Evaluating Program Intervention in Complex Systems. (June 2017)

• Record Type: Journal Article
• Authors: Paz-Ybarnegaray, Rodrigo; Douthwaite, Boru
• Is Part Of: American journal of evaluation. Volume 38:Number 2(2017:Jun.)
• Page Start: 275
• Page End: 293
• Publication Date: 2017-06
• Subjects: complex systems -- outcome trajectories -- theory of change -- monitoring -- evaluation -- sociotechnical niches -- realist evaluation -- mechanisms -- innovation; Evaluation -- Periodicals; Public administration -- Evaluation -- Periodicals; Educational evaluation -- Periodicals; Social sciences -- Methodology -- Periodicals; 300.72
• DOI: 10.1177/1098214016676573
• Languages: English
• ISSNs: 1098-2140

Abstract

This article describes the development and use of a rapid evaluation approach to meet program accountability and learning requirements in a research for development program operating in five developing countries. The method identifies clusters of outcomes, both expected and unexpected, happening within areas of change. In a workshop, change agents describe the causal connections within outcome clusters to identify outcome trajectories for subsequent verification. Comparing verified outcome trajectories with existing program theory allows program staff to question underlying causal premises and adapt accordingly. The method can be used for one-off evaluations that seek to understand whether, how, and why program interventions are working. Repeated cycles of outcome evidencing can build a case for program contribution over time that can be evaluated as part of any future impact assessment of the program or parts of it.