Using Implementation Fidelity to Aid in Interpreting Program Impacts: A Brief Review. (December 2019)

• Record Type: Journal Article
• Authors: Hill, Heather C.; Erickson, Anna
• Is Part Of: Educational researcher. Volume 48:Number 9(2019)
• Page Start: 590
• Page End: 598
• Publication Date: 2019-12
• Subjects: descriptive analysis -- evaluation -- experimental design -- policy -- program evaluation; Education -- Periodicals; Education -- United States -- Periodicals; Education -- Research -- Periodicals; Education -- Research -- Methodology -- Periodicals; 370.72
• DOI: 10.3102/0013189X19891436
• Languages: English
• ISSNs: 0013-189X

Abstract

Poor program implementation constitutes one explanation for null results in trials of educational interventions. For this reason, researchers often collect data about implementation fidelity when conducting such trials. In this article, we document whether and how researchers report and measure program fidelity in recent cluster-randomized trials. We then create two measures—one describing the level of fidelity reported by authors and another describing whether the study reports null results—and examine the correspondence between the two. We also explore whether fidelity is influenced by study size, type of fidelity measured and reported, and features of the intervention. We find that as expected, fidelity level relates to student outcomes; we also find that the presence of new curriculum materials positively predicts fidelity level.