How Much Is Enough? Evaluating Intervention Implementation Efficiently. (March 2019)

• Record Type: Journal Article
• Authors: Fritz, Ronda; Harn, Beth; Biancarosa, Gina; Lucero, Audrey; Flannery, K. Brigid
• Other Names: Glover Todd A. guest-editor.; Kettler Ryan J. guest-editor.; Reddy Linda A. guest-editor.; Kurz Alexander guest-editor.
• Is Part Of: Assessment for effective intervention. Volume 44:Number 2(2019)
• Page Start: 135
• Page End: 144
• Publication Date: 2019-03
• Subjects: instruction -- interventions -- observation; Educational tests and measurements -- Periodicals; Special education -- Periodicals; 371.2605
• DOI: 10.1177/1534508418772909
• Languages: English
• ISSNs: 1534-5084

Abstract

This study investigated the use of brief observations to measure implementation of small group interventions using the Quality of Intervention Delivery and Receipt (QIDR) tool. Videos of 10-min segments representing the beginning, middle, and end of each 30-min intervention lesson were coded for implementation. Results indicated that (a) reliability can be achieved when observing a portion of a lesson; (b) QIDR scores obtained from 10-min segments are significantly correlated with the 30-min observations; and (c) post hoc analysis indicate the tool may be sensitive to changes in implementation quality at the intervention group level across time. Implications for research and practice are discussed, including the utility of shorter observations to increase the monitoring of intervention implementation to potentially improve outcomes.