How to Measure Quality of Delivery: Focus on Teaching Practices That Help Students to Develop Proximal Outcomes. Issue 4 (2nd October 2022)

• Record Type: Journal Article
• Authors: Catalán Molina, Diego; Porter, Tenelle; Oberle, Catherine; Haghighat, Misha; Fredericks, Afiya; Budd, Kristen; Roberts, Sylvia; Blackwell, Lisa; Trzesniewski, Kali H.
• Is Part Of: Journal of research on educational effectiveness. Volume 15:Issue 4(2022)
• Page Start: 898
• Page End: 923
• Publication Date: 2022-10-02
• Subjects: Implementation -- quality of delivery -- theory of change -- measure; Education -- Research -- Periodicals; Education -- Evaluation -- Periodicals; Education -- Methodology -- Periodicals; 371.422
• DOI: 10.1080/19345747.2022.2054481
• Languages: English
• ISSNs: 1934-5747

Abstract

Abstract: Recent studies have suggested that quality of delivery matters to achieve better student outcomes in the context of school interventions. However, studies rarely measure quality of delivery and test its association with students' outcomes, perhaps due to lack of clarity regarding how to measure it. Here, we offer recommendations on how to select or design measures of quality of delivery. These recommendations focus on identifying teaching practices that help students to develop proximal outcomes during the delivery of an intervention. Additionally, we illustrate an application of these recommendations to the study of quality of delivery in a cluster-randomized efficacy study of Brainology, a program that promotes students' motivation and learning. We found that, although teachers fluctuated in their quality of delivery across lessons, students who received the intervention with higher quality of delivery on average increased more in targeted proximal outcomes (effort beliefs and learning goals) than students exposed to low quality. We discuss these results in terms of their implications for measuring quality of delivery, supporting teachers, and studying the conditions that make school interventions successful.