How Should Educational Effects Be Communicated to Teachers?. (August 2021)

• Record Type: Journal Article
• Authors: Lortie-Forgues, Hugues; Sio, Ut Na; Inglis, Matthew
• Is Part Of: Educational researcher. Volume 50:Number 6(2021)
• Page Start: 345
• Page End: 354
• Publication Date: 2021-08
• Subjects: communication -- decision making -- effect sizes -- experimental design -- teacher knowledge -- teachers; Education -- Periodicals; Education -- United States -- Periodicals; Education -- Research -- Periodicals; Education -- Research -- Methodology -- Periodicals; 370.72
• DOI: 10.3102/0013189X20987856
• Languages: English
• ISSNs: 0013-189X

Abstract

Research findings regarding the effects of educational interventions—typically reported in units of standard deviations (e.g., Cohen's d )—are often translated into more intuitive metrics before being communicated to teachers. However, there is no consensus about the most suitable metric, and no study has systematically examined how teachers respond to the different options. We conducted two preregistered studies addressing this issue. We found that teachers have strong preferences concerning effect size metrics in terms of informativeness, understandability, and helpfulness. These preferences challenge current research reporting recommendations. Most importantly, we found that different metrics induce different perceptions of an intervention's effectiveness—a situation that could cause teachers to have unrealistic expectations about what a given intervention may achieve. Implications for how educational effects should be communicated are discussed.