Designing Large-Scale Multisite and Cluster-Randomized Studies of Professional Development. Issue 3 (3rd July 2017)

• Record Type: Journal Article
• Authors: Kelcey, Ben; Spybrook, Jessaca; Phelps, Geoffrey; Jones, Nathan; Zhang, Jiaqi
• Is Part Of: Journal of experimental education. Volume 85:Issue 3(2017)
• Page Start: 389
• Page End: 410
• Publication Date: 2017-07-03
• Subjects: Cluster-randomization trials -- experimental design -- multisite cluster randomized trials -- professional development; Education -- Experimental methods -- Periodicals; Educational psychology -- Periodicals; Education -- Periodicals; Psychology, Experimental -- Periodicals; 370.15
• DOI: 10.1080/00220973.2016.1220911
• Languages: English
• ISSNs: 0022-0973

Abstract

ABSTRACT: We develop a theoretical and empirical basis for the design of teacher professional development studies. We build on previous work by (a) developing estimates of intraclass correlation coefficients for teacher outcomes using two- and three-level data structures, (b) developing estimates of the variance explained by covariates, and (c) modifying the conventional optimal design framework to include differential covariate costs so as to capture the point at which the cost of collecting a covariate overtakes the reduction in variance it supplies. We illustrate the use of these estimates to explore the absolute and relative sensitivity of multilevel designs in teacher professional development studies. The results from these analyses are intended to guide researchers in making more-informed decisions about the tradeoffs and considerations involved in selecting study designs for assessing the impacts of professional development programs.