Comparing three approaches for handling a fourth level of nesting structure in cluster-randomized trials. Issue 3 (28th April 2022)

• Record Type: Journal Article
• Authors: Glaman, Ryan; Chen, Qi; Henson, Robin K.
• Is Part Of: Journal of experimental education. Volume 90:Issue 3(2022)
• Page Start: 712
• Page End: 730
• Publication Date: 2022-04-28
• Subjects: Cluster-randomized trial -- latent growth curve modeling -- multilevel modeling -- nested data; Education -- Experimental methods -- Periodicals; Educational psychology -- Periodicals; Education -- Periodicals; Psychology, Experimental -- Periodicals; 370.15
• DOI: 10.1080/00220973.2020.1814684
• Languages: English
• ISSNs: 0022-0973

Abstract

Abstract: This study compared three approaches for handling a fourth level of nesting when analyzing cluster-randomized trial (CRT) data. Although CRT data analyses may include repeated measures, individual, and cluster levels, there may be an additional fourth level that is typically ignored. This study examined the impact of ignoring this fourth level, accounting for it using a model-based approach, and accounting for it using a design-based approach on parameter and standard error ( SE ) estimates. Several fixed effect and random effect variance parameters and SE s were biased across all three models. Results suggest if a meaningful fourth level exists, researchers should acknowledge it using a design-based approach. If the fourth level is not practically important, researchers may ignore it altogether, resulting in more accurate parameter and SE estimates.