Statistical Power for Causally Defined Indirect Effects in Group-Randomized Trials With Individual-Level Mediators. (October 2017)

• Record Type: Journal Article
• Authors: Kelcey, Benjamin; Dong, Nianbo; Spybrook, Jessaca; Cox, Kyle
• Is Part Of: Journal of educational and behavioral statistics. Volume 42:Number 5(2017)
• Page Start: 499
• Page End: 530
• Publication Date: 2017-10
• Subjects: mediation -- power -- indirect effects -- multilevel models -- sample size determination; Educational statistics -- Periodicals; Social sciences -- Statistical methods -- Periodicals; 370.2
• DOI: 10.3102/1076998617695506
• Languages: English
• ISSNs: 1076-9986

Abstract

Designs that facilitate inferences concerning both the total and indirect effects of a treatment potentially offer a more holistic description of interventions because they can complement "what works" questions with the comprehensive study of the causal connections implied by substantive theories. Mapping the sensitivity of designs to detect these effects is of critical importance because it directly governs the types of evidence researchers can bring to bear on theories of action under realistic sample sizes. In this study, we develop closed-form expressions to estimate the variance of and the power to detect causally defined indirect effects in two-level group-randomized studies examining individual-level mediators (i.e., 2-1-1 mediation). We formulate our approach within the purview of typical multilevel mediation models and anchor their interpretation in the potential outcomes framework. The results provide power analysis formulas that reduce calculations to simple functions of the primary path coefficients (e.g., treatment–mediator and mediator–outcome relationships) and common summary statistics (e.g., intraclass correlation coefficients). Probing these formulas suggests that group-randomized designs can be well powered to detect indirect effects when carefully planned. The power formulas are implemented in the PowerUp software (causalevaluation.org ).