Standardized Mean Differences in Two-Level Cross-Classified Random Effects Models. (August 2014)

• Record Type: Journal Article
• Authors: Lai, Mark H. C.; Kwok, Oi-Man
• Is Part Of: Journal of educational and behavioral statistics. Volume 39:Number 4(2014)
• Page Start: 282
• Page End: 302
• Publication Date: 2014-08
• Subjects: cross-classified random effects model -- effect size -- randomized trials -- multilevel -- standardized mean differece; Educational statistics -- Periodicals; Social sciences -- Statistical methods -- Periodicals; 370.2
• DOI: 10.3102/1076998614532950
• Languages: English
• ISSNs: 1076-9986

Abstract

Multilevel modeling techniques are becoming more popular in handling data with multilevel structure in educational and behavioral research. Recently, researchers have paid more attention to cross-classified data structure that naturally arises in educational settings. However, unlike traditional single-level research, methodological studies about multilevel effect size have been rare and those that have recently appeared had an emphasis on strictly hierarchical data structure. This article extends the work on multilevel standardized mean differences from strictly hierarchical structure to both fully and partially cross-classified structures. Analytically derived formulae for calculating effect sizes and the corresponding sampling variances (or standard errors) are presented, verified by simulation results, and illustrated with real data examples. Implications for primary research studies and meta-analyses are discussed.