Design Effect in Multilevel Settings: A Commentary on a Latent Variable Modeling Procedure for Its Evaluation. (October 2022)

• Record Type: Journal Article
• Authors: Raykov, Tenko; DiStefano, Christine
• Is Part Of: Educational and psychological measurement. Volume 82:Number 5(2022)
• Page Start: 1020
• Page End: 1030
• Publication Date: 2022-10
• Subjects: design effect -- interval estimation -- intraclass correlation coefficient -- latent variable modeling -- multilevel setting -- two-level study.; Educational tests and measurements -- Periodicals; Psychological tests -- Periodicals; 151.205
• DOI: 10.1177/00131644211019447
• Languages: English
• ISSNs: 0013-1644

Abstract

A latent variable modeling-based procedure is discussed that permits to readily point and interval estimate the design effect index in multilevel settings using widely circulated software. The method provides useful information about the relationship of important parameter standard errors when accounting for clustering effects relative to conducting single-level analyses. The approach can also be employed as an addendum to point and interval estimation of the intraclass correlation coefficient in empirical research. The discussed procedure makes it easily possible to evaluate the design effect in two-level studies by utilizing the popular latent variable modeling methodology and is illustrated with an example.