A Multilevel CFA-MTMM Model for Nested Structurally Different Methods. (October 2015)

• Record Type: Journal Article
• Authors: Koch, Tobias; Schultze, Martin; Burrus, Jeremy; Roberts, Richard D.; Eid, Michael
• Is Part Of: Journal of educational and behavioral statistics. Volume 40:Number 5(2015)
• Page Start: 477
• Page End: 510
• Publication Date: 2015-10
• Subjects: multilevel structural equation modeling -- MTMM analysis -- structurally different and interchangeable methods; Educational statistics -- Periodicals; Social sciences -- Statistical methods -- Periodicals; 370.2
• DOI: 10.3102/1076998615606109
• Languages: English
• ISSNs: 1076-9986

Abstract

The numerous advantages of structural equation modeling (SEM) for the analysis of multitrait–multimethod (MTMM) data are well known. MTMM-SEMs allow researchers to explicitly model the measurement error, to examine the true convergent and discriminant validity of the given measures, and to relate external variables to the latent trait as well as the latent method factors in the model. According toEid et al. (2008) different MTMM measurement designs require different types of MTMM-SEMs.Eid et al. (2008) proposed three different MTMM-SEMs for measurement designs with (a) structurally different methods, (b) interchangeable methods, and (c) a combination of both types of methods. In the present work, we extend this taxonomy to a multilevel correlated traits–correlated methods minus one [CTC(M − 1)] model for nested structurally different methods. The new model enables researchers to study method effects on both measurement levels (i.e., within and between clusters, classes, schools, etc.) and evaluate the convergent and discriminant validity of the measures. The statistical performance of the model is examined by a simulation study, and recommendations for the application of the model are given.