Quantifying and addressing the impact of measurement error in network models. (October 2022)

• Record Type: Journal Article
• Authors: de Ron, Jill; Robinaugh, Donald J.; Fried, Eiko I.; Pedrelli, Paola; Jain, Felipe A.; Mischoulon, David; Epskamp, Sacha
• Is Part Of: Behaviour research and therapy. Volume 157(2022)
• Publication Date: 2022-10
• Subjects: Measurement error -- Replicability -- Single-item indicators -- Multiple-item indicators -- Latent network modeling; Cognitive therapy -- Periodicals; Psychotherapy -- Periodicals; 616.891
• DOI: 10.1016/j.brat.2022.104163
• Languages: English
• ISSNs: 0005-7967

Abstract

Abstract: Network psychometric models are often estimated using a single indicator for each node in the network, thus failing to consider potential measurement error. In this study, we investigate the impact of measurement error on cross-sectional network models. First, we conduct a simulation study to evaluate the performance of models based on single indicators as well as models that utilize information from multiple indicators per node, including average scores, factor scores, and latent variables. Our results demonstrate that measurement error impairs the reliability and performance of network models, especially when using single indicators. The reliability and performance of network models improves substantially with increasing sample size and when using methods that combine information from multiple indicators per node. Second, we use empirical data from the STAR*D trial (n = 3, 731) to further evaluate the impact of measurement error. In the STAR*D trial, depression symptoms were assessed via three questionnaires, providing multiple indicators per symptom. Consistent with our simulation results, we find that when using sub-samples of this dataset, the discrepancy between the three single-indicator networks (one network per questionnaire) diminishes with increasing sample size. Together, our simulated and empirical findings provide evidence that measurement error can hinder network estimation when working with smaller samples and offers guidance on methods to mitigate measurement error. Highlights: Many psychological network studies use one item to query a symptom. One item variables are a major potential limitation for the reliability for networks due to measurement error. Here, we investigate the impact of measurement error on cross-sectional network models. We also investigate which different multiple-indicator methods can best be used to mitigate the effects of measurement error.