A Comparison of Composite Reliability Estimators: Coefficient Omega Confidence Intervals in the Current Literature. (June 2016)

• Record Type: Journal Article
• Authors: Padilla, Miguel A.; Divers, Jasmin
• Is Part Of: Educational and psychological measurement. Volume 76:Number 3(2016:Jun.)
• Page Start: 436
• Page End: 453
• Publication Date: 2016-06
• Subjects: coefficient omega -- reliability -- composite reliability -- bootstrap -- confidence interval -- interval estimate -- nonnormality -- ordinal -- dichotomous -- binary; Educational tests and measurements -- Periodicals; Psychological tests -- Periodicals; 151.205
• DOI: 10.1177/0013164415593776
• Languages: English
• ISSNs: 0013-1644

Abstract

Coefficient omega and alpha are both measures of the composite reliability for a set of items. Unlike coefficient alpha, coefficient omega remains unbiased with congeneric items with uncorrelated errors. Despite this ability, coefficient omega is not as widely used and cited in the literature as coefficient alpha. Reasons for coefficient omega's underutilization include a limited knowledge of its statistical properties. However, consistent efforts to understand the statistical properties of coefficient omega can help improve its utilization in research efforts. Here, six approaches for estimating confidence intervals for coefficient omega with unidimensional congeneric items were evaluated through a Monte Carlo simulation. The evaluations were made through simulation conditions that mimic realistic conditions that investigators are likely to face in applied work, including items that are not normally distributed and small sample size(s). Overall, the normal theory bootstrap confidence interval had the best performance across all simulation conditions that included sample sizes less than 100. However, most methods had sound coverage with sample sizes of 100 or more.