A Comparison of Modern and Popular Approaches to Calculating Reliability for Dichotomously Scored Items. Issue 4 (June 2022)

• Record Type: Journal Article
• Authors: Béland, Sébastien; Falk, Carl F.
• Is Part Of: Applied psychological measurement. Volume 46:Issue 4(2022)
• Page Start: 321
• Page End: 337
• Publication Date: 2022-06
• Subjects: reliability -- factor analysis -- item response theory -- classical test theory -- dichotomous data; Psychometrics -- Periodicals; Psychological tests -- Periodicals; Psychology, Applied -- Periodicals; 150.1519505
• DOI: 10.1177/01466216221084210
• Languages: English
• ISSNs: 0146-6216

Abstract

Recent work on reliability coefficients has largely focused on continuous items, including critiques of Cronbach's alpha. Although two new model-based reliability coefficients have been proposed for dichotomous items (Dimitrov, 2003a, b; Green & Yang, 2009a), these approaches have yet to be compared to each other or other popular estimates of reliability such as omega, alpha, and the greatest lower bound. We seek computational improvements to one of these model-based reliability coefficients and, in addition, conduct initial Monte Carlo simulations to compare coefficients using dichotomous data. Our results suggest that such improvements to the model-based approach are warranted, while model-based approaches were generally superior.