Correcting Measurement Error in Content Analysis. Issue 2 (3rd April 2017)

• Record Type: Journal Article
• Authors: Bachl, Marko; Scharkow, Michael
• Is Part Of: Communication methods and measures. Volume 11:Issue 2(2017)
• Page Start: 87
• Page End: 104
• Publication Date: 2017-04-03
• Subjects: Communication -- Methodology -- Periodicals; Communication -- Research -- Periodicals; Communication -- Study and teaching -- Periodicals; 302.2072
• DOI: 10.1080/19312458.2017.1305103
• Languages: English
• ISSNs: 1931-2458

Abstract

ABSTRACT: Conducting and reporting reliability tests has become a standard practice in content analytical research. However, the consequences of measurement error in coding data are rarely discussed or taken into consideration in subsequent analyses. In this article, we demonstrate how misclassification in content analysis leads to biased estimates and introduce matrix back-calculation as a simple remedy. Using Monte Carlo simulation, we investigate how different ways of collecting information about the misclassification process influence the effectiveness of error correction under varying conditions. The results show that error correction with an adequate set-up can often substantially reduce bias. We conclude with an illustrative example, extensions of the procedure, and some recommendations.