The quality of data collected online: An investigation of careless responding in a crowdsourced sample. (November 2020)

• Record Type: Journal Article
• Authors: Brühlmann, Florian; Petralito, Serge; Aeschbach, Lena F.; Opwis, Klaus
• Is Part Of: Methods in psychology. Volume 2(2020)
• Publication Date: 2020-11
• Subjects: Careless responding -- Crowdsourcing -- Survey -- Response patterns -- Inattentive responding -- Open answer -- Latent profile analysis; Psychology -- Periodicals; 150.5
• DOI: 10.1016/j.metip.2020.100022
• Languages: English
• ISSNs: 2590-2601

Abstract

Abstract: Despite recent concerns about data quality, various academic fields rely increasingly on crowdsourced samples. Thus, the goal of this study was to systematically assess carelessness in a crowdsourced sample (N = 394) by applying various measures and detection methods. A Latent Profile Analysis revealed that 45.9% of the participants showed some form of careless behavior. Excluding these participants increased the effect size in an experiment included in the survey. Based on our findings, several recommendations of easy to apply measures for assessing data quality are given.