Crowdsourcing content analysis for managerial research. Issue 4 (13th May 2014)

• Record Type: Journal Article
• Authors: Simone Guercini, Professor; Conley, Caryn; Tosti-Kharas, Jennifer
• Is Part Of: Management decision. Volume 52:Issue 4(2014)
• Page Start: 675
• Page End: 688
• Publication Date: 2014-05-13
• Subjects: Management -- Periodicals; 658.403
• DOI: 10.1108/MD-03-2012-0156
• Languages: English
• ISSNs: 0025-1747

Abstract

<abstract> <title> <x content-type="archive" xml:space="preserve">Abstract</x> </title> <sec> <title content-type="abstract-heading">Purpose</title> <p> – The purpose of this paper is to evaluate the effectiveness of a novel method for performing content analysis in managerial research – crowdsourcing, a system where geographically distributed workers complete small, discrete tasks via the internet for a small amount of money. </p> </sec> <sec> <title content-type="abstract-heading">Design/methodology/approach</title> <p> – The authors examined whether workers from one popular crowdsourcing marketplace, Amazon's Mechanical Turk, could perform subjective content analytic tasks involving the application of inductively generated codes to unstructured, personally written textual passages. </p> </sec> <sec> <title content-type="abstract-heading">Findings</title> <p> – The findings suggest that anonymous, self-selected, non-expert crowdsourced workers were applied content codes efficiently and at low cost, and that their reliability and accuracy compared to that of trained researchers. </p> </sec> <sec> <title content-type="abstract-heading">Research limitations/implications</title> <p> – The authors provide recommendations for management researchers interested in using crowdsourcing most effectively for content analysis, including a discussion of the limitations and ethical issues involved in using this method. Future research could extend the findings by considering alternative data sources and coding schemes of interest to management researchers. </p> </sec> <sec> <title content-type="abstract-heading">Originality/value</title> <p> – Scholars have begun to explore whether crowdsourcing can assist in academic research; however, this is the first study to examine how crowdsourcing might facilitate content analysis. Crowdsourcing offers several advantages over existing content analytic approaches by combining the efficiency of computer-aided text analysis with the interpretive ability of traditional human coding.</p> </sec> </abstract>