Bringing Social Context Back In: Enriching Political Participation Surveys with Measures of Social Interaction from Social Media Content Data. (6th September 2021)

• Record Type: Journal Article
• Authors: Carlsen, Hjalmar Bang; ToubØl, Jonas; Ralund, Snorre
• Is Part Of: Public opinion quarterly. Volume 85(2021)supplement 1
• Page Start: 264
• Page End: 288
• Publication Date: 2021-09-06
• Subjects: Public opinion -- Periodicals; Public opinion; Periodicals; 303.38
• DOI: 10.1093/poq/nfab022
• Languages: English
• ISSNs: 0033-362X

Abstract

Abstract: This article demonstrates the utility of combining individual survey data with social media content data in order to analyze how social context predicts individual behavior. The lack of valid and reliable measures of the contexts of social interaction in which individuals are embedded has remained an Achilles heel of the survey method. The reason is that the collection of direct observation of social interaction requires qualitative analysis of the context, which, hitherto, has been too costly to collect on a large scale. Instead, researchers have resorted to indirect measures such as aggregate group composition, respondent reports of social context, and institutional accounts. However, with the recent advent of social media data, contemporary social scientists now have social interaction data on an unprecedented scale. To utilize these data for quantitative analysis, researchers have to transform text prose into good measurement. We combine qualitative content analysis and supervised machine learning in order to ensure both semantic validity and accuracy in our measure of social interaction in Facebook groups. To test the substantive performance of the direct measures of social interaction, we use it to predict individual participation in refugee solidarity activism in Denmark. Additional testing indicates that the direct measure cannot easily be replaced by indirect measures of social interaction derived from group composition and institutional accounts. We also show how contexts and individual respondents can be effectively sampled using Facebook groups. Finally, the article discusses the limitations of social media data and points to alternate settings where our design is applicable.