Two Half-Truths Make a Whole? On Bias in Self-Reports and Tracking Data. (October 2020)

• Record Type: Journal Article
• Authors: Jürgens, Pascal; Stark, Birgit; Magin, Melanie
• Other Names: Stier Sebastian guest-editor.; Siegers Pascal guest-editor.; Breuer Johannes guest-editor.; Thorson Kjerstin guest-editor.
• Is Part Of: Social science computer review. Volume 38:Number 5(2020)
• Page Start: 600
• Page End: 615
• Publication Date: 2020-10
• Subjects: tracking data -- self-reports -- media exposure -- quantitative methods -- nonreactive measurement -- survey -- digital traces; Social sciences -- Data processing -- Periodicals; Computers -- Social aspects -- Periodicals; Microcomputers -- Periodicals; Sciences sociales -- Informatique -- Périodiques; Micro-ordinateurs -- Périodiques; 300.285
• DOI: 10.1177/0894439319831643
• Languages: English
• ISSNs: 0894-4393

Abstract

The pervasive use of mobile information technologies brings new patterns of media usage, but also challenges to the measurement of media exposure. Researchers wishing to, for example, understand the nature of selective exposure on algorithmically driven platforms need to precisely attribute individuals' exposure to specific content. Prior research has used tracking data to show that survey-based self-reports of media exposure are critically unreliable. So far, however, little effort has been invested into assessing the specific biases of tracking methods themselves. Using data from a multimethod study, we show that tracking data from mobile devices is linked to systematic distortions in self-report biases. Further inherent but unobservable sources of bias, along with potential solutions, are discussed.