The idiosyncrasies of everyday digital lives: Using the Human Screenome Project to study user behavior on smartphones. (January 2021)

• Record Type: Journal Article
• Authors: Brinberg, Miriam; Ram, Nilam; Yang, Xiao; Cho, Mu-Jung; Sundar, S. Shyam; Robinson, Thomas N.; Reeves, Byron
• Is Part Of: Computers in human behavior. Volume 114(2021)
• Publication Date: 2021-01
• Subjects: Screenomics -- Smartphone use -- Intensive longitudinal data -- Digital phenotyping; Interactive computer systems -- Periodicals; Man-machine systems -- Periodicals; 004.019
• DOI: 10.1016/j.chb.2020.106570
• Languages: English
• ISSNs: 0747-5632

Abstract

Abstract: Most methods used to make theory-relevant observations of technology use rely on self-report or application logging data where individuals' digital experiences are purposively summarized into aggregates meant to describe how the average individual engages with broadly defined segments of content. This aggregation and averaging masks heterogeneity in how and when individuals actually engage with their technology. In this study, we use screenshots ( N > 6 million) collected every 5five seconds that were sequenced and processed using text and image extraction tools into content-, context-, and temporally-informative "screenomes" from 132 smartphone users over several weeks to examine individuals' digital experiences. Analyses of screenomes highlight extreme between-person and within-person heterogeneity in how individuals switch among and titrate their engagement with different content. Our simple quantifications of textual and graphical content and flow throughout the day illustrate the value screenomes have for the study of individuals' smartphone use and the cognitive and psychological processes that drive use. We demonstrate how temporal, textual, graphical, and topical features of people's smartphone screens can lay the foundation for expanding the Human Screenome Project with full-scale mining that will inform researchers' knowledge of digital life. Highlights: Descriptions of media use based on aggregate individuals' experiences may be wrong. Screenomics provides in situ observation of individuals' actual digital life. Textual, graphical, topical content of individuals' screens differs substantially. The details in the screenome open new insights for researchers/designers. Observation at fine resolution suggests need for new theories of media use.