The Effects of Sampling Frequency and Questionnaire Length on Perceived Burden, Compliance, and Careless Responding in Experience Sampling Data in a Student Population. (March 2022)

• Record Type: Journal Article
• Authors: Eisele, Gudrun; Vachon, Hugo; Lafit, Ginette; Kuppens, Peter; Houben, Marlies; Myin-Germeys, Inez; Viechtbauer, Wolfgang
• Is Part Of: Assessment. Volume 29:Number 2(2022)
• Page Start: 136
• Page End: 151
• Publication Date: 2022-03
• Subjects: experience sampling -- ecological momentary assessment -- sampling frequency -- questionnaire length -- data quality; Psychological tests -- Periodicals; Psychodiagnostics -- Periodicals; Personality tests -- Periodicals; 150.287
• DOI: 10.1177/1073191120957102
• Languages: English
• ISSNs: 1073-1911

Abstract

Currently, little is known about the association between assessment intensity, burden, data quantity, and data quality in experience sampling method (ESM) studies. Researchers therefore have insufficient information to make informed decisions about the design of their ESM study. Our aim was to investigate the effects of different sampling frequencies and questionnaire lengths on burden, compliance, and careless responding. Students ( n = 163) received either a 30- or 60-item questionnaire three, six, or nine times per day for 14 days. Preregistered multilevel regression analyses and analyses of variance were used to analyze the effect of design condition on momentary outcomes, changes in those outcomes over time, and retrospective outcomes. Our findings offer support for increased burden and compromised data quantity and quality with longer questionnaires, but not with increased sampling frequency. We therefore advise against the use of long ESM questionnaires, while high-sampling frequencies do not seem to be associated with negative consequences.