Assessing Survey Satisficing: The Impact of Unmotivated Questionnaire Responding on Data Quality. (December 2021)

• Record Type: Journal Article
• Authors: Vriesema, Christine Calderon; Gehlbach, Hunter
• Is Part Of: Educational researcher. Volume 50:Number 9(2021)
• Page Start: 618
• Page End: 627
• Publication Date: 2021-12
• Subjects: attitude -- educational policy -- motivation -- questionnaire responding -- satisficing -- social–emotional learning (SEL) -- student behavior/attitude -- survey research; Education -- Periodicals; Education -- United States -- Periodicals; Education -- Research -- Periodicals; Education -- Research -- Methodology -- Periodicals; 370.72
• DOI: 10.3102/0013189X211040054
• Languages: English
• ISSNs: 0013-189X

Abstract

Education researchers use surveys widely. Yet, critics question respondents' ability to provide high-quality responses. As schools increasingly use student surveys to drive local policy making, respondents' (lack of) motivation to provide quality responses may threaten the wisdom of using questionnaires for data-based decision making. To better understand student satisficing—the practice of suboptimal responding on surveys—and its impact on data quality, we examined its pervasiveness and impact on a large-scale social–emotional learning survey administered to 409, 721 elementary and secondary students. Findings indicated that despite the prevalence of satisficing, its impact on data quality appeared more modest than anticipated. We conclude by outlining an accessible approach for defining and calculating satisficing for researchers, practitioners, and policymakers.