A Simple Question Goes a Long Way: A Wording Experiment on Bank Account Ownership. (9th December 2021)

• Record Type: Journal Article
• Authors: Angrisani, Marco; Couper, Mick P
• Is Part Of: Journal of Survey Statistics and Methodology. Volume 10:Number 5(2022)
• Page Start: 1172
• Page End: 1182
• Publication Date: 2021-12-09
• Subjects: Bank account ownership -- Cognitive ability -- Experiment -- Online probability panel -- Question wording; Surveys -- Methodology -- Periodicals; Surveys -- Evaluation -- Periodicals; Sampling (Statistics) -- Periodicals; 001.433
• DOI: 10.1093/jssam/smab045
• Languages: English
• ISSNs: 2325-0984

Abstract

Abstract: Ownership of a bank account is an objective measure and should be relatively easy to elicit via survey questions. Yet, depending on the interview mode, the wording of the question and its placement within the survey may influence respondents' answers. The Health and Retirement Study (HRS) asset module, as administered online to members of the Understanding America Study (UAS), yielded substantially lower rates of reported bank account ownership than either a single question on ownership in the Current Population Survey (CPS) or the full asset module administered to HRS panelists (both interviewer-administered surveys). We designed and implemented an experiment in the UAS comparing the original HRS question eliciting bank account ownership with two alternative versions that were progressively simplified. We document strong evidence that the original question leads to systematic underestimation of bank account ownership. In contrast, the proportion of bank account owners obtained from the simplest alternative version of the question is very similar to the population benchmark estimate. We investigate treatment effect heterogeneity by cognitive ability and financial literacy. We find that questionnaire simplification affects responses of individuals with higher cognitive ability substantially less than those with lower cognitive ability. Our results suggest that high-quality data from surveys start from asking the right questions, which should be as simple and precise as possible and carefully adapted to the mode of interview.