What Influences Trust in Survey Results? Evidence From a Vignette Experiment. (29th July 2022)

• Record Type: Journal Article
• Authors: Stadtmüller, Sven; Silber, Henning; Beuthner, Christoph
• Is Part Of: International journal of public opinion research. Volume 34:Number 2(2022)
• Publication Date: 2022-07-29
• Subjects: survey data quality -- perceived trustworthiness -- sample size -- representativeness -- sampling method -- heuristics; Public opinion -- Addresses, essays, lectures -- Periodicals; 303.38
• DOI: 10.1093/ijpor/edac012
• Languages: English
• ISSNs: 0954-2892

Abstract

Abstract: More survey results are available today than ever before. This increase in survey data has been accompanied by growing concerns about their quality. With the present study, we aim to investigate to what extent the public draws on survey quality information when evaluating the trustworthiness of survey results. We implemented a vignette experiment in an online panel survey ( N = 3, 313), in which respondents each received four different survey descriptions with varying methodological information. Compared with respondent characteristics, survey quality information had only a minor effect on perceptions of trustworthiness. However, trust in the survey results was significantly influenced by sample size and sample balance. Finally, the relevance of survey quality information increased with the cognitive ability of the respondent.