Mode and Frame Matter: Assessing the Impact of Survey Mode and Sample Frame in Choice Experiments. (October 2019)
- Record Type:
- Journal Article
- Title:
- Mode and Frame Matter: Assessing the Impact of Survey Mode and Sample Frame in Choice Experiments. (October 2019)
- Main Title:
- Mode and Frame Matter: Assessing the Impact of Survey Mode and Sample Frame in Choice Experiments
- Authors:
- Watson, Verity
Porteous, Terry
Bolt, Tim
Ryan, Mandy - Abstract:
- Background. Choice experiments (CE) are applied in health economics to elicit public preferences and willingness to pay (WTP). CEs are frequently administered as Internet-based surveys. Internet surveys have recognized advantages, but concerns exist about the representativeness of Internet samples, data quality, and the impact on elicited values.Aim. We conducted the first study in health comparing an Internet-based CE survey with the more traditional general population mail survey. We also compared the Internet-based and mail CE surveys with computer-assisted personal interviews (CAPIs), which are commonly used to elicit health state valuations.Methods. Two separate samples were drawn from 2 United Kingdom (UK) volunteer Internet panels (IPs), CAPIs were undertaken with respondents sampled from UK Census Output Areas, and mail surveys were sent to UK households drawn from the postcode address file (PAF). Each mode received more than 1000 respondents. We compared modes and frames using objective measures (response rate, sample representativeness of the UK population, elicited values, theoretical validity, and cost per response) and subjective/self-reported measures (time taken to complete the study, perceived study consequentiality, and stated attribute nonattendance). This study intentionally confounded the survey modes and sample frame by choosing sample frames that are typically used by researchers for each mode.Results. Estimated WTP differs across mode-frame pairs. OnBackground. Choice experiments (CE) are applied in health economics to elicit public preferences and willingness to pay (WTP). CEs are frequently administered as Internet-based surveys. Internet surveys have recognized advantages, but concerns exist about the representativeness of Internet samples, data quality, and the impact on elicited values.Aim. We conducted the first study in health comparing an Internet-based CE survey with the more traditional general population mail survey. We also compared the Internet-based and mail CE surveys with computer-assisted personal interviews (CAPIs), which are commonly used to elicit health state valuations.Methods. Two separate samples were drawn from 2 United Kingdom (UK) volunteer Internet panels (IPs), CAPIs were undertaken with respondents sampled from UK Census Output Areas, and mail surveys were sent to UK households drawn from the postcode address file (PAF). Each mode received more than 1000 respondents. We compared modes and frames using objective measures (response rate, sample representativeness of the UK population, elicited values, theoretical validity, and cost per response) and subjective/self-reported measures (time taken to complete the study, perceived study consequentiality, and stated attribute nonattendance). This study intentionally confounded the survey modes and sample frame by choosing sample frames that are typically used by researchers for each mode.Results. Estimated WTP differs across mode-frame pairs. On most measures, CAPIs dominated. They are more expensive, however. On all measures, except response rates, Internet surveys dominated the mail survey. They were also cheaper.Conclusion. Researchers using IPs should pay attention to response rates and be aware that the quality of IPs differs. Given the importance of perceived consequentiality and attribute attendance in CEs, future research should address their impact across modes and frames. … (more)
- Is Part Of:
- Medical decision making. Volume 39:Number 7(2019)
- Journal:
- Medical decision making
- Issue:
- Volume 39:Number 7(2019)
- Issue Display:
- Volume 39, Issue 7 (2019)
- Year:
- 2019
- Volume:
- 39
- Issue:
- 7
- Issue Sort Value:
- 2019-0039-0007-0000
- Page Start:
- 827
- Page End:
- 841
- Publication Date:
- 2019-10
- Subjects:
- choice experiment -- health care -- sample frame -- survey mode
Medical policy -- Periodicals
Clinical medicine -- Decision making -- Periodicals
Medicine -- Periodicals
Médecine clinique -- Prise de décision -- Périodiques
362.1 - Journal URLs:
- http://journals.sagepub.com/home/mdm ↗
http://www.ingenta.com/journals/browse/sage/j501 ↗
http://www.sagepublications.com/ ↗
http://firstsearch.oclc.org ↗
http://firstsearch.oclc.org/journal=0272-989x;screen=info;ECOIP ↗ - DOI:
- 10.1177/0272989X19871035 ↗
- Languages:
- English
- ISSNs:
- 0272-989X
- Deposit Type:
- Legaldeposit
- View Content:
- Available online (eLD content is only available in our Reading Rooms) ↗
- Physical Locations:
- British Library DSC - BLDSS-3PM
British Library HMNTS - ELD Digital store - Ingest File:
- 11748.xml