Evaluation of emergency preparedness exercises: the design of a questionnaire to measure staff perceptions. (23rd August 2021)

• Record Type: Journal Article
• Authors: Skryabina, Elena A.; Betts, Naomi; Reedy, Gabriel; Riley, Paul; Amlôt, Richard
• Is Part Of: International journal of emergency management. Volume 16:Number 4(2020)
• Page Start: 317
• Page End: 346
• Publication Date: 2021-08-23
• Subjects: HEPE -- health emergency preparedness exercises -- evaluation -- questionnaire -- survey -- TTX -- tabletop -- drill -- healthcare emergency responder -- emergency preparedness -- operation exercise -- simulation exercise -- healthcare emergency -- mass casualty -- major incident -- disaster; Emergency management -- Periodicals; 658.47705
• Languages: English
• ISSNs: 1471-4825

Abstract

Evaluation is an essential part of health emergency preparedness exercises (HEPE) that allows identification of limitations in performance. Addressing limitations enhances preparedness. However, there is a lack of reliable and validated tools to assist with exercise evaluation. This study reports the design and validation of a questionnaire to collect data from participants to study their experiences with HEPE and perceptions of their own and their organisation's emergency preparedness. Questionnaire test-retest reliability using ICC was checked (N = 27). Internal reliability using Cronbach's alpha is reported separately for discussion-based (N = 97) and operation-based exercises (N = 238). Analysis checked for discriminant validity and sensitivity to change. The questionnaire consists of four scales (parts): pre-exercise assessment, participant's perceptions, exercise feedback, and satisfaction with the exercise. All scales demonstrated good internal consistency for both exercise types (Cronbach's alpha: 0.672-0.940), but mixed test-retest agreement for the pre-exercise and exercise feedback scales. The questionnaire offers a valid and reliable tool for assessing healthcare staff perceptions of emergency preparedness and exercise satisfaction.