You are here
Evaluation of emergency preparedness exercises: the design of a questionnaire to measure staff perceptions
Publication date:
23 Aug 2021
Ref:
International Journal of Emergency Management, 2020 Vol.16 No.4, pp.317 - 346
Author(s):
Skryabina EA, Betts N, Reedy G, Riley P and Amlôt R
Publication type:
Article
Abstract:
Abstract: Evaluation is an essential part of health emergency preparedness exercises (HEPE) that allows identification of limitations in performance. Addressing limitations enhances preparedness. However, there is a lack of reliable and validated tools to assist with exercise evaluation. This study reports the design and validation of a questionnaire to collect data from participants to study their experiences with HEPE and perceptions of their own and their organisation's emergency preparedness. Questionnaire test-retest reliability using ICC was checked (N = 27). Internal reliability using Cronbach's alpha is reported separately for discussion-based (N = 97) and operation-based exercises (N = 238). Analysis checked for discriminant validity and sensitivity to change. The questionnaire consists of four scales (parts): pre-exercise assessment, participant's perceptions, exercise feedback, and satisfaction with the exercise. All scales demonstrated good internal consistency for both exercise types (Cronbach's alpha: 0.672-0.940), but mixed test-retest agreement for the pre-exercise and exercise feedback scales. The questionnaire offers a valid and reliable tool for assessing healthcare staff perceptions of emergency preparedness and exercise satisfaction.