Evaluating the impact of a simulation study in emergency stroke care. (September 2015)

• Record Type: Journal Article
• Authors: Monks, Thomas; Pearson, Mark; Pitt, Martin; Stein, Ken; James, Martin A.
• Is Part Of: Operations research for health care. Volume 6(2015:Sep.)
• Page Start: 40
• Page End: 49
• Publication Date: 2015-09
• Subjects: Stroke -- Simulation -- OR in health services -- Implementation -- Evaluation; Medical care -- Mathematical models -- Periodicals; Medical policy -- Mathematical models -- Periodicals; Health services administration -- Mathematical models -- Periodicals; Operations research -- Periodicals; Operations Research -- Periodicals; Health Services Research -- Periodicals; Health Policy -- Periodicals; Delivery of Health Care -- Periodicals; 362.106805
• DOI: 10.1016/j.orhc.2015.09.002
• Languages: English
• ISSNs: 2211-6923

Abstract

Abstract: Very few discrete-event simulation studies follow up on recommendations with evaluation of whether modelled benefits have been realised and the extent to which modelling contributed to any change. This paper evaluates changes made to the emergency stroke care pathway at a UK hospital informed by a simulation modelling study. The aims of the study were to increase the proportion of people with strokes that undergo a time-sensitive treatment to breakdown a blood clot within the brain and decrease the time to treatment. Evaluation involved analysis of stroke treatment pre- and post-implementation, as well as a comparison of how the research team believed the intervention would aid implementation compared to what actually happened. Two years after the care pathway was changed, treatment rates had increased in line with expectations and the hospital was treating four times as many patients than before the intervention in half the time. There is evidence that the modelling process aided implementation, but not always in line with expectations of the research team. Despite user involvement throughout the study it proved difficult to involve a representative group of clinical stakeholders in conceptual modelling and this affected model credibility. The research team also found batch experimentation more useful than visual interactive simulation to structure debate and decision making. In particular, simple charts of results focused debates on the clinical effectiveness of drugs — an emergent barrier to change. Visual interactive simulation proved more useful for engaging different hospitals and initiating new projects. Highlights: We study the impact of changes to a stroke pathway following a simulation study. We evaluate quantitative system performance and critique the modelling process. Patient treatment rates increased fourfold while arrival to treatment times halved. User involvement in conceptual modelling was affected by selection bias. VIS proved more useful for initial engagement and project buy-in.