Simulation With PARTS (Phase-Augmented Research and Training Scenarios). Issue 3 (June 2015)

• Record Type: Journal Article
• Authors: Schick, Carl J.; Weiss, Mona; Kolbe, Michaela; Marty, Adrian; Dambach, Micha; Knauth, Axel; Spahn, Donat R.; Grote, Gudela; Grande, Bastian
• Is Part Of: Simulation in healthcare. Volume 10:Issue 3(2015)
• Publication Date: 2015-06
• Subjects: Simulated patients -- Periodicals; 362.1
• DOI: 10.1097/SIH.0000000000000085
• Languages: English
• ISSNs: 1559-2332

Abstract

<abstract> <title> <x xml:space="preserve">Abstract</x> </title> <sec> <title>Introduction</title> <p>Assessment in simulation is gaining importance, as are scenario design methods increasing opportunity for assessment. We present our approach to improving measurement in complex scenarios using PARTS [Phase-Augmented Research and Training Scenarios], essentially separating cases into clearly delineated phases.</p> </sec> <sec> <title>Methods</title> <p>We created 7 PARTS with real-time rating instruments and tested these in 63 cases during 4 weeks of simulation. Reliability was tested by comparing real-time rating with postsimulation video-based rating using the same instrument. Validity was tested by comparing preintervention and postintervention total results, by examining the difference in improvement when focusing on the phase-specific results addressed by the intervention, and further explored by trying to demonstrate the discrete improvement expected from proficiency in the rare occurrence of leader inclusive behavior.</p> </sec> <sec> <title>Results</title> <p>Intraclass correlations [3, 1] between real-time and postsimulation ratings were 0.951 (95% confidence interval [CI], 0.794–0.990), 1.00 (95% CI, — to —), 0.948 (95% CI, 0.783–0.989), and 0.995 (95% CI, 0.977–0.999) for 3 phase-specific scores and total scenario score, respectively. Paired <italic>t</italic> tests of prelecture-postlecture performance showed an improvement of 14.26% (bias-corrected and accelerated bootstrap [BCa] 95% CI, 4.71–23.82; <italic>P</italic> = 0.009) for total performance but of 28.57% (BCa 95% CI, 13.84–43.30; <italic>P</italic> = 0.002) for performance in the respective phase. The correlation of total scenario performance with leader inclusiveness was not significant (<italic>r</italic><sub>s</sub> = 0.228; BCa 95% CI. −0.082 to 0.520; <italic>P</italic> = 0.119) but significant for specific phase performance (<italic>r</italic><sub>s</sub> = 0.392; BCa 95% CI, 0.118–0.632; <italic>P</italic> = 0.006).</p> </sec> <sec> <title>Conclusions</title> <p>The PARTS allowed for improved reliability and validity of measurements in complex scenarios.</p> </sec> </abstract>