A tool to measure shared clinical understanding following handoffs to help evaluate handoff quality. Issue 3 (31st January 2014)

• Record Type: Journal Article
• Authors: Bates, Katherine E.; Bird, Geoffrey L.; Shea, Judy A.; Apkon, Michael; Shaddy, Robert E.; Metlay, Joshua P.
• Is Part Of: Journal of hospital medicine. Volume 9:Issue 3(2014)
• Page Start: 142
• Page End: 147
• Publication Date: 2014-01-31
• Subjects: Hospital care -- Periodicals; Clinical medicine -- Periodicals; 610
• DOI: 10.1002/jhm.2147
• Languages: English
• ISSNs: 1553-5592

Abstract

<abstract abstract-type="main"> <title> <x xml:space="preserve">Abstract</x> </title> <sec id="jhm2147-sec-0001" sec-type="section"> <title>BACKGROUND</title> <p>Information exchanged during handoffs contributes importantly to a team's shared mental model. There is no established instrument to measure shared clinical understanding as a marker of handoff quality.</p> </sec> <sec id="jhm2147-sec-0002" sec-type="section"> <title>OBJECTIVE</title> <p>To study the reliability, validity, and feasibility of the pediatric cardiology Patient Knowledge Assessment Tool (PKAT), a novel instrument designed to measure shared clinical understanding for pediatric cardiac intensive care unit patients.</p> </sec> <sec id="jhm2147-sec-0003" sec-type="section"> <title>DESIGN</title> <p>To estimate reliability, 10 providers watched 9 videotaped simulated handoffs and then completed a PKAT for each scenario. To estimate construct validity, we studied 90 handoffs in situ by having 4 providers caring for an individual patient each complete a PKAT following handoff. Construct validity was assessed by testing the effects of provider preparation and patient complexity on agreement levels.</p> </sec> <sec id="jhm2147-sec-0004" sec-type="section"> <title>SETTING</title> <p>A 24‐bed pediatric cardiac intensive care unit in a freestanding children's hospital.</p> </sec> <sec id="jhm2147-sec-0005" sec-type="section"> <title>RESULTS</title> <p>Video simulation results demonstrated score reliability. Average inter‐rater agreement by item ranged from 0.71 to 1.00. During in situ testing, agreement by item ranged from 0.41 to 0.87 (median 0.77). Construct validity for some items was supported by lower agreement rates for patients with increased length of stay and increased complexity.</p> </sec> <sec id="jhm2147-sec-0006" sec-type="section"> <title>DISCUSSION</title> <p>Results suggest that the PKAT has high inter‐rater reliability and can detect differences in understanding between handoff senders and receivers for routine and complex patients. Additionally, the PKAT is feasible for use in a real‐time clinical environment. The PKAT or similar instruments could be used to study effects of handoff improvement efforts in inpatient settings. <italic>Journal of Hospital Medicine</italic> 2014;9:142–147. © 2014 Society of Hospital Medicine</p> </sec> </abstract>