An experimental investigation of the impact of alert frequency and relevance on alert dwell time. (January 2020)

• Record Type: Journal Article
• Authors: Baysari, Melissa T.; Zheng, Wu Yi; Tariq, Amina; Heywood, Maureen; Scott, Grace; Li, Ling; Van Dort, Bethany A.; Rathnayake, Kasun; Day, Richard; Westbrook, Johanna I.
• Is Part Of: International journal of medical informatics. Volume 133(2020)
• Publication Date: 2020-01
• Subjects: Alert -- Alert dwell time -- CPOE; Medical informatics -- Periodicals; Information science -- Periodicals; Computers -- Periodicals; Medical technology -- Periodicals; Medical Informatics -- Periodicals; Technology, Medical -- Periodicals; Computers; Information science; Medical informatics; Medical technology; Electronic journals; Periodicals; Electronic journals; 610.285
• DOI: 10.1016/j.ijmedinf.2019.104027
• Languages: English
• ISSNs: 1386-5056

Abstract

Highlights: Large numbers of alerts led to users spending less time reading alerts. Alert relevance did not have an impact on alert dwell time. Alerts requiring an override were more likely to be correctly responded to. Abstract: Aim: This study aimed to determine the impact of alert frequency and relevance on alert dwell time. Method: A 2 × 3 design was used where 127 university students completed 60 prescribing tasks and were presented with a variable frequency of computerized alerts (low, medium and high) with variable relevance (low and high). Participants were instructed to override an alert if it was not relevant to their prescription, and to cancel the order if the alert signalled an error in their order. Results: Participants presented with a small number of alerts spent more time attending to alert content than participants presented with a medium or high number of alerts (respectively median 15.6 s vs 10.8 vs 10.2 s). Alert relevance had no impact on alert dwell time. Alerts requiring an override response were 4.5 times more likely to be correctly actioned than alerts requiring the order to be cancelled. Discussion: Dwell time was influenced by alert frequency, with greater exposure to alerts associated with shorter dwell times. We hypothesize that this was because participants came to learn that spending time on alert information was unnecessary. We propose that when users experience no consequences or feedback from overriding alerts they quickly learn that this action is more efficient and so more rewarding than taking any other action.