A Mixed‐Method Usability Study on User Experience with Systematic Review Software. Issue 1 (13th October 2021)

• Record Type: Journal Article
• Authors: Wang, Manhua; Sharmin, Selina; Wang, Mengqian; Yu, Fei
• Is Part Of: Proceedings of the Association for Information Science and Technology. Volume 58:Issue 1(2021)
• Page Start: 346
• Page End: 356
• Publication Date: 2021-10-13
• Subjects: gaze fixation -- Human‐computer interaction -- subjective workload -- systematic review -- user‐interface design; Information science -- Congresses; Information technology -- Congresses; Information science; Information technology; Conference papers and proceedings; 020
• DOI: 10.1002/pra2.462
• Languages: English
• ISSNs: 2373-9231

Abstract

Abstract: Systematic reviews are widely used in evidence‐based medicine. Conducting a systematic review requires intensive mental efforts, especially during the study screening process. This challenge has motivated the development of intelligent software. This study examined and compared the performance, workload, and user experience of two systematic review tools – Colandr with Artificial Intelligence (AI) features and Covidence without AI features by conducting a mixed‐method usability study. The results showed that reviewers had higher precision in citation screening using Colandr than using Covidence. However, the user experience with Colandr was not optimal due to problems in its user interface design. Therefore, we suggest that the design and development of AI‐enabled SR software emphasize the usability of the interface and apply user‐centered design principles.