Lessons Learned in Leveraging Existing Simulations for Cybersecurity Training, Evaluation, and Research. (December 2020)

• Record Type: Journal Article
• Authors: Mabie, Daniel; Schuster, David
• Is Part Of: Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Volume 64:Part 1(2020)
• Page Start: 425
• Page End: 429
• Publication Date: 2020-12
• Subjects: Human engineering -- Congresses; 620.8205
• DOI: 10.1177/1071181320641095
• Languages: English
• ISSNs: 1541-9312

Abstract

We provide lessons learned in leveraging existing simulations to conduct human-subjects cybersecurity experiments and develop training for cybersecurity professionals. First, we provide criteria for the evaluation and categorization of existing simulation tools into four categories (competitions, testbeds, tabletop exercises, and simulations used in published research). Following this, eight criteria are offered to evaluate simulations on their suitability for use in experiments. We evaluated one representative product in each category. This paper serves as a resource for practitioners who use simulation as a method of training or evaluation. Further, this work is a starting point for researchers to efficiently find and leverage simulations to conduct cybersecurity research.