Creating Metrics for Human-Agent Teams. (December 2020)

• Record Type: Journal Article
• Authors: Cavanah, Elizabeth; Ford, Zachary; Jasper, Angelica; Stonewall, Jacklin; Gilbert, Stephen B.; Dorneich, Michael
• Is Part Of: Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Volume 64:Part 1(2020)
• Page Start: 349
• Page End: 353
• Publication Date: 2020-12
• Subjects: Human engineering -- Congresses; 620.8205
• DOI: 10.1177/1071181320641079
• Languages: English
• ISSNs: 1541-9312

Abstract

This paper describes the requirements and overall design of a testbed for a human-agent team. A robust, flexible testbed will enable researchers to evaluate the effectiveness of human-agent teaming concepts and issues. In the testbed, MazeWorld, multiple agents play different roles in which tasks are interdependent. Each role can be served by a human or an autonomous agent. Metrics were developed to capture individual and team effectiveness and allow researchers to compare different types of teams and teamwork protocols. Examples of the current task design are presented with the discussion of the future development of the system.