Surrogate-agent modeling for improved training. (September 2018)

• Record Type: Journal Article
• Authors: Tavcar, Ales; Gams, Matjaz
• Is Part Of: Engineering applications of artificial intelligence. Volume 74(2018)
• Page Start: 280
• Page End: 293
• Publication Date: 2018-09
• Subjects: Multi-agent systems -- Agent-based simulation training -- Decision making -- Behavior analysis -- Data farming; Engineering -- Data processing -- Periodicals; Artificial intelligence -- Periodicals; Expert systems (Computer science) -- Periodicals; Ingénierie -- Informatique -- Périodiques; Intelligence artificielle -- Périodiques; Systèmes experts (Informatique) -- Périodiques; Artificial intelligence; Engineering -- Data processing; Expert systems (Computer science); Periodicals; 620.00285
• DOI: 10.1016/j.engappai.2018.07.001
• Languages: English
• ISSNs: 0952-1976

Abstract

Abstract: Extensive skill training using simulations for improving decision making has become a common practice in a multitude of domains and professions due to the expense or danger of training in real-life circumstances, or to speed up the learning process. In this work we propose a novel approach called PATDS (Performance Analysis of Training through Data-Farming Simulations) in which a simulated agent as a virtual copy of a human trainee is constructed and tested in all circumstances to provide feedback and decision support for another round of human learning. PATDS includes the analysis of behavior demonstrated by the trainee in simulations and the identification of relevant behavior patterns; that is, strategies. The identified patterns are in turn used to model a surrogate agent of the trainee. The created agent is then evaluated with data-farming experiments on a variety of simulation parameters to estimate the key weaknesses in its behavior and the overall performance. In subsequent rounds of training, the trainee improves the behavior based on the identified weaknesses and strategic decision recommendations; a new surrogate agent is designed adding new skills from the trainee until the desired overall performance is achieved. We evaluated the proposed approach on two asymmetric urban-terrain threat scenarios where a squad of security forces interacts with hostile crowds. We demonstrate that the data-farming-based evaluation in the complete simulation parameter space is beneficial for improving the trainees' capabilities. Highlights: High-level knowledge of the trainee is extracted from observing his performance. Behavior patterns can create a realistic surrogate agent of the trainee. Behavior evaluation helps identifying weaknesses and improves decision making. Data-farming-based evaluation helps improving the trainees' capabilities.