Enhancing Video Games Policy Based on Least-Squares Continuous Action Policy Iteration: Case Study on StarCraft Brood War and Glest RTS Games and the 8 Queens Board Game. (3rd January 2016)

• Record Type: Journal Article
• Authors: Sarhan, Shahenda; Abu ElSoud, Mohamed; Rashed, Hebatullah
• Other Names: Oliveira Manuel M. Academic Editor.
• Is Part Of: International journal of computer games technology. Volume 2016(2016)
• Publication Date: 2016-01-03
• Subjects: Computer games -- Design -- Periodicals; Computer games -- Programming -- Periodicals; Jeux d'ordinateur; Jeux d'ordinateur -- Programmation; Computer games -- Design; Computer games -- Programming; Electronic journals; Periodicals; 794.81
• DOI: 10.1155/2016/7090757
• Languages: English
• ISSNs: 1687-7047

Abstract

Abstract : With the rapid advent of video games recently and the increasing numbers of players and gamers, only a tough game with high policy, actions, and tactics survives. How the game responds to opponent actions is the key issue of popular games. Many algorithms were proposed to solve this problem such as Least-Squares Policy Iteration (LSPI) and State-Action-Reward-State-Action (SARSA) but they mainly depend on discrete actions, while agents in such a setting have to learn from the consequences of their continuous actions, in order to maximize the total reward over time. So in this paper we proposed a new algorithm based on LSPI called Least-Squares Continuous Action Policy Iteration (LSCAPI). The LSCAPI was implemented and tested on three different games: one board game, the 8 Queens, and two real-time strategy (RTS) games, StarCraft Brood War and Glest. The LSCAPI evaluation proved superiority over LSPI in time, policy learning ability, and effectiveness.