Decentralised dynamic games for large population stochastic multi‐agent systems. Issue 3 (1st February 2015)

• Record Type: Journal Article
• Authors: Wang, Xuehe; Xiao, Nan; Xie, Lihua; Frazzoli, Emilio; Rus, Daniela
• Is Part Of: IET control theory & applications. Volume 9:Issue 3(2015)
• Page Start: 503
• Page End: 510
• Publication Date: 2015-02-01
• Subjects: decentralised control -- multi‐agent systems -- stochastic systems -- game theory -- asymptotic stability -- optimal control -- nonlinear dynamical systems; decentralised dynamic games -- population stochastic multiagent systems -- dynamic equations -- long time average cost -- LTA cost -- agent states -- population state average -- PSA -- decentralised control design -- Nash certainty equivalence -- stability property -- mass behaviour -- asymptotic Nash equilibrium property -- optimal controls -- nonlinear system dynamics -- decentralised mean field social control laws -- mean field Nash controls -- infinite population systems; Control theory -- Periodicals; Automatic control -- Periodicals; 629.8312
• DOI: 10.1049/iet-cta.2014.0625
• Languages: English
• ISSNs: 1751-8644

Abstract

Abstract : In this study, the authors consider the large population dynamic games where each agent evolves according to a dynamic equation containing the input average of all agents. The long time average (LTA) cost that each agent aims to minimise is coupled with other agents' states via a population state average (PSA), which is also known as the mean field term. In order to design decentralised controls, the Nash certainty equivalence is introduced. It is shown that the resulting decentralised mean field control laws lead the system to mean‐consensus asymptotically as time goes to infinity. The stability property of the mass behaviour and the almost sure asymptotic Nash equilibrium property of the optimal controls are also guaranteed, and the case with non‐linear system dynamics is also discussed. In addition, the influence of inaccurate mean field information on individual agent is analysed. Finally, they investigate the socially cooperative formulation where the objective is to minimise the social cost as the sum of all individual LTA costs containing the PSA. In this case, they show that the decentralised mean field social controls are the same as the mean field Nash controls for infinite population systems.