Iterative Path Integral Approach to Nonlinear Stochastic Optimal Control Under Compound Poisson Noise. Issue 2 (18th October 2016)

• Record Type: Journal Article
• Authors: Yuta, Okumura; Kashima, Kenji; Ohta, Yoshito
• Is Part Of: Asian journal of control. Volume 19:Issue 2(2017)
• Page Start: 781
• Page End: 786
• Publication Date: 2016-10-18
• Subjects: Stochastic optimal control -- Lévy process -- path‐integral -- nonlinear systems -- Monte‐Carlo method; Automatic control -- Periodicals; Control theory -- Periodicals; 629.805
• DOI: 10.1002/asjc.1402
• Languages: English
• ISSNs: 1561-8625

Abstract

Abstract: Nonlinear stochastic optimal control theory has played an important role in many fields. In this theory, uncertainties of dynamics have usually been represented by Brownian motion, which is Gaussian white noise. However, there are many stochastic phenomena whose probability density has a long tail, which suggests the necessity to study the effect of non‐Gaussianity. This paper employs Lévy processes, which cause outliers with a significantly higher probability than Brownian motion, to describe such uncertainties. In general, the optimal control law is obtained by solving the Hamilton–Jacobi–Bellman equation. This paper shows that the path‐integral approach combined with the policy iteration method is efficiently applicable to solve the Hamilton–Jacobi–Bellman equation in the Lévy problem setting. Finally, numerical simulations illustrate the usefulness of this method.