Stochastic optimal control in infinite dimensions with state constraints. (October 2022)

• Record Type: Journal Article
• Authors: Moon, Jun
• Is Part Of: Nonlinear analysis. Volume 223(2022)
• Publication Date: 2022-10
• Subjects: 93E20 -- 35R15 -- 49L25; State-constrained control problem -- Hamilton–Jacobi–Bellman equation in infinite dimensions -- Viscosity solution -- Backward reachability analysis; Mathematical analysis -- Periodicals; Functional analysis -- Periodicals; Nonlinear theories -- Periodicals; Analyse mathématique -- Périodiques; Analyse fonctionnelle -- Périodiques; Théories non linéaires -- Périodiques; Functional analysis; Mathematical analysis; Nonlinear theories; Periodicals; Electronic journals; 515.7248
• DOI: 10.1016/j.na.2022.113050
• Languages: English
• ISSNs: 0362-546X

Abstract

Abstract: We consider the state-constrained stochastic optimal control problem in infinite-dimensional separable Hilbert spaces, where the state process is driven by the Q -Wiener process and the (possibly unbounded) linear operator. By applying the stochastic target theory and the backward reachability approach, we show that the original (possibly discontinuous) value function can be represented by the zero-level set of the auxiliary (continuous) value function. The auxiliary value function is obtained from the penalized unconstrained stochastic control problem (in infinite dimensions) that includes an additional control variable as a consequence of the (infinite-dimensional) martingale representation theorem. We then prove that the auxiliary value function is a unique (continuous) viscosity solution to the associated Hamilton–Jacobi–Bellman (HJB) equation in infinite dimensions. Note that the viscosity analysis developed in our paper generalizes that presented in the existing literature, since the corresponding infinite-dimensional HJB equation includes an additional operator-valued control variable in the Hamiltonian maximization and depends on an additional initial state variable.