Optimal control of a class of positive Markovian bilinear systems. (August 2016)

• Record Type: Journal Article
• Authors: Colaneri, Patrizio; Middleton, Richard H.; Blanchini, Franco
• Is Part Of: Nonlinear analysis. Volume 21(2016)
• Page Start: 155
• Page End: 170
• Publication Date: 2016-08
• Subjects: Positive switched systems -- Positive Markov jump linear systems -- Optimal control; Nonlinear functional analysis -- Periodicals; Analyse fonctionnelle non linéaire -- Périodiques; Nonlinear functional analysis; Periodicals; 515.7248
• DOI: 10.1016/j.nahs.2016.01.001
• Languages: English
• ISSNs: 1751-570X

Abstract

Abstract: In this paper a class of input-parametrized bilinear positive Markovian systems is considered. The class considered has switching control of the diagonal entries of the dynamical matrix, together with Markov jump dynamics. This class is relevant to a variety of dynamical models arising in system biology and compartmental systems. It is proven that the component of the expected value of the state vector is a convex functional of the input variables. If a linear cost of the final state is considered this implies that any Pontryagin solution of the associated optimal control problem is optimal and can be numerically computed by using standard gradient-type algorithms. Moreover, suboptimal strategies, both in open loop and closed loop are provided, mainly based on linear programming tools. An example is provided to illustrate the theory.