Abstract
This paper is concerned with partially-observed optimal control problems for stochastic delay systems. Combining Girsanov’s theorem with a standard variational technique, the authors obtain a maximum principle on the assumption that the system equation contains time delay and the control domain is convex. The related adjoint processes are characterized as solutions to anticipated backward stochastic differential equations in finite-dimensional spaces. Then, the proposed theoretical result is applied to study partially-observed linear-quadratic optimal control problem for stochastic delay system and an explicit observable control variable is given.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Kolmanovsky V B and Maizenberg T L, Optimal control of stochastic systems with aftereffect, Automation and Remote Control, 1973, 1: 47–61.
Øksendal B and Sulem A, A maximum principle for optimal control of stochastic systems with delay, with applications to finance, Optimal Control and Partial Differential Equations, Amsterdam: ISO Press, 2000, 64–79.
Larssen B, Dynamic programming in stochastic control of systems with delay, Stochastic and Stochastics Reports, 2002, 74(3): 651–673.
Peng S and Yang Z, Anticipated backward stochastic differential equations, Ann. Proba., 2009, 37(3): 877–902.
Bismut J M, An introductory approach to duality in optimal stochastic control, SIAM Rev., 1978, 20(1): 62–78.
Pardoux E and Peng S, Adapted solution of backward stochastic dierential equation, Systems Control Lett., 1990, 14(1): 55–61.
Chen L and Wu Z, Maximum principle for the stochastic optimal control problem with delay and application, Automatica, 2010, 46(6): 1074–1080.
Øksendal B, Sulem A, and Zhang T, Optimal control of stochastic delay equations and timeadvanced backward stochastic differential equations, Advances in Applied Probability, 2011, 43(2): 572–596.
Bensoussan A, Maximum principle and dynamic programming approaches of the optimal control of partially observed diffusions, Stochastics, 1983, 9(3): 169–222.
Li X and Tang S, General necessary conditions for partially observed optimal stochastic controls, J. Appl. Probab., 1995, 32(4): 1118–1137.
Tang S, The maximum principle for partially-observed optimal control of stochastic differential equations, SIAM J. Control Optim., 1998, 36(5): 1596–1617.
Zhang W, Zhao Y, and Sheng L, Some remarks on stability of stochastic singular systems with state-dependent noise, Automatica, 2014, 51: 273–277.
Wang G, Zhang C, and Zhang W, Stochastic maximum principle for mean-field type optimal control under partial information, IEEE Trans. Autom. Control, 2014, 59(2): 522–528.
Wang G and Wu Z, General maximum principles for partially observed risk-sensitive optimal control problems and applications to finance, J. Optim. Theory. Appl., 2009, 141(3): 677–700.
Wu Z, A maximum principle for partially observed optimal control of forward-backward stochastic control systems, Sci. China Ser. F., 2010, 53(11): 2205–2214.
Shi J and Wu Z, Maximum principle for partially-observed optimal control of fully-coupled forward-backward stochastic systems, J. Optim. Theory. Appl., 2010, 145(3): 543–578.
Chen L and Wu Z, A type of generalized forward-backward stochastic differential equations and applications, Chin. Ann. Math. Ser. B, 2011, 32(2): 279–292.
Liptser R S and Shiryayev A N, Statistics of Random Process, Springer-Verlag, New York, 1977.
Huang J, Li X, and Shi J, Froward-backward linear quadratic stochastic optimal control problem with delay, Systems Control Lett., 2012, 61(5): 623–630.
Huang J, Wang G, and Xiong J, A maximum principle for partial information backward stochastic control problems with applications, SIAM J. Control Optim., 2009, 48(4): 2106–2117.
Author information
Authors and Affiliations
Corresponding author
Additional information
This paper was recommended for publication by Editor XIE Lihua.
Rights and permissions
About this article
Cite this article
Wu, S., Shu, L. Maximum principle for partially-observed optimal control problems of stochastic delay systems. J Syst Sci Complex 30, 316–328 (2017). https://doi.org/10.1007/s11424-016-5078-4
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11424-016-5078-4