Abstract
This paper is concerned with partially-observed optimal control problems for fully-coupled forward-backward stochastic systems. The maximum principle is obtained on the assumption that the forward diffusion coefficient does not contain the control variable and the control domain is not necessarily convex. By a classical spike variational method and a filtering technique, the related adjoint processes are characterized as solutions to forward-backward stochastic differential equations in finite-dimensional spaces. Then, our theoretical result is applied to study a partially-observed linear-quadratic optimal control problem for a fully-coupled forward-backward stochastic system and an explicit observable control variable is given.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Peng, S.G., Wu, Z.: Fully coupled forward-backward stochastic differential equations and applications to the optimal control. SIAM J. Control Optim. 37(3), 825–843 (1999)
Bensoussan, A.: Stochastic Control of Partially Observable Systems. Cambridge University Press, Cambridge (1992)
Haussmann, U.G.: The maximum principle for optimal control of diffusions with partial information. SIAM J. Control Optim. 25(2), 341–361 (1987)
Baras, J.S., Elliott, R.J., Kohlmann, M.: The partially-observed stochastic minimum principle. SIAM J. Control Optim. 27(6), 1279–1292 (1989)
Li, X.J., Tang, S.J.: General necessary conditions for partially-observed optimal stochastic controls. J. Appl. Probab. 32, 1118–1137 (1995)
Tang, S.J.: The maximum principle for partially-observed optimal control of stochastic differential equations. SIAM J. Control Optim. 36(5), 1596–1617 (1998)
Wu, Z.: A maximum principle for partially observed optimal control of forward–backward stochastic control systems, accepted to be published in Sci. China Ser. F (2010)
Wang, G.C., Wu, Z.: The maximum principle for stochastic recursive optimal control problems under partial information. IEEE Trans. Autom. Control 54, 1230–1242 (2009)
Cvitanic, J., Ma, J.: Hedging options for a large investor and forward-backward SDE’s. Ann. Appl. Probab. 6(2), 370–398 (1996)
Ma, J., Yong, J.M.: Forward-Backward Stochastic Differential Equations and Their Applications. Springer, Berlin (1999)
Antonelli, F.: Backward-Forward stochastic differential equations. Ann. Appl. Probab. 3(3), 777–793 (1993)
Ma, J., Protter, P., Yong, J.M.: Solving forward-backward stochastic differential equations explicitly-a four step scheme. Probab. Theory Relat. Fields 98, 339–359 (1994)
Hu, Y., Peng, S.G.: Solution of forward-backward stochastic differential equations. Probab. Theory Relat. Fields 103, 273–283 (1995)
Yong, J.M.: Finding adapted solutions of forward-backward stochastic differential equations: method of continuation. Probab. Theory Relat. Fields 107, 537–572 (1997)
Pardoux, E., Tang, S.J.: Forward-backward stochastic differential equations and quasilinear parabolic PDEs. Probab. Theory Relat. Fields 114, 123–150 (1999)
Delarue, F.: On the Existence and Uniqueness of Solutions to FBSDEs in a Non-Degenerate Case. Stoch. Process. Appl. 99, 209–286 (2002)
Zhang, J.F.: The wellposedness of FBSDEs. Discrete Contin. Dyn. Syst., Ser. B 6, 927–940 (2006)
Xu, W.S.: Stochastic maximum principle for optimal control problem of forward and backward system. J. Aust. Math. Soc., Ser. B 37, 172–185 (1995)
Shi, J.T., Wu, Z.: The maximum principle for fully coupled forward-backward stochastic control systems. Acta Autom. Sinica 32, 161–169 (2006)
Liptser, R.S., Shiryayev, A.N.: Statistics of Random Process. Springer, New York (1977)
Baghery, F., Øksendal, B.: A maximum principle for stochastic control with partial information. Stoch. Anal. Appl. 25, 705–717 (2007)
Meyer-Brandis, T., Øksendal, B., Zhou, X.Y.: A maximum principle via Malliavin calculus. Pure Math., Vol. 10 (2008). University of Oslo
Øksendal, B., Sulem, A.: Maximum principles for optimal control of forward-backward stochastic differential equations with jumps. Pure Math., Vol. 22 (2008). University of Oslo
Meng, Q.X.: A maximum principle for optimal control problem of fully coupled forward-backward stochastic systems with partial information. Sci. China Ser. A 52(7), 1579–1588 (2009)
Yu, Z.Y.: Some backward problems in stochastic control and game theory. PhD Thesis, Shandong University (2008)
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by F. Zirilli.
This work was supported by the National Basic Research Program of China (973 Program, Grant. 2007CB814904), the National Natural Science Foundations of China (Grants. 10921101, 10701050) and the Natural Science Foundation of Shandong Province (Grants. JQ200801 and 2008BS01024).
Rights and permissions
About this article
Cite this article
Shi, J.T., Wu, Z. Maximum Principle for Partially-Observed Optimal Control of Fully-Coupled Forward-Backward Stochastic Systems. J Optim Theory Appl 145, 543–578 (2010). https://doi.org/10.1007/s10957-010-9696-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10957-010-9696-z