Abstract
In this work, we address an uncertain minimax optimal control problem with linear dynamics where the objective functional is the expected value of the supremum of the running cost over a time interval. By taking an independently drawn random sample, the expected value function is approximated by the corresponding sample average function. We study the epi-convergence of the approximated objective functionals as well as the convergence of their global minimizers. Then we define an Euler discretization in time of the sample average problem and prove that the value of the discrete time problem converges to the value of the sample average approximation. In addition, we show that there exists a sequence of discrete problems such that the accumulation points of their minimizers are optimal solutions of the original problem. Finally, we propose a convergent descent method to solve the discrete time problem, and show some preliminary numerical results for two simple examples.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Aragone, L.S., Di Marco, S., González, R.L.V.: Numerical analysis of a minimax optimal control problem with an additive final cost. Math. Models Methods Appl. Sci. 12(2), 183–203 (2002). https://doi.org/10.1142/S021820250200160X
Artstein, Z., Wets, R.J.: Consistency of minimizers and the slln for stochastic programs. Journal of Convex Analysis 2(1–2), 1–17 (1995). http://eudml.org/doc/226566
Attouch, H.: Variational Convergence for Functions and Operators. Applicable Math- Ematics Series. Pitman, London (1984)
Attouch, H., Wets, R.J.B.: Approximation and convergence in nonlinear optimization. Nonlinear Programming 4, 367–394 (1981)
Attouch, H., Wets, R.J.B.: A convergence theory for saddle functions. Trans. Am. Math. Soc. 280(1), 1–41 (1983)
Barron, E.N.: The Bellman equation for control of the running max of a diffusion and applications to look-back options. Appl. Anal. 48, 205–222 (1993). https://doi.org/10.1080/00036819308840158
Barron, E.N., Ishi, H.: The Bellman equation for minimizing the maximum cost. Nonlinear Anal. Theory Methods Appl. 13(9), 1067–1090 (1989). https://doi.org/10.1016/0362-546X(89)90096-5
Bokanowski, O., Picarelli, A., Zidani, H.: Dynamic programming and error estimates for stochastic control problems with maximum cost. Appl. Math. Optim. 71 (1), 125–163 (2015). https://doi.org/10.1007/s00245-014-9255-3
Bonnans, J.F., Shapiro, A.: Perturbation Analysis of Optimization Problems. Springer, New York (2000)
Bulirsch, R., Montrone, F., Pesch, H.J.: Abort landing in the presence of windshear as a minimax optimal control problem, part 1: Necessary conditions. J. Optim. Theory Appl. 70(1), 1–23 (1991). https://doi.org/10.1007/BF00940502
Bulirsch, R., Montrone, F., Pesch, H.J.: Abort landing in the presence of windshear as a minimax optimal control problem, part 2: Multiple shooting and homotopy. J. Optim. Theory Appl. 70(2), 223–254 (1991). https://doi.org/10.1007/BF00940625
Di Marco, S., González, R.L.V.: Minimax optimal control problems. Numerical analysis of the finite horizon case ESAIM: Mathematical Modelling and Numerical Analysis 1(33), 23–54 (1999). https://doi.org/10.1051/m2an:1999103
Gianatti, J., Aragone, L.S., Lotito, P.A., Parente, L.A.: Solving minimax control problems via nonsmooth optimization. Oper. Res. Lett. 44(5), 680–686 (2016). https://doi.org/10.1016/j.orl.2016.08.001. http://www.sciencedirect.com/science/article/pii/S016763771630075X
King, A.J., Wets, R.J.: Epi-consistency of convex stochastic programs. Stochastics and Stochastic Reports 34(1-2), 83–92 (1991). https://doi.org/10.1080/17442509108833676
Kleywegt, A.J., Shapiro, A., Homem-de Mello, T.: The sample average approximation method for stochastic discrete optimization. SIAM J. Optim. 12(2), 479–502 (2002). https://doi.org/10.1137/S1052623499363220
Mosco, U.: Convergence of convex sets and of solutions of variational inequalities. Adv. Math. 3(4), 510–585 (1969)
Oberle, H.J.: Numerical solution of minimax optimal control problems by multiple shooting technique. J. Optim. Theory Appl. 50 (2), 331–357 (1986). https://doi.org/10.1007/BF00939277
Petersen, I.R., James, M.R., Dupuis, P.: Minimax optimal control of stochastic uncertain systems with relative entropy constraints. IEEE Trans. Autom. Control 45 (3), 398–412 (2000). https://doi.org/10.1109/9.847720
Phelps, C., Royset, J.O., Gong, Q.: Optimal control of uncertain systems using sample average approximations. SIAM J. Control. Optim. 54(1), 1–29 (2016). https://doi.org/10.1137/140983161
Polak, E.: Computational Methods in Optimization. a Unified Approach. Academic Press, New York (1986)
Rockafellar, R., Wets, R.: Variational Analysis. Grundlehren der mathematischen Wissenschaften. Springer, Berlin (2009)
Royset, J.O., Polak, E.: Implementable algorithm for stochastic optimization using sample average approximations. J. Optim. Theory Appl. 122(1), 157–184 (2004). https://doi.org/10.1023/B:JOTA.0000041734.06199.71
Ugrinovskii, V., Petersen, I.: Absolute stabilization and minimax optimal control of uncertain systems with stochastic uncertainty. SIAM J. Control. Optim. 37(4), 1089–1122 (1999). https://doi.org/10.1137/S0363012996309964
Vinter, R.B.: Minimax optimal control. SIAM J. Control. Optim. 44(3), 939–968 (2005). https://doi.org/10.1137/S0363012902415244
Wijsman, R.A.: Convergence of sequences of convex sets, cones and functions. Bull. Am. Math. Soc. 70(1), 186–188 (1964)
Wijsman, R.A.: Convergence of sequences of convex sets, cones and functions. Trans. Am. Math. Soc. II(123), 32–45 (1966)
Wu, C., Teo, K.L., Wang, X.: Minimax optimal control of linear system with input-dependent uncertainty. J. Frankl. Inst. 351(5), 2742–2754 (2014). https://doi.org/10.1016/j.jfranklin.2014.01.012. http://www.sciencedirect.com/science/article/pii/S0016003214000143
Acknowledgements
We thank the anonymous referees for their useful comments and suggestions.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work has been partially supported by the following projects: PICT-2012-2212 ANPCyT and PIP 112-201101-286 CONICET.
Rights and permissions
About this article
Cite this article
Aragone, L.S., Gianatti, J., Lotito, P.A. et al. An Approximation Scheme for Uncertain Minimax Optimal Control Problems. Set-Valued Var. Anal 26, 843–866 (2018). https://doi.org/10.1007/s11228-017-0450-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11228-017-0450-7
Keywords
- Minimax control problems
- Uncertain control problems
- Sample average approximation
- Epi-convergence
- Numerical solutions