Abstract
We are concerned with the Hamilton-Jacobi equation related to the infinite horizon problem of deterministic control theory. Approximate solutions are constructed by means of a discretization in time as well as in the state variable and we prove that their rate of convergence to the viscosity solution is of order 1, provided a semiconcavity assumption is satisfied. A computational algorithm, originally due to R. Gonzales and E. Rofman, is adapted and reformulated for the problem at hand in order to obtain an error estimate for the numerical approximate solutions.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Aubin JP, Cellina A (1984) Differential Inclusions. Springer-Verlag, Berlin, Heidelberg, New York
Capuzzo Dolcetta I (1983) On a discrete approximation of the Hamilton-Jacobi equation of dynamic programming. Appl Math Optim 10:367–377
Capuzzo Dolcetta I, Ishii H (1984) Approximate solutions of the Bellman equation of deterministic control theory. Appl Math Optim 11:161–181
Crandall MG, Lions PL (1983) Viscosity solutions of Hamilton-Jacobi equations. Trans Amer Math Soc 277:1–42
Crandall MG, Lions PL (1984) Two approximations of solutions of Hamilton-Jacobi equations. Math Comp 43:1–19
Crandall MG, Evans LC, Lions PL (1984) Some properties of viscosity solutions of Hamilton-Jacobi equations. Trans Amer Math Soc 282:487–502
Falcone M (1985) Numerical solution of deterministic continuous control problems. Proceedings of the International Symposium on Numerical Analysis, Madrid, September 1985
Falcone M (1986) (forthcoming)
Fleming WH, Rishel RW (1975) Deterministic and Stochastic Optimal Control. Springer-Verlag, Berlin, Heidelberg, New York
Glowinski R, Lions JL, Trémolières R (1976) Analyse Numerique des Inéquations Variationnelles, vols 1 and 2. Dunod, Paris
Gonzales R, Rofman E (1985) On deterministic control problems: an approximation procedure for the optimal cost, I and II. SIAM J Control Optim 23:242–285
Lions PL (1982) Generalized Solutions of Hamilton-Jacobi Equations. Pitman, London
Lions PL, Mercier B (1980) Approximation numerique des equations de Hamilton-Jacobi-Bellman. RAIRO Anal Numér 14:369–393
Quadrat JP (1975) Analyse Numerique de l'Equation de Bellman Stochastique. Rapport INRIA no 140
Rofman E (1985) Approximation of Hamilton-Jacobi-Bellman equation in deterministic control theory. An application to energy production systems. In: Capuzzo Dolcetta I, Fleming WH, Zolezzi T (eds) Recent Mathematical Methods in Dynamic Programming. Lecture Notes in Mathematics 1119. Springer-Verlag, Berlin, Heidelberg, New York
Souganidis PE (1985) Approximation schemes for viscosity solutions of Hamilton-Jacobi equations. J. Differential Equations 59:1–43
Author information
Authors and Affiliations
Additional information
Communicated by W. Fleming
This work has been partially supported by CNR-GNAFA.
Rights and permissions
About this article
Cite this article
Falcone, M. A numerical approach to the infinite horizon problem of deterministic control theory. Appl Math Optim 15, 1–13 (1987). https://doi.org/10.1007/BF01442644
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF01442644