Abstract
In Part I, methods of nonstandard analysis are applied to deterministic control theory, extending earlier work of the author. Results established include compactness of relaxed controls, continuity of solution and cost as functions of the controls, and existence of optimal controls. In Part II, the methods are extended to obtain similar results for partially observed stochastic control. Systems considered take the form:
where the feedback control u depends on information from a digital read-out of the observation process y. The noise in the state equation is controlled along with the drift. Similar methods are applied to a Markov system in the final section.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Albeverio, S., Fenstad, J.-E., Høegh-Krohn, R. and Lindstrøm, T. L.: Nonstandard Methods in Stochastic Analysis and Mathematical Physics, Academic Press, to appear.
AndersonR. M.: ‘A Non-standard Representation for Brownian Motion and Itô Integration’, Israel J. Math. 25 (1976), 15–46.
AndersonR. M.: ‘Star-finite Representations of Measure Spaces’, Trans. Amer. Math. Soc. 271 (1982), 667–687.
AndersonR. M. and RashidS.: ‘A Nonstandard Characterisation of Weak Convergence’, Proc. Amer. Math. Soc. 69 (1978), 327–332.
CutlandN. J.: ‘On the Existence of Solutions to Stochastic Differential Equations on Loeb Spaces’, Z. Wahrsch. verw. Gebiete 60 (1982), 335–357.
CutlandN. J.: ‘Internal Controls and Relaxed Controls’, J. London Math. Soc. 27 (1983), 130–140.
CutlandN. J.: ‘Optimal Controls for Partially Observed Stochastic Systems: an Infinitesimal Approach’, Stochastics 8 (1983), 239–257.
CutlandN. J.: ‘Nonstandard Measure Theory and its Applications’, Bull. London Math. Soc. 15 (1983), 529–589.
Cutland, N. J., ‘Partially Observed Stochastic Controls Based on a Cumulative Digital Readout of the Observations’, to appear in Proceedings of 4th IFIP Working Conference on Stochastic Differential Systems, Marseille-Luminy 1984, Springer Lecture Notes in Control and Information Sciences.
DoobJ. L.: Stochastic Processes, Wiley, New York, 1953.
ElliottR. J. and KohlmannM.: ‘On the Existence of Optimal Partially Observed Controls’, Appl. Math. Optim. 9 (1982), 41–66.
GamkrelidzeR. V.: Principles of Optimal Control, Plenum, New York, 1978.
Keisler H. J.: ‘An Infinitesimal Approach to Stochastic Analysis’, Mem. Amer. Math. Soc. 297 (1984).
Keisler, H. J.: ‘Nonstandard Probability Theory and Probability Logic’, unpublished lecture notes, University of Winconsin, 1979.
KrylovN. V.: Some Estimates of the Probability Density of a Stochastic Integral, Math. USSR Izv. 8 (1974), 233–254.
LindstrømT. L.: ‘Hyperfinite Stochastic Integration’ I, II, III and addendum, Math. Scand. 46 (1980), 265–292, 293–314, 315–331, 332–333.
LoebP. A.: ‘Conversion from Nonstandard to Standard Measure Spaces and Applications in Probability Theory’, Trans. Amer. Math. Soc. 211 (1975), 113–122.
LoebP. A.: ‘Weak Limits of Measures and the Standard Part Map’, Proc. Amer. Math. Soc. 77 (1979), 128–135.
ParthasarathyK. R.: Probability Measures on Metric Spaces, Academic Press, New York, 1967.
StroockD. W. and VaradhanS. R. S.: Multidimensional Diffusion Processes, Springer-Verlag, Berlin, 1979.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Cutland, N.J. Infinitesimal methods in control theory: Deterministic and stochastic. Acta Appl Math 5, 105–135 (1986). https://doi.org/10.1007/BF00046584
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF00046584