Abstract
The development of numerical methods for stochastic differential equations has intensified over the past decade. The earliest methods were usually heuristic adaptations of deterministic methods, but were found to have limited accuracy regardless of the order of the original scheme. A stochastic counterpart of the Taylor formula now provides a framework for the systematic investigation of numerical methods for stochastic differential equations. It suggests numerical schemes, which involve multiple stochastic integrals, of higher order of convergence. We shall survey the literature on these and on the earlier schemes in this paper. Our discussion will focus on diffusion processes, but we shall also indicate the extensions needed to handle processes with jump components. In particular, we shall classify the schemes according to strong or weak convergence criteria, depending on whether the approximation of the sample paths or of the probability distribution is of main interest.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Arnold, L. 1974: Stochastic differential equations. Wiley, New York
Artemev, S.S. 1985: A variable step algorithm for the numerical solution of stochastic differential equations. Methody Mekhaniki Sploshnoi Sredy 16 (2), 11–23. (in Russian)
Atalla, M.A. 1986: Finite-difference approximations for stochastic differential equations. In Probabilistic Methods for the Investigation of Systems with an Infinite Number of Degrees of Freedom. Collection of Scientific Works. Kiev, pp. 11–16
Averina, T.A.; Artemev, S.S. 1986: A new family of numerical methods for solving stochastic differential equations. Dokl. Akad. Nauk SSSR 288 (4), 777–780. (in Russian)
Azencott, R. 1982: Formule de Taylor stochastique et development as asymptotique d'integrales de Feynmann. Springer Lecture Notes in Mathematics Vol. 921, pp. 237–285
Balakrishnan, A.V. 1985: On a class of stochastic differential equations which do not satisfy a Lipschitz condition. Springer Lecture Notes in Control and Inform. Sc. Vol. 78
Bodo, B.A.; Thompson, M.E.; Unny, T.E. 1987: A review on stochastic differential equations for applications in hydrology. J. Stoch. Hydrol. Hydraulics 1, 81–100
Boyce, W.E. 1978: Approximate solution of random ordinary differential equations. Adv. Appl. Prob. 10, 172–184
Butcher, J.C. 1987: The numerical analysis of ordinary differential equations. Runge-Kutta and general linear methods. Wiley, Chirchester.
Bywater, R.J.; Chung, P.M. 1973: Turbulent flow fields with two dynamically significant scales. AIAA papers 73–646, 991–10
Chang, C.C. 1985: Numerical solution of stochastic differential equations. Ph.D. dissertation, University of California, Berkeley, 1985
Chang, C.C. 1987: Numerical solution of stochastic differential equation with constant diffusion coefficients. Math. Computat. 49, 523–542
Clements, D.J.; Anderson, B.D.O. 1973: Well behaved Ito equations with simulations that always misbehave. IEEE Trans. Autom. Control AC-18, 676–677
Clark, J.M.C. 1978: The design of robust approximations to the stochastic differential equations of nonlinear filtering. In Communication systems and Random process theory, edited by J.K. Skwirzynski. Sijthoff and Noordhoff, Alphe naan de Rijn, pp. 721–734
Clark, J.M.C.; Cameron, R.J. 1980: The maximum rate of convergence of discrete approximations for stochastic differential equations. Springer Lecture Notes In Control And Inform. Sc. Vol. 25, pp. 162–171
Dashevski, M.L.; Liptser, R.S. 1966: Simulation of stochastic differential equations connected with the disorder problem by means of analog computer. Autom. Remote Control 27, 665–673. (In Russian)
Doss, H. 1977: Liens entre equations differentielles stochastiques et ordinaire. Ann. Inst. Henri Poincare 13, 99–125
Dsagnidse, A.A.; Tschitashvili, R.J. 1975: Approximate integration of stochastic differential equations. Tbilisi State University, Institute of Appl. Math. “Trudy IV”, Tibilisi, pp. 267–279. (In Russian)
Ermakov, S.M. 1975: The Monte Carlo method and related questions. Nauka, Moscow. (In Russian)
Fahrmeier, L. 1976: Approximation von stochastischen Differenzialgleichungen auf Digitial-und Hybridrechnern. Computing 16, 359–371
Gard, T.C. 1988: Introduction to stochastic differential equations. Marcel Dekker, New York
Gear, C.W. 1971: Numerical initial value problems in ordinary differential equations. Prentice-Hall, Englewood Cliffs, N.J.
Geman, S.; Hwang, C. 1986: Diffusions for global optimization. SIAM J. Control Optim. 24, 1031–1043
Greiner, A.; Strittmatter, W.; Honerkamp, J. 1987: Numerical integration of stochastic differential equations. J. Stat. Physics 51, 95–108
Gikhmann, I.I.; Skorokhod, A.V. 1972: Stochastic differential equations. Springer, Berlin
Gikhmann, I.I.; Skorokhod, A.V. 1979: The theory of stochastic processes, Vol. I–III. Springer, Berlin.
Glorennec, P.Y. 1977: Estimation a priori des erreurs dans la resolution numerique d'equations differentials stochastiques. Seminare de Probabilite, Universite de Rennes, Facsicule 1, 57–93
Gorostiza, L.G. 1980: Rate of convergence of an approximate solution of stochastic differential equations. Stochastics 3, 267–276. Erratum Stochastics 4 (1981), 85
Greenside, H.S.; Helfand, E. 1981: Numerical integration of stochastic differential equations II. Bell System Tech. J. 60, 1927–1940
Grigelonius B. 1981: On weak convergence of semimartingales. Lietuvos Matem. Rink. 21, no. 3, 9–25
Harris, C.J. 1976: Simulation of nonlinear stochastic equations with applications in modeling water pollution. In Mathematical models for environmental problems, edited by C.A. Brebbi. Pentech Press, London, pp. 269–282
Haworth, D.C.; Pope, S.B. 1986: A second-order Monte Carlo method for the solution of the Ito stochastic differential equation. Stoch. Anal. Appl. 4, 151–186
Helfand, E. 1979: Numerical integration of stochastic differential equations. Bell System Tech. J. 58, 2239–2299
Horsthemke, W.; Lefevre, R. 1984: Noise induced transitions. Springer, Berlin.
Ikeda, N.; Watanabe, S. 1981: Stochastic differential equations and diffusion processes. North-Holland, Amsterdam.
Ito, K. 1951: On stochastic differential equations. Memoirs Amer. Math. Soc. 4
Jacod, J.; Shirayaev, A.N. 1987: Limit theorems for stochastic processes. Springer, Berlin
Jannsen, R. 1982: Difference-methods for stochastic differential equations. Preprint no. 50, FB Mathematik, Universitaet Kaiserslautern
Jannsen, R. 1984: Discretization of the Wiener process in difference methods for stochastic differential equations. Stoch. Processes Appl. 18, 361–369
Kallianpur, B. 1980: Stochastic filtering theory. Springer, Berlin
Karatzas, I.; Shreve, S.E. 1988: Brownian motion and stochastic calculus. Springer, Berlin
Kimura, M.; Ohta, T. 1971: Theoretical aspects of population genetics. Princeton University Press, Princeton
Klauder, J.R.; Petersen, W.P. 1985: Numerical integration of multiplicative-noise stochastic differential equations. SIAM J. Numer. Anal. 22, 1153–1166
Kloeden, P.E.; Pearson, R.A. 1977: The numerical solution of stochastic differential equations. J. Austral. Math. Soc., Series B, 20, 8–12.
Kloeden, P.E.; Liske, H.; Platen, E. 1990: The numerical solution of stochastic differential equations through computer experiments. (to appear)
Kloeden, P.E.; Platen, E. 1990: The numerical solution of stochastic differential equations. (to appear)
Kozin, F. 1977: An approach to characterizing, modeling and analyzing earthquake excitation records. CISM Lecture Notes Vol. 225, pp. 77–109. Springer, Berlin
Kushner, H.J. 1977: Probability methods for approximations in stochastic control and for elliptic equations. Academic press, New York.
Kushner, H.J.; Di Masi, G. 1978: Approximation for functionals and optimal control on jump diffusion processes. J. Math. Anal. Appl. 63, 772–800.
Leblond, J.; Talay, D. 1986: Simulation of diffusion processes with PRESTO building systems like PRESTO with ADAGIO. Proc. French-Belgian Satistician' Congress, November 1986, Rouen. Edited by J.P. Raoult
Legland, F. 1981: Estimation de parametres dans les processes stochastiques en observation incomplete: Application a un probleme de radio-astronomie. Dr. Ing. Thesis, L'Universite de Paris IX (Dauphine)
Liske, H.; Platen, E.; Wagner, W. 1982: About mixed multiple Wiener integrals. Preprint P-Math-23/82, IMath, Akad. der Wiss. der DDR, Berlin
Liske, H.; Platen, E. 1987: Simulation studies on time discrete diffusion approximations. In Mathematics and Computers in Simulation 29, 253–260. North-Holland, Amsterdam
Maruyama, G. 1955: Continuous Markov processes and stochastic equations. Rend. Circolo Math. Palemo 4, 48–90
McShane, E.J. 1974: Stochastic calculus and stochastic models. Academic Press, New York
Merton, R.C. 1971: Optimum consumption and portfolio rules in a continuous-time model. J. Econ. Theory 3, 373–413
Mikulevicius R.; Platen, E. 1986: Rate of convergence of the Euler approximation for diffusion processes. Preprint P-Math-38/86, IMath, Akad. der Wiss. der DDR, Berlin
Mikulevicius R.; Platen, E. 1988: Time discrete Taylor approximations for Ito processes with jump component. Math. Nachr. 138, 93–104
Milstein, G.N. 1974: Approximate integration of stochastic differential equations. Theor. Prob. Appl. 19, 557–562
Milstein, G.N. 1978: A method of second-order accuracy for the integration of stochastic differential equations. Theor. Prob. Appl. 23, 396–401
Milstein, G.N. 1986: Weak approximation of the solution of systems of stochastic differential equations. Theor. Prob. Appl. 30, 750–766
Morgan, B.J.J. 1984: Elements of simulation. Chapman and Hall, London
Newton, N.J. 1986: An asymptotically efficient difference formula for solving stochastic differential equations. Stochastics 19, 175–206
Nikitin, N.N.; Rasevig, V.D. 1978: Methods of computer simulation of stochastic differential equation. Vytshical. Matem. i Matem. Fisiki 18, 106–117 (In Russian)
Pardoux, E.; Pignol, M. 1984: Etude de la stabilite de la solution d'une EDS bilinear a coefficients periodiques: Application au movement d'une pale helicopter. Springer Lecture Notes in Control and Inform. Sc. Vol. 63, pp. 92–103
Pardoux, E.; Talay, D. 1985: Discretization and simulation of stochastic differential equations. Acta Appl. Math 3, 23–47
Petersen, W.P. 1987: Numerical simulation of Ito stochastic differential equations on supercomputers. Proc. IMA Conference, 18–24th September 1985
Platen, E. 1980: Approximation of Ito integral equation. Springer Lecture Notes in Control and Inform. Sc. Vol 25, pp. 172–176
Platen, E. 1981: An approximation method for a class of Ito processes. Lietuvos Matem. Rink. 21, 121–133
Platen, E. 1982a: A generalized Taylor formula for solutions of stochastic differential equations. Sankhya, A 44, 163–172
Platen, E. 1982b: An approximation method for a class of Ito processes with jump component, Lietuvos Matem. Rink. 21, 121–133
Platen, E. 1984: Zur zeitdiskreten Approximation von Itoprozessen. Diss. B., IMath, Akad. der Wiss. Der DDR, Berlin
Platen, E.; Rebolledo, R. 1985: Weak convergence of semimartingales and discretization methods. Stoch. Processes Appl. 20, 41–58
Platen, E.; Wagner, W. 1982: On a Taylor formula for a class of Ito processes. Probability Math. Statistics 3, 37–51
Rao, N.J.; Borwankar, J.D.; Ramakrishna, D. 1974: Numerical solution of Ito integral equations. SIAM J. Control 12, 124–139
Roemisch, W.; Wakolbinger, A. 1987: On the convergence rates of approximate solutions of stochastic equations. Preprint, Sektion Mathematik, Humboldt Universitaet, Berlin
Rubinstein, R.Y. 1981: Simulation and the Monte Carlo method. Wiley, New York.
Rumelin, W. 1982: Numerical treatment of stochastic differential equations. SIAM J. Numer. Anal. 19, 604–613
Sagirow, P. 1970: Stochastic methods in the dynamics of statellites. ICMS Lecture Notes Vol. 57. Springer, Berlin
Schenkl, F. 1988: Bericht ueber die Loesung stochastischer Ito-Differentialgleichungen durch Simulation. Preprint, Universitaet der Bundeswehr Muenchen
Schoener, G., Haken, H.; Kelso, J.A.S. 1986: A stochastic theory of phase transitions in human hand movement. Biol. Cybernetics 53, 247–257
Shimizu, A.; Kawachi, T. 1984: Approximate solutions of stochastic differential equations. Bull Nagoya Inst. Tech. 36, 105–108
Shinozuka, M.; Sato, Y. 1967: Simulation of nonstationary random processes. J. Eng. Mech Div. ASCE 93 EM1, 11
Sobcyzk, K. 1986: Modelling of random fatigue crack growth. Eng. Fracture Mech. 24, 609–623
Sussmann, H. 1978: On the gap between deterministic and stochastic differential equations. Ann. Prob. 6, 19–41
Talay, D. 1982: Convergence pour chaque trajectoire d'un schema d'approximation des EDS. Comptes Rendus Acad. Sc. Paris 295, Serie I. 249–252
Talay, D. 1983: Resolution trajectorielle et analysis numerique des equations differentielles stochastiques. Stochastics 9, 275–306
Talay, D 1984: Efficient numerical schemes for the approximation of expectation of functionals of the solution of an SDE and applications. Springer Lecture Notes in Control and Inform Sc. Vol. 61, pp. 294–313
Unny, T.E. 1984: Numerical integration of stochastic differential equations in catchment modeling. Water Resources Res 20, 360–368
Unny, T.E.; Karmeshu 1983: Stochastic nature of outputs from conceptual reservoir model cascades. J. Hydrol. 68, 161–180
Van Kampen, N.G. 1981: Stochastic processes in physics and chemistry. North-Holland, Amsterdam.
Viterbi, A.J. 1966: Principles of coherent communication. McGraw-Hill, New York.
Wagner, W. 1987: Unbiased Monte Carlo evaluation of certain functional integrals. J. Comput. Physics 71, 21–23
Wagner, W. 1988: Monte Carlo evaluation of functionals of solutions of stochastic differential equations. Variance reduction and numerical examples. Stochastic Anal. Appl. 6, 447–468
Wagner, W.; Platen, E. 1978: Approximation of Ito integral equations. Preprint ZIMM, Akad. der Wiss. der DDR, Berlin
Wright, D.J. 1974: The digital simulation of stochastic differential equations. IEEE Trans. Autom. Control AC-19, 75–76
Wright, D.J. 1980: Digital simulation of Poisson stochastic differential equations. Int. J. Systems Sc. 11, 781–785
Yaglom, A.M. 1980: Application of stochastic differential equations to the description of turbulent equations. Springer Lecture Notes in Control and Inform. Sc. Vol. 25, pp. 1–13
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Kloeden, P.E., Platen, E. A survey of numerical methods for stochastic differential equations. Stochastic Hydrol Hydraul 3, 155–178 (1989). https://doi.org/10.1007/BF01543857
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF01543857