Abstract
In this paper, we review briefly some methods for minimizing a functionF(x), which proceed by follwoing the solution curve of a system of ordinary differential equations. Such methods have often been thought to be unacceptably expensive; but we show, by means of extensive numerical tests, using a variety of algorithms, that the ODE approach can in fact be implemented in such a way as to be more than competitive with currently available conventional techniques.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Botsaris, C. A., andJacobson, D. H.,A Newton-Type Curvilinear Search Method for Optimization, Journal of Mathematical Analysis and Applications, Vol. 54, pp. 217–229, 1976.
Botsaris, C. A.,A Curvilinear Optimization Method Based on Stable Numerical Integration Techniques, Journal of Mathematical Analysis and Applications, Vol. 63, pp. 396–411, 1978.
Botsaris, C. A.,Differential Gradient Methods, Journal of Mathematical Analysis and Applications, Vol. 63, pp. 177–198, 1978.
Botsaris, C. A.,A Class of Methods for Unconstrained Minimization Based on Stable Numerical Integration Techniques, Journal of Mathematical Analysis and Applications, Vol. 63, pp. 729–749, 1978.
Boggs, P. T.,An Algorithm, Based on Singular Perturbation Theory, for Ill-Conditioned Minimization Problems, SIAM Journal on Numerical Analysis, Vol. 15, pp. 830–843, 1977.
Zirilli, F., Incerti, S., andParisi, V.,A New Method for Solving Nonlinear Simultaneous Equations, SIAM Journal on Numerical Analysis, Vol. 16, pp. 779–789, 1979.
Zirilli, F., Incerti, S., andAluffi, F.,Systems of Equations and A-Stable Integration of Second-Order ODEs, Numerical Optimization and Dynamic Systems, Edited by L. C. W. Dixon and G. P. Szego, Elsevier-North Holland, Amsterdam, Holland, 1980.
Zirilli, F., Aluffi, F., andIncerti, S.,Systems of Simultaneous Equations and Second-Order Differential Equations, Ottimizzazione Nonlineare e Applicazioni, Edited by S. Incerti and G. Treccani, Pitagora Editrice, Bologna, Italy, 1980.
Zirilli, F., Incerti, S., andParisi, V.,A FORTRAN Subroutine for Solving Systems of Nonlinear Simultaneous Equations, Computer Journal, Vol. 24, pp. 87–91, 1981.
Zirilli, F., Aluffi, F., andParisi, V.,A Differential Equations Algorithm for Nonlinear Equations, ACM Transactions on Mathematical Software, Vol. 10, pp. 299–316, 1984.
Zirilli, F., Aluffi, F., andParisi, V.,DAFNE: A Differential Equations Algorithm for Nonlinear Equations, ACM Transactions on Mathematical Software, Vol. 10, pp. 317–324, 1984.
Zghier, A. K.,The Use of Differential Equations in Optimization, PhD Thesis, Loughborough University, 1981.
Snyman, J. A.,A New and Dynamic Method for Unconstrained Optimization, Applied Mathematical Modelling, Vol. 6, pp. 449–462, 1982.
Snyman, J. A.,An Improved Method of the Original Leapfrog Dynamic Method for Unconstrained Minimization, University of Pretoria, Applied Mathematics Department, Report No. UP-TW30, 1982.
Powell, M. J. D., Editor,Nonlinear Optimization 1981, Academic Press, London, England, 1982.
Brown, A. A.,Optimization Methods Involving the Solution of Ordinary Differential Equations, PhD Thesis, Hatfield Polytechnic, 1986.
Hindmarsh, A. C.,LSODE and LSODI: Two New Initial-Value Ordinary Differential Equation Solvers, ACM Signum Newsletter, Vol. 15, pp. 10–11, 1980.
Goldfeld, D., Quandt, R. E., andTrotter, H. F.,Maximization by Quadratic Hill-Climbing, Econometrica, Vol. 34, pp. 541–551, 1966.
Gill, P. E., Murray, W., andPicken, S. M.,The Implementation of Two Modified Newton Algorithms for Unconstrained Optimization, National Physical Laboratory, Report No. NAC-24, 1972.
Biggs, M. C.,Minimization Algorithms Making Use of Nonquadratic Properties of the Objective Function, Journal of the Institute of Mathematics and Its Applications, Vol. 8, pp. 315–327, 1971.
Hock, W., andSchittkowski, K.,Test Examples for Nonlinear Programming Codes, Springer-Verlag, New York, New York, 1981.
Brown, A. A., andBartholomew-Biggs, M. C.,Some Effective Methods for Unconstrained Optimization Based on the Solution of Systems of Ordinary Differential Equations, Technical Report No. 178, Numerical Optimisation Centre, Hatfield Polytechnic, 1987.
Author information
Authors and Affiliations
Additional information
Communicated by L. C. W. Dixon
This work was supported by a SERC research studentship for the first author. Both authors are indebted to Dr. J. J. McKeown and Dr. K. D. Patel of SCICON Ltd, the collaborating establishment, for their advice and encouragement.
Rights and permissions
About this article
Cite this article
Brown, A.A., Bartholomew-Biggs, M.C. Some effective methods for unconstrained optimization based on the solution of systems of ordinary differential equations. J Optim Theory Appl 62, 211–224 (1989). https://doi.org/10.1007/BF00941054
Issue Date:
DOI: https://doi.org/10.1007/BF00941054