Abstract
Constrained minimization is often done via interior penalty functions. Such functions can be very difficult to minimize using existing algorithms. In this paper, a new algorithm is described which is specially constructed to deal with such functions. It generates search directions by linearizing the objective and constraints about the current (interior) point, substituting these linearizations into the penalty function, and minimizing the result. Properties of the algorithm are derived, an efficient method for solving the direction finding problem is suggested, and computational results are presented. Preliminary results are also given on an extension to quasibarrier and exterior penalty functions.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Optimization, Ed. R. Fletcher (Academic Press, 1969) p. 203.
Ibid., p. 205.
D.G. Luenberger, “A combined penalty function and gradient projection mothod for nonlinear programming,” Internal Memorandum 70-2 (Department of Engineering — Economic Systems, Stanford University, June 1970),
A.V. Fiacco and G.P. McCormick,Nonlinear programming; sequential unconstrained minimization techniques (John Wiley and Sons, Inc., 1968) Ch. 8,
Fletcher,op. cit., p. 324.
Ibid., pp. 324–325.
Ibid., pp. 209–213.
A.V. Fiacco and G.P. McCormick,op. cit..
W. Zangwill,Nonlinear programming: a unified approach (Prentice Hall. 1969).
L. Lasdon,Optimization theory for large systems (The Macmillan Company, 1970) Appendix 2.
S. Karlin,Mathematical models and theory in games programming and economics. Vol. 1 Addison-Wesley Publishing Company, Inc., Reading, Massachusetts, 1959).
P. Wolfe, “A duality theorem for nonlinear programming,”Quarterly of Applied Mathematics 19, No. 3 (1961) 239–244.
G. Zoutendijk, “Nonlinear programming: a numerical survey,”SIAM Journal on Control 4 (1966) 194–210.
D. Goldfarb, “Extension of Davidon's variable metric method to maximization under linear inequality and equality constraints,”SIAM Journal on Applied Mathematics 17, No. 4 (1969) 739–764.
G.P. McCormick, “The variable reduction method for nonlinear programming,”Management Science 17, No. 3 (1970) 146–160.
R.R. Allran and S.E.J. Johnsen, “An algorithm for solving nonlinear programming problems, subject to nonlinear inequality constraints,”The Computer Journal 13, No. 2 (1970).
G.B. Dantzig,Linear programming and extensions (Princeton University Press, Princeton, New Jersey, 1963) Chs. 22 and 24.
L. Lasdon,op. cit., Ch. 1.
J.D. Pearson, “Variable metric methods of minimization,”British Computer Journal 12 (1969).
J. Kowalik, M.R. Osborne and D.M. Ryan, “A new method for constrained optimization problems,”Operations Research 17, No. 6 (1969) 973–983.
A.R. Colville, “Nonlinear programming study results as of November 1968,” IBM New York Scientific Center, New York Technical Report No. 320-2949 (1968).
J.D. Pearson, “On variable metric methods of minimization,” Technical Paper RAC-TP-302, Research Analysis Corporation, McLean, Virginia (1968).
D. Marquardt, “An algorithm for least-squares estimation of nonlinear parameters,”SIAM Journal on Applied Mathematics 11, No. 2 (1963) 431–441.
Y. Bard, “Comparison of gradient methods for the solution of nonlinear parameter estimation problems,”SIAM Journal on Numerical Analysis 7, No. 1 (1970) 157–186.
R. Fletcher, “An efficient, globally convergent, algorithm for unconstrained and linearly constrained optimization problems,” Technical Paper 431, Theoretical Physics Division, Atomic Energy Research Establishment, Harwell, England,Mathematical Programming, to appear.
Author information
Authors and Affiliations
Additional information
This document may be reproduced in whole or in part for any non-commercial purpose of the United States Government. Its preparation was supported in part by funds allocated to Case Western Reserve University under contract DAHC 19-68-C-0007 (Project Themis) with the U.S. Army Research Office, Durham Army Materiel Command.
Rights and permissions
About this article
Cite this article
Lasdon, L.S. An efficient algorithm for minimizing barrier and penalty functions. Mathematical Programming 2, 65–106 (1972). https://doi.org/10.1007/BF01584537
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF01584537