Abstract
Termination criteria for the iterative solution of bound-constrained optimization problems are examined in the light of backward error analysis. It is shown that the problem of determining a suitable perturbation on the problem’s data corresponding to the definition of the backward error is analytically solvable under mild assumptions. Moreover, a link between existing termination criteria and this solution is clarified, indicating that some standard measures of criticality may be interpreted in the sense of backward error analysis. The backward error problem is finally considered from the multicriteria optimization point of view and some numerical illustration is provided.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Arioli M., Duff I.S., Ruiz D.: Stopping criteria for iterative solvers. SIAM J. Matrix Anal. Appl. 13(1), 138–144 (1992)
Arioli M., Loghin D., Wathen A.: Stopping criteria for iterations in finite element methods. Numer. Math. 99(3), 381–410 (2004)
Averick, B.M., Moré, J.J.: The Minpack-2 test problem collection. Technical Report ANL/MCS-P153-0694, Mathematics and Computer Science, Argonne National Laboratory, Argonne (1992)
Burke J.V.: On the identification of active constraints II: the nonconvex case. SIAM J. Numer. Anal. 27(4), 1081–1102 (1990)
Burke J.V., Moré J.J.: On the identification of active constraints. SIAM J. Numer. Anal. 25(5), 1197–1211 (1988)
Burke J.V., Moré J.J., Toraldo G.: Convergence properties of trust region methods for linear and convex constraints. Math. Program. Ser. A 47(3), 305–336 (1990)
Byrd R.H., Lu P., Nocedal J., Zhu C.: A limited memory algorithm for bound constrained optimization. SIAM J. Sci. Comput. 16(5), 1190–1208 (1995)
Calamai P.H., Moré J.J.: Projected gradient methods for linearly constrained problems. Math. Program. 39, 93–116 (1987)
Chaitin-Chatelin F., Frayssé V.: Lectures on Finite Precision Computations. SIAM, Philadelphia (1996)
Conn A.R., Gould N.I.M., Sartenaer A., Toint Ph.L.: Global convergence of a class of trust region algorithms for optimization using inexact projections on convex constraints. SIAM J. Optim. 3(1), 164–221 (1993)
Conn A.R., Gould N.I.M., Toint Ph.L.: Trust-Region Methods, Number 01 in MPS-SIAM Series on Optimization. SIAM, Philadelphia (2000)
Cox A.J., Higham N.J.: Backward error bounds for constrained least squares problems. BIT Numer. Math. 39(2), 210–227 (1999)
Dolan, E.D., Moré, J.J., Munson, T.S.: Benchmarking optimization software with COPS 3.0. Technical Report ANL/MCS-TM-237, Mathematics and Computer Science, Argonne National Laboratory, Argonne (2004)
Dostál Z.: Optimal Quadratic Programming Algorithms. Springer, New York (2009)
Ehrgott M.: Multicriteria Optimization, Lecture Notes in Economics and Mathematical Systems, second edition. Springer, Heidelberg (2005)
Fisher, M.: Minimization algorithms for variational data assimilation. In: Recent Developments in Numerical Methods for Atmospheric Modelling, pp. 364–385. European Center for Medium-Range Weather Forecasts, Reading (1998)
Givens, W.: Numerical computation of the characteristic values of a real matrix. Technical Report 1574, Oak Ridge National Laboratory, Oak Ridge (1954)
Golub G.H., Van Loan C.F.: Matrix computations. North Oxford Academic, Oxford (1983)
Hager W.W., Zhang H.: A new active set algorithm for box constrained optimization. SIAM J. Optim. 17(2), 526–557 (2006)
Higham N.J.: Accuracy and Stability of Numerical Algorithms. SIAM, Philadelphia (1996)
Moré, J.J., Wild, S.M.: Estimating computational noise. Technical Report ANL-MCS-P1721-0210, Mathematics and Computer Science, Argonne National Laboratory, Argonne (2010)
Mouffe, M.: Multilevel optimization in infinity norm and associated stopping criteria. PhD thesis, Department of Mathematics, FUNDP - University of Namur, Namur (2009)
Rigal J.L., Gaches F.: On the compatibility of a given solution with the data of a linear system. J. ACM 14(3), 543–548 (1967)
Wilkinson J.H.: Error analysis of direct methods of matrix inversion. J. ACM 8(3), 281–330 (1961)
Xu, L., Burke, J.: ASTRAL: An active set ℓ ∞-trust-region algorithm for box-constrained optimization. Technical Report preprint, Department of Mathematics, University of Washington, Seattle (2007)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Gratton, S., Mouffe, M. & Toint, P.L. Stopping rules and backward error analysis for bound-constrained optimization. Numer. Math. 119, 163–187 (2011). https://doi.org/10.1007/s00211-011-0376-1
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00211-011-0376-1