Abstract
In this paper we describe active set type algorithms for minimization of a smooth function under general order constraints, an important case being functions on the set of bimonotone r×s matrices. These algorithms can be used, for instance, to estimate a bimonotone regression function via least squares or (a smooth approximation of) least absolute deviations. Another application is shrinkage estimation in image denoising or, more generally, regression problems with two ordinal factors after representing the data in a suitable basis which is indexed by pairs (i,j)∈{1,…,r}×{1,…,s}. Various numerical examples illustrate our methods.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Ayer, M., Brunk, H.D., Reid, W.T., Silverman, E.: An empirical distribution function for sampling with incomplete information. Ann. Math. Stat. 26, 641–647 (1955)
Beran, R., Dümbgen, L.: Modulation of estimators and confidence sets. Ann. Stat. 26, 1826–1856 (1998)
Best, M.J., Chakravarti, N.: Active set algorithms for isotonic regression; a unifying framework. Math. Program. 47, 425–439 (1990)
Burdakow, O., Grimwall, A., Hussian, M.: A generalised PAV algorithm for monotone regression in several variables. In: Antoch, J. (ed.) COMPSTAT 2004—Proceedings in Computational Statistics, 16th Symposium Held in Prague, Czech Republic, pp. 761–767. Physica-Verlag, Heidelberg (2004)
Chatterjee, S., Handcock, M.S., Simonoff, J.S.: A Casebook for a First Course in Statistics and Data Analysis. Wiley, New York (1995)
Cormen, T.H., Leiserson, C.E., Rivest, R.L.: Introduction to Algorithms. MIT Press, Cambridge (1990)
Donoho, D.L., Johnstone, I.M.: Ideal spatial adaptation by wavelet shrinkage. Biometrika 81, 425–455 (1994)
Dümbgen, L., Hüsler, A., Rufibach, K.: Active set and EM algorithms for log–concave densities based on complete and censored data. Technical Report 61, IMSV, University of Bern (2007). arXiv:0707.4643
Fletcher, R.: Practical Methods of Optimization, 2nd edn. Wiley, New York (1987)
Robertson, T., Wright, F.T., Dykstra, R.L.: Order Restricted Statistical Inference. Wiley, New York (1988)
Spouge, J., Wan, H., Wilbur, W.J.: Least squares isotonic regression in two dimensions. J. Optim. Theory Appl. 117, 585–605 (2003)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Beran, R., Dümbgen, L. Least squares and shrinkage estimation under bimonotonicity constraints. Stat Comput 20, 177–189 (2010). https://doi.org/10.1007/s11222-009-9124-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11222-009-9124-0