Abstract
We consider the problem of estimating the sum of squared means when the data (x 1,...,x n ) are independent values with x i ∼ N(θ i , 1) and θ 1, θ 2... are a priori i.i.d. N(0, σ 2) with σ 2 known. This example has posed difficulties for many approaches to inference. We examine the consistency properties of several estimators derived from Bayesian considerations. We prove that a particular Bayesian estimate (LRSE) is consistent in a wider set of circumstances than other Bayesian estimates like the posterior mean and mode. We show that the LRSE is either equal to the positive part of the UMVUE or differs from it with a relative error no greater than 2/n. We also prove a consistency result for interval estimation and discuss checking for prior-data conflict. While it can be argued that the choice of the N(0,σ 2) prior is inappropriate when σ 2 is chosen large to reflect noninformativity, this argument is not applicable when σ 2 is chosen to reflect knowledge about the unknowns. As such it is important to show that there are consistent Bayesian estimation procedures using this prior.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Abramowitz, M. and Stegun, I.A. (eds.) (1972). Handbook of mathematical functions with formulas, graphs, and mathematical tables. Dover, New York.
Baskurt, Z. and Evans, M. (2013). Hypothesis assessment and inequalities for Bayes factors and relative belief ratios. Bayesian Anal., 8, 569–590.
Berger, J.O. and Bernardo, J. (1992). On the development of reference priors. In Bayesian Statistics, vol. 4 (J. Berger, J. Bernardo, P. Dawid and A.F.M. Smith, eds.). Oxford University Press, London, pp. 35–49.
Berger, J.O., Philippe, A. and Robert, C.P. (1998). Estimation of quadratic functions: Noninformative priors for noncentrality parameters. Stat. Sin., 8, 359–378.
Berger, J.O., Liseo, B. and Wolpert, R.L. (1999). Integrated likelihood methods for eliminating nuisance parameters (with discussion). Stat. Sci., 14, 1–28.
Chow, M.S. (1987). A complete class theorem for estimating a noncentrality parameter. Ann. Statist., 15, 800–804.
De Waal, D.J. (1974). Bayes estimate of the noncentrality parameter in multivariate analysis. Comm. Statist., 3, 73–79.
Efron, B. (1973). Discussion of Dawid, A.P., Stone, M. and Zidek, J.V. (1973). Marginalization paradoxes in Bayesian and structural inference (with discussion). J. R. Stat. Soc. B, 2, 189–233.
Evans, M. (1997). Bayesian inference procedures derived via the concept of relative surprise. Comm. Statist., 26, 1125–1143.
Evans, M., Guttman, I. and Swartz, T. (2006). Optimality and computations for relative surprise inferences. Canad. J. Statist., 34, 113–129.
Evans, M. and Jang, G.H. (2011a). A limit result for the prior predictive applied to checking for prior-data conflict. Statist. Probab. Lett., 81, 1034–1038.
Evans, M. and Jang, G.H. (2011b). Weak informativity and the information in one prior relative to another. Statist. Sci., 26, 423–439.
Evans, M. and Jang, G.H. (2011c). Inferences from prior-based loss functions. Tech. Rep. No. 1104, Dept. of Statistics, U. of Toronto.
Evans, M. and Moshonov, H. (2006). Checking for prior-data conflict. Bayesian Anal., 1, 893–914.
Evans, M. and Shakhatreh, M. (2008). Optimal properties of some Bayesian inferences. Electron. J. Stat., 2, 1268–1280.
Gelfand, A. (1983). Estimation in noncentral distributions. Comm. Statist. A, 12, 463–475.
Kemp, C.D. and Kemp, A.W. (1956). Generalized hypergeometric distributions. J. R. Stat. Soc., 2, 202–211.
Kubokawa, T., Robert, C.P. and Saleh, A.K.Md.E. (1993). Estimation of noncentrality parameters. Canad. J. Statist., 21, 45–57.
Neff, N. and Strawderman, W.E. (1976). Estimation of the parameter of a non-central chi square distribution. Comm. Statist., A5, 65–76.
Perlman, M.D. and Rasmussen, V.A. (1975). Some remarks on estimating a noncentrality parameter. Comm. Statist., 4, 455–468.
Saxena, K.M.L. and Alam, K. (1982). Estimation of the non-centrality parameter of a chi squared distribution. Ann. Statist., 10, 1012–1016.
Stein, C. (1959). An example of wide discrepancy between fiducial and confidence intervals. Ann. Math. Statist., 30, 877–880.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Evans, M., Shakhatreh, M. Consistency of Bayesian Estimates for the Sum of Squared Normal Means with a Normal Prior. Sankhya A 76, 25–47 (2014). https://doi.org/10.1007/s13171-013-0042-z
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13171-013-0042-z