Abstract
Two characterisations of a random mean from a Dirichlet process, as a limit of finite sums of a simple symmetric form and as a solution of a certain stochastic equation, are developed and investigated. These are used to reach results on and new insights into the distributions of such random means. In particular, identities involving functional transforms and recursive moment formulae are established. Furthermore, characterisations for several choices of the Dirichlet process parameter (leading to symmetric, unimodal, stable, and finite mixture distributions) are provided. Our methods lead to exact simulation recipes for prior and posterior random means, an approximation algorithm for the exact densities of these means, and limiting normality theorems for posterior distributions. The theory also extends to mixtures of Dirichlet processes and to the case of several random means simultaneously.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
C.E. Antoniak (1974) ArticleTitleMixtures of Dirichlet processes with applications to Bayesian nonparametric problems Ann. Stat. 2 1152–1174 Occurrence Handle0335.60034 Occurrence Handle51 #2221
A.R. Barron C. Sheu (1991) ArticleTitleApproximations of density functions by sequences of exponential families Ann. Stat. 19 1347–1369 Occurrence Handle92m:62038a
P. Billingsley (1999) Convergence of Probability Measures EditionNumber2 Wiley New York
D.M. Cifarelli E. Regazzini (1990) ArticleTitleDistribution functions of means of a Dirichlet process Ann. Stat. 18 429–442 Occurrence Handle91c:62013
D.M. Cifarelli E. Regazzini (1993) Some remarks on the distribution functions of means of a Dirichlet process, Quaderno IAMI 93.4 CNR-IAMI Milano
D.M. Cifarelli E. Melilli (2000) ArticleTitleSome new results for Dirichlet priors Ann. Stat. 28 1390–1413 Occurrence Handle2002h:62026
P. Diaconis J. Kemperman (1996) Some new tools for Dirichlet priors J.M. Bernardo J.O. Berger A.P. Dawid A.F.M. Smith (Eds) Bayesian Statistics 5 Oxford University Press Oxford 97–106
D. Dufresne (1998) ArticleTitleAlgebraic properties of Beta and Gamma distributions, and applications Adv. Appl. Math. 20 285–299 Occurrence Handle10.1006/aama.1997.0576 Occurrence Handle0915.62006 Occurrence Handle99i:60036
I. Epifani (1999) Some results on the moments of vector-valued functionals of the Ferguson-Dirichlet process, Quaderno 380/P Dipartimento di Matematica Politecnico di Milano
M.D. Escobar (1994) ArticleTitleEstimating normal means with a Dirichlet process prior J. Am. Stat. Ass. 89 268–277 Occurrence Handle0791.62039 Occurrence Handle94k:62054
M.D. Escobar M. West (1995) ArticleTitleBayesian density estimation and inference using mixtures J. Am. Stat. Ass. 90 577–588 Occurrence Handle96d:62054
M.D. Escobar M. West (1998) Computing nonparametric hierarchical models D. Day P. Müller D. Sinha (Eds) Practical Nonparametric and Semiparametric Bayesian Statistics, Lecture Notes in Statistics NumberInSeries133 Springer-Verlag New York 1–22
P.B. Feigin R.L. Tweedie (1989) ArticleTitleLinear functionals and Markov chains associated with Dirichlet processes Math. Proc. Cambridge Phil. Soc. 105 579–585 Occurrence Handle90f:60129
W. Feller (1966) An Introduction to Probability Theory and Its Applications NumberInSeriesII Wiley New York
T.S. Ferguson (1973) ArticleTitleA Bayesian analysis of some nonparametric problems Ann. Stat. 1 209–230 Occurrence Handle0255.62037 Occurrence Handle50 #3441
T.S. Ferguson (1974) ArticleTitlePrior distributions on spaces of probability measures Ann. Stat. 2 615–629 Occurrence Handle0286.62008 Occurrence Handle55 #11479
T.S. Ferguson (1983) Bayesian density estimation by mixtures of normal distributions H. Rizvi J.S. Rustagi D.O. Siegmund (Eds) Recent Advances in Statistics, Chernoff Festschrift Volume Academic Press New York 287–302
H. Gjessing J. Paulsen (1997) ArticleTitlePresent value distributions with applications to ruin theory and stochastic equations Stochastic Processes Appl. 71 123–144 Occurrence Handle10.1016/S0304-4149(97)00072-0 Occurrence Handle99b:60068
A. Guglielmi (1998) ArticleTitleA simple procedure calculating the generalized Stieltjes transform of the mean of a Dirichlet process, Stat Prob. Lett. 38 299–303 Occurrence Handle0916.60046 Occurrence Handle99e:60049
A. Guglielmi C.C. Holmes S.G. Walker (2002) ArticleTitlePerfect simulation involving functionals of a Dirichlet process J. Comput. Graphical Stat. 29 306–310 Occurrence Handle1938137
A. Guglielmi R.L. Tweedie (2001) ArticleTitleMarkov chain Monte Carlo estimation of the law of the mean of a Dirichlet process Bernoulli 7 593–604 Occurrence Handle2002j:62107
R. Hannum M. Hollander N. Langberg (1981) ArticleTitleDistributional results for random functionals of a Dirichlet process Ann. Prob. 9 665–670 Occurrence Handle83b:60086
P. Henrici (1993) Applied and Computational Complex Analysis NumberInSeries3 Wiley New York
N.L. Hjort (1990) ArticleTitleNonparametric Bayes estimators based on Beta processes in models for life history data Ann. Stat. 18 1259–1294 Occurrence Handle0711.62033 Occurrence Handle91h:62007
Hjort N.L., Bayesian and empirical Bayesian bootstrapping, Statistical Research Report, Department of Mathematics, University of Oslo, (1991).
N.L. Hjort (1996) Bayesian approaches to non- and semiparametric density estimation [with discussion] J. Berger J. Bernardo A.P. Dawid A.F.M. Smith (Eds) Bayesian Statistics 5 Oxford University Press Oxford 223–253
Hjort N.L., Bayesian analysis for a generalised Dirichlet process prior, Statistical Research Report, Department of Mathematics, University of Oslo, (2000).
N.L. Hjort (2003) Topics in nonparametric Bayesian statistics [with discussion] P.J. Green N.L. Hjort S. Richardson (Eds) Highly Structured Stochastic Systems Oxford University Press Oxford 455–478
Hjort N.L., Ongaro A., On the distribution of random Dirichlet jumps, to appear, (2005).
J. Hoffmann-Jorgensen (1994) Probability With a View Toward Statistics Chapman and Hall New York
H. Ishwaran L.F. James (2001) ArticleTitleGibbs sampling methods for stick-breaking priors J. Am. Stat. Ass. 96 161–173 Occurrence Handle2004d:62018
H. Ishwaran M. Zarepour (2002) ArticleTitleExact and approximate sum-representations for the Dirichlet process Can. J. of Stat. 30 1–16 Occurrence Handle2003g:60081
O. Kallenberg (1986) Random Measures Berlin and Academic Press Akademie-Verlag
S. Kerov (1998) ArticleTitleInterlacing measures Am. Mathe. Soc. Translations 181 35–83 Occurrence Handle0890.05074 Occurrence Handle99h:30034
S. Kerov N. Tsilevich (2001) ArticleTitleThe Markov–Krein correspondence in several dimensions (in Russian) Transactions from the scienti.c seminars of POMI 283 98–122
L. LeCam G.L. Yang (1990) Asymptotics in Statistics Springer-Verlag New York
A. Lijoi E. Regazzini (2001) Means of a Dirichlet process and multiple hypergeometric functions, Quaderno IAMI 01.09 CNR-IAMI Milano
A.Y. Lo (1984) ArticleTitleOn a class of Bayesian nonparametric estimates: I Density estimates. Ann. Stat. 12 351–357 Occurrence Handle0557.62036 Occurrence Handle85d:62047
E. Lukacs (1970) Characteristic Functions EditionNumber2 Griffin London
S.N. MacEachern (1994) ArticleTitleEstimating normal means with a conjugate style Dirichlet process prior Comm. Stat. – Simulation Comput. 23 727–741 Occurrence Handle0825.62053 Occurrence Handle1293996
S.N. MacEachern (1998) Computational methods for mixture of Dirichlet process models D. Day P. Müller D. Sinha (Eds) Practical Nonparametric and Semiparametric Bayesian Statistics, Lecture Notes in Statistics NumberInSeries133 Springer-Verlag New York 23–43
A. Ongaro (2005) ArticleTitleSize-biased sampling and discrete nonparametric Bayesian inference J. Stat. Plan. Inference 128 123–148 Occurrence Handle10.1016/j.jspi.2003.10.005 Occurrence Handle1075.62040 Occurrence Handle2110181
Regazzini E., An example of the interplay between statistics and special functions, in Tricomi’s ideas and contemporary applied mathematics, Atti dei Convegni Lincei 147, Accademia Nazionale dei Lincei e Accademia delle Scienze di Torino, (1998)., pp. 303–320.
E. Regazzini A. Guglielmi G. Di Nunno (1998) ArticleTitleTheory and numerical analysis for exact distributions of functionals of a Dirichlet process Ann. Stat. 30 1376–1411 Occurrence Handle2004h:62054
J. Sethuraman (1994) ArticleTitleA constructive de.nition of Dirichlet priors Statistica Sinica 4 639–650 Occurrence Handle0823.62007 Occurrence Handle95m:62058
J. Sethuraman R. Tiwari (1982) Convergence of Dirichlet measures and the interpretation of their parameter S.S. Gupta J. Berger (Eds) Proceedings of the Third Purdue Symposium on Statistical Decision Theory and Related Topics Academic Press New York 305–315
A.M. Vershik M. Yor N.V. Tsilevich (2001) ArticleTitleO tozhdestve Markova–Kreina i kvaziinvariantnosti gamma-protsessa [On the Markov–Krein identity and quasi-invariant Gamma processes (in Russian)] Transactions from the scienti.c seminars of POMI 283 21–36
S.G. Walker P. Damien P.W. Laud A.F.M. Smith (1999) ArticleTitleBayesian nonparametric inference for random distributions and related functions [with discussion] J. R. Stat. Soc. B 61 485–527 Occurrence Handle2000g:62123
D.V. Widder (1971) An Introduction to Transform Theory Academic Press New York
H. Yamato (1984) ArticleTitleCharacteristic functions of means of distributions chosen from a Dirichlet process Ann. Prob. 12 262–267 Occurrence Handle0535.60012 Occurrence Handle85c:60180
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Hjort, N.L., Ongaro, A. Exact Inference for Random Dirichlet Means. Stat Infer Stoch Process 8, 227–254 (2005). https://doi.org/10.1007/s11203-005-6068-7
Issue Date:
DOI: https://doi.org/10.1007/s11203-005-6068-7
Keywords
- Bernshtein–von Mises theorems
- Dirichlet process
- Hilbert and Stieltjes transforms
- mixtures
- nonparametric Bayes
- random probability measure
- stochastic equation