Abstract
It is shown that the uniform distance between the distribution function \(F_n^K(h)\) of the usual kernel density estimator (based on an i.i.d. sample from an absolutely continuous law on \({\mathbb{R}}\)) with bandwidth h and the empirical distribution function F n satisfies an exponential inequality. This inequality is used to obtain sharp almost sure rates of convergence of \(\|F_n^K(h_n)-F_n\|_\infty\) under mild conditions on the range of bandwidths h n , including the usual MISE-optimal choices. Another application is a Dvoretzky–Kiefer–Wolfowitz-type inequality for \(\|F_n^{K}(h)-F\|_\infty\) , where F is the true distribution function. The exponential bound is also applied to show that an adaptive estimator can be constructed that efficiently estimates the true distribution function F in sup-norm loss, and, at the same time, estimates the density of F—if it exists (but without assuming it does)—at the best possible rate of convergence over Hölder-balls, again in sup-norm loss.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Balabdaoui F. and Wellner J.A. (2007). A Kiefer–Wolfowitz theorem for convex densities. IMS Lect. Notes Monogr. Ser. 55: 1–31
Bickel J.P. and Ritov Y. (2003). Nonparametric estimators which can be ’plugged-in’. Ann. Stat. 31: 1033–1053
Bousquet O. (2003). Concentration inequalities for sub-additive functions using the entropy method. In: Giné, E., Houdré, C. and Nualart, D. (eds) Stochastic inequalities and applications, Progr. Probab., vol 56, pp 213–247. Birkhäuser, Boston
Butucea C. (2001). Exact adaptive pointwise estimation on Sobolev classes of densities. ESAIM Probab. Stat. 5: 1–31
Dalalyan A.S., Golubev G.K. and Tsybakov A.B. (2006). Penalized maximum likelihood and semiparametric second-order efficiency. Ann. Stat. 34: 169–201
de la Peña, V., Giné, E.: Decoupling From Dependence to Independence. Springer, New York (1999)
Donoho D.L., Johnstone I.M., Kerkyacharian G. and Picard D. (1996). Density estimation by wavelet thresholding. Ann. Stat. 24: 508–539
Dümbgen, L., Rufibach, K.: Maximum likelihood estimation of a log-concave density and its distribution function: Basic properties and uniform consistency. Preprint (2007)
Durot C. and Tocquet A.S. (2003). On the distance between the empirical process and its concave majorant in a monotone regression framework. Ann. Inst. H. Poincaré Probab. Stat. 39: 217–240
Dvoretzky A., Kiefer J. and Wolfowitz J. (1956). Asymptotic minimax character of the sample distribution function and of the classical multinomial estimator. Ann. Math. Stat. 27: 642–669
Einmahl U. and Mason D.M. (2000). An empirical process approach to the uniform consistency of kernel-type function estimators. J. Theor. Probab. 13: 1–37
Folland G.B. (1999). Real Analysis. Wiley, New York
Giné E. and Guillou A. (2001). On consistency of kernel density estimators for randomly censored data: rates holding uniformly over adaptive intervals. Ann. Inst. H. Poincaré Probab. Stat. 37: 503–522
Giné E. and Guillou A. (2002). Rates of strong uniform consistency for multivariate kernel density estimators. Ann. Inst. H. Poincaré Probab. Stat. 38: 907–921
Giné E. and Koltchinskii V. (2006). Concentration inequalities and asymptotic results for ratio type empirical processes. Ann. Probab. 34: 1143–1216
Giné E. and Mason D.M. (2007). Laws of the iterated logarithm for the local U-statistic process. J. Theor. Probab. 20: 457–486
Giné, E., Nickl, R.: Uniform limit theorems for wavelet density estimators. preprint (2007)
Giné, E., Nickl, R.: Uniform central limit theorems for kernel density estimators. Probab. Theory Related Fields (forthcoming) (2008)
Hall P., Kerkyacharian G. and Picard D. (1998). Block threshold rules for curve estimation using kernel and wavelet methods. Ann. Stat. 26: 922–942
Ibragimov I.A. and Khasminski R.Z. (1980). On estimation of distribution density. Zap. Nauchnyh Seminarov LOMI 98: 61–86
Juditsky A. and Lambert-Lacroix S. (2004). On minimax density estimation on \(\mathbb R\) Bernoulli 10: 187–220
Kerkyacharian G., Picard D. and Tribouley K (1996). L p adaptive density estimation. Bernoulli 2: 229–247
Kiefer J. and Wolfowitz J. (1976). Asymptotically minimax estimation of concave and convex distribution functions. Z. Wahr. verw. Gebiete. 34: 73–85
Ledoux M. and Talagrand M. (1991). Probability in Banach spaces. Springer, Berlin
Lepski O.V. (1991). Asymptotic minimax adaptive estimation. 1. Upper bounds. Theory Probab. Appl. 36: 682–697
Lepski O.V., Mammen E. and Spokoiny V.G. (1997). Optimal spatial adaptation to inhomogeneous smoothness: an approach based on kernel estimates with variable bandwidth selectors. Ann. Stat. 25: 929–947
Lepski O.V. and Spokoiny V.G. (1997). Optimal pointwise adaptive methods in nonparametric estimation. Ann. Stat. 25: 2512–2546
Marron J.S. and Wand M.P. (1992). Exact mean integrated squared error. Ann. Stat. 20: 712–736
Nickl R. (2007). Donsker-type theorems for nonparametric maximum likelihood estimators. Probab. Theory Related Fields 138: 411–449
Rio E. (2002). Une inégalité de Bennett pour les maxima de processus empiriques. Ann. Inst. H. Poincaré Probab. Stat. 38: 1053–1057
Talagrand M. (1994). Sharper bounds for Gaussian and empirical processes. Ann. Probab. 22: 28–76
Talagrand M. (1996). New concentration inequalities in product spaces. Invent. Math. 126: 505–563
Tsybakov A.B. (1998). Pointwise and sup-norm sharp adaptive estimation of the functions on the Sobolev classes. Ann. Stat. 26: 2420–2469
Wellner J.A. and Vaart A.W. (1996). Weak Cconvergence and Empirical Processes. Springer, New York
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Giné, E., Nickl, R. An exponential inequality for the distribution function of the kernel density estimator, with applications to adaptive estimation. Probab. Theory Relat. Fields 143, 569–596 (2009). https://doi.org/10.1007/s00440-008-0137-y
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00440-008-0137-y