Abstract
In this paper, we address the problem of estimating a multidimensional density f by using indirect observations from the statistical model Y = X + ε. Here, ε is a measurement error independent of the random vector X of interest and having a known density with respect to Lebesgue measure. Our aim is to obtain optimal accuracy of estimation under \({\mathbb{L}_p}\)-losses when the error ε has a characteristic function with a polynomial decay. To achieve this goal, we first construct a kernel estimator of f which is fully data driven. Then, we derive for it an oracle inequality under very mild assumptions on the characteristic function of the error ε. As a consequence, we getminimax adaptive upper bounds over a large scale of anisotropic Nikolskii classes and we prove that our estimator is asymptotically rate optimal when p ∈ [2,+∞]. Furthermore, our estimation procedure adapts automatically to the possible independence structure of f and this allows us to improve significantly the accuracy of estimation.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Y. Baraud, and L. Birgé, “Estimating Composite Functions by Model Selection”, Ann. Inst. H. Poincaré Probab. Statist. 50, 285–314 (2014).
R. Benhaddou, M. Pensky, and D. Picard, “Anisotropic Denoising in Functional Deconvolution Model with Dimension-Free Convergence Rates”, Electronic J. Statist. 7, 1686–1715 (2013).
N. Bissantz, L. Dümbgen, H. Holzmann, and A. Munk, “Nonparametric Confidence Bands in Deconvolution Density Estimation”, J. Roy. Statist. Soc., Ser. B 69, 483–506 (2007).
C. Butucea, “Deconvolution of Supersmooth Densities with Smooth Noise”, Canad. J. Statist. 32 (2), 181–192 (2004).
C. Butucea and F. Comte, “Adaptive Estimation of Linear Functionals in the Convolution Model and Applications”, Bernoulli 15 (1), 69–68 (2009).
C. Butucea and A. B. Tsybakov, “Sharp Optimality inDensity Deconvolution with Dominating Bias. I”, Teor. Veroyatn. Primen. 52 (1), 111–128 (2007).
C. Butucea and A. B. Tsybakov, “Sharp Optimality in Density Deconvolution with Dominating Bias. II”, Theory Probab. Appl. 52 (2), 237–249 (2008).
R. J. Carroll and P. Hall, “Optimal Rates of Convergence for Deconvolving a Density”, J. Amer. Statist. Assoc. 83, 1184–1186 (1988).
F. Comte and C. Lacour, “Anisotropic Adaptive Kernel Deconvolution”, Ann. Inst. H. Poincaré Probab. Statist. 49 (2), 569–609 (2013).
F. Comte and T. Rebafka, “Adaptive Density Estimation in the Pile-Up Model Involving Measurement Errors”, Electronic J. Statist. 6, 2002–2037 (2012).
L. Devroye and G. Lugosi, “Nonasymptotic Universal Smoothing Factor, Kernel Complexity and Yatracos Classes”, Ann. Statist. 25, 2626–2637 (1997).
J. Fan, “On the Optimal Rates of Convergence for Nonparametric Deconvolution Problems”, Ann. Statist. 19 (3), 1257–1272 (1991).
J. Fan, “Global Behavior of Deconvolution Kernel Estimates”, Statist. Sinica 1, 541–551 (1991).
J. Fan, “Adaptively Local One-Dimensional Subproblems with Application to a Deconvolution Problem”, Ann. Statist. 21 (2), 600–610 (1993).
A. Goldenshluger and O. V. Lepski, “Structural Adaptation via Lp-Norm Oracle Inequalities”, Probab. Theory Rel. Fields 143, 41–71 (2009).
A. Goldenshluger and O. Lepski, “Uniform Bounds for Norms of Sums of Independent Random Functions”, Ann. Probab. 39, 2318–2384 (2011a).
A. Goldenshluger and O. Lepski, “Bandwidth Selection in Kernel Density Estimation: Oracle Inequalities and Adaptive Minimax Optimality”, Ann. Statist. 39, 1608–1639 (2011b).
A. Goldenshluger and O. Lepski, “On Adaptive Minimax Density Estimation on Rd”, Probab. Theory and Rel. Fields 159, 479–543 (2013).
L. Grafakos, Classical Fourier Analysis, in Graduate Texts in Mathematics (Springer, 2008), Vol. 249.
P. Hall and A. Meister, “A Ridge-Parameter Approach to Deconvolution”, Ann. Statist. 35 (4), 1535–1558 (2007).
J. I. Horowitz and E. Mammen, “Rate-Optimal Estimation for a General Class of Nonparametric Regression Models with Unknown Link Functions”, Ann. Statist. 35 (6), 2589–2619 (1990).
A. B. Juditsky, O.V. Lepski, and A. B. Tsybakov, “Nonparametric Estimation of Composite Functions”, Ann. Statist. 37 (3), 1360–1440 (2009).
G. Kerkyacharian, O. V. Lepski, and D. Picard, “Nonlinear Estimation in Anisotropic Multi-Index Denoising”, Probab. Theory and Rel. Fields 121, 137–170 (2001).
O. Lepski, “Upper Functions for Positive Random Functionals. I. General Setting and Gaussian Random Functions”, Math. Methods Statist. 22 (1), 1–27 (2013).
O. Lepski, “Multivariate Density Estimation Under Sup-Norm Loss: Oracle Approach, Adaptation and Independence Structure”, Ann. Statist. 40 (2), 1005–1034 (2013).
O. V. Lepski and N. Serdyukova, “Adaptive Estimation under Single-Index Constraint in a Regression Model”, Ann. Stat. 40 (1), 1–28 (2014).
O. Lepski and T. Willer, “Lower Bounds in the Convolution Structure Density Model”, Bernoulli (2014) (forthcoming paper).
K. Lounici and R. Nickl, “Global Uniform Risk Bounds forWavelet Deconvolution Estimators”, Ann. Statist. 39 (2), 201–231 (2011).
E. Masry, “Multivariate Probability Density Deconvolution for Stationary Random Processes”, IEEE Trans. Inform. Theory 37 (4), 1105–1115 (1991).
E. Masry, “Strong Consistency and Rates for Deconvolution of Multivariate Densities of Stationary Processes”, Stochastic Proc. and Their Appl. 47, 53–74 (1993).
P. Massart, Concentration Inequalities and Model Selection, in Lecture Notes in Mathematics, Vol. 1886: Lecture from the 33rd Summer School on Probability Theory Held in Saint-Floor, July 6-23, 2003 (Springer, Berlin, 2007).
A. Meister, “Deconvolution from Fourier-Oscillating Error Densities under Decay and Smoothness Restrictions”, Inverse Problems 24 (1), (2008).
S. M. Nikol’skii, Approximation of Functions of Several Variables and Embedding Theorems (Nauka, Moscow, 1977) [in Russian].
M. Pensky and B. Vidakovic, “AdaptiveWavelet Estimator for Nonparametric Density Deconvolution”, Ann. Statist. 27 (6), 2033–2053 (1999).
G. Rebelles, “Pointwise Adaptive Estimation of a Multivariate Density under Independence Hypothesis”, Bernoulli 21 (4), 1984–2023 (2014).
G. Rebelles, “Lp Adaptive Estimation of an AnisotropicDensity under IndependenceHypothesis”, Electronic J. Statist. 9, 106–134 (2015).
A. Samarov and A. B. Tsybakov, “Aggregation of Density Estimators and Dimension Reduction”, in Advances in Statistical Modeling and Inference, Ser. Biostat., 3, (World Sci. Publ., Hackensack, NJ, 2007), pp. 233–251.
L. A. Stefanski, “Rates of Convergence of Some Estimators in a Class of Deconvolution Problems”, Statist. Probab. Lett. 9, 229–235 (1990).
L. A. Stefanski and R. J. Carroll, “Deconvoluting KernelDensityEstimators”, Statistics 21, 169–184 (1990).
A. Tsybakov, Introduction to Nonparametric Estimation, in Springer Series in Statistics (Springer, New York, 2009).
E. Youndjé and M. T. Wells, “Optimal Bandwidth Selection for Multivariate Kernel Deconvolution Density Estimation”, TEST 17 (1), 138–162 (2008).
Author information
Authors and Affiliations
Corresponding author
About this article
Cite this article
Rebelles, G. Structural adaptive deconvolution under \({\mathbb{L}_p}\)-losses. Math. Meth. Stat. 25, 26–53 (2016). https://doi.org/10.3103/S1066530716010026
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.3103/S1066530716010026
Keywords
- density estimation
- deconvolution
- kernel estimator
- oracle inequality
- adaptation
- independence structure
- concentration inequality