Abstract
In the present paper, we are mainly concerned with the nonparametric estimation of the density as well as the regression function, related to stationary and ergodic continuous time processes, by using orthonormal wavelet bases. We provide the strong uniform consistency properties with rates of these estimators, over compact subsets of ℝd, under a general ergodic condition on the underlying processes. We characterize the asymptotic normality of considered wavelet-based estimators under easily verifiable conditions. The asymptotic properties of these estimators are obtained by means of the martingale approach.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
D. W. K. Andrews, “Nonstrong Mixing Autoregressive Processes”, J. Appl. Probab. 21 (4), 930–934 (1984).
G. Banon, “Nonparametric Identification for Diffusion Processes”, SIAM J. Control Optim. 16 (3), 380–395 (1978).
A. Beck, “On the Strong Law of Large Numbers”, in Ergodic Theory (Proc. Internat. Sympos., Tulane Univ., New Orleans, La., 1961), (Academic Press, New York, 1963), pp 21–53.
J. Bergh and J. Löfström, Interpolation Spaces. An Introduction, in Grundlehren der Mathematischen Wissenschaften (Springer-Verlag, Berlin, 1976), No. 223.
D. Bosq and J.-P. Lecoutre, Théorie de l’estimation fonctionnelle, in Economie et Statistiques Avancées (Economica, Paris, 1987).
S. Bouzebda and S. Didi, “Multivariate Wavelet Density and Regression Estimators for Stationary and Ergodic Discrete Time Processes: Asymptotic Results”, Comm. Statist. Theory Methods, (2015) (in press). DOI:10.1080/03610926.2015.1019144
R. C. Bradley, Introduction to Strong Mixing Conditions (Kendrick Press, Heber City, UT, 2007), Vol. 1.
J. E. Chacón, J. Montanero, and A. G. Nogales, “A Note on Kernel Density Estimation at a Parametric Rate”, J. Nonparam. Statist. 19 (1), 13–21 (2007).
Y. S. Chow and H. Teicher, Probability Theory in Springer Texts in Statistics, (Springer, New York, 1997).
I. Daubechies, Ten Lectures on Wavelets, in CBMS-NSF Regional Conf. Ser. in Appl. Math. (SIAM, Philadelphia, PA, 1992), Vol. 61.
V. H. de la Peña and E. Giné, Decoupling. From Dependence to Independence, Randomly Stopped Processes. U-Statistics and Processes. Martingales and Beyond, in Probability and Its Applications (Springer-Verlag, New York, 1999).
M. Delecroix, Sur l’estimation et la prévision non-paramétrique des processus ergodiques, Doctorat d’état. Univ. des Sci. de Lille, Flandre-Artois (1987).
L. Devroye and L. Györfi, Nonparametric Density Estimation. The L1 View, in Wiley Series in Probability and Mathematical Statistics: Tracts on Probability and Statistics (Wiley, New York, 1985).
L. Devroye and G. Lugosi, Combinatorial Methods in Density Estimation, in Springer Series in Statistics (Springer-Verlag, New York, 2001).
S. Didi, Quelques propriétés asymptotiques en estimation non paramétrique de fonctionnelles de processus stationnaires à temps continu, Thèse Doctorat. Univ. Pierre et Marie Curie (2014).
E. Ginéand W. R. Madych, “On Wavelet Projection Kernels and the Integrated Squared Error in Density Estimation”, Statist. Probab. Lett. 91, 32–40 (2014).
E. Ginéand R. Nickl, “Uniform Limit Theorems for Wavelet Density Estimators”, Ann. Probab. 37 (4), 1605–1646 (2009).
L. Györfi, W. Härdle, P. Sarda, and P. Vieu, Nonparametric Curve Estimation from Time Series, in Lecture Notes in Statistics (Springer-Verlag, Berlin, 1989), Vol. 60.
P. Hall and C. C. Heyde, C. C. Martingale Limit Theory and Its Application, in Probability and Mathematical Statistics (Academic Press, New York, 1980).
W. Härdle, G. Kerkyacharian, D. Picard, and A. Tsybakov, Wavelets, Approximation, and Statistical Applications, in Lecture Notes in Statistics (Springer-Verlag, New York, 1998), Vol. 129.
M. C. Jones, “On Higher Order Kernels”, J. Nonparam. Statist. 5 (2), 215–221 (1995).
M. C. Jones and D. F. Signorini, “A Comparison of Higher-Order Bias Kernel Density Estimators”, J. Amer. Statist. Assoc. 92 (439), 1063–1073 (1997).
M. C. Jones, S. J. Davies, and B. U. Park, “Versions of Kernel-Type Regression Estimators”, J. Amer. Statist. Assoc. 89 (427), 825–832 (1994).
M. C. Jones, O. Linton, and J. P. Nielsen, “A Simple Bias Reduction Method for Density Estimation”, Biometrika 82 (2), 327–338 (1995).
U. Krengel, Ergodic Theorems, in de Gruyter Studies in Mathematics (de Gruyter, Berlin, 1985), Vol. 6. With a supplement by Antoine Brunel.
F. Leblanc, “Discretized Wavelet Density Estimators for Continuous Time Stochastic Processes”, in Lecture Notes in Statist., Vol. 103: Wavelets and Statistics (Villard de Lans, 1994) (Springer, New York, 1995), pp. 209–224.
A. Leucht and M. H. Neumann, “Degenerate U- and V-Statistics under Ergodicity: Asymptotics, Bootstrap and Applications in Statistics”, Ann. Inst. Statist. Math. 65, 349–386 (2013).
L. Li, “Nonparametric Adaptive Density Estimation on Random Fields Using Wavelet Method”, Statist. Probab. Lett. 96, 346–355 (2014).
S. Mallat, A Wavelet Tour of Signal Processing. The Sparse Way, 3ed ed. (Elsevier/Academic Press, Amsterdam, 2009). With contributions from Gabriel Peyré.
E. Masry, “Multivariate Probability Density Estimation by Wavelet Methods: Strong Consistency and Rates for Stationary Time Series”, Stochastic Process. Appl. 67 (2), 177–193 (1997).
E. Masry, “Wavelet-Based Estimation of Multivariate Regression Functions in Besov Spaces”, J. Nonparam. Statist. 12 (2), 283–308 (2000).
Y. Meyer, Wavelets and Operators, in Cambridge Studies in Advanced Mathematics (Cambridge Univ. Press, Cambridge, 1992), Vol. 37. Transl. from 1990 French original by D. H. Salinger.
M. H. Neumann, “Absolute Regularity and Ergodicity of Poisson Count Processes”, Bernoulli 17 (4), 1268–1284 (2011).
B. Vidakovic, Statistical Modeling by Wavelets, in Wiley Series in Probability and Statistics: Applied Probability and Statistics (Wiley, New York, 1999).
H. Triebel, Theory of Function Spaces, in Monographs in Mathematics (Birkhäuser, Basel, 1983), Vol. 78.
B. L. S. Prakasa Rao, Nonparametric Functional Estimation, in Probability and Mathematical Statistics (Academic Press, New York, 1983).
G. Peskir, “The Uniform Mean-Square Ergodic Theorem for Wide Sense Stationary Processes”, Stochastic Anal. Appl. 16 (4), 697–720 (1998).
D. W. Scott, Multivariate Density Estimation. Theory, Practice, and Visualization, in Wiley Series in Probability and Mathematical Statistics: Applied Probability and Statistics (Wiley, New York, 1992).
M. P. Wand and M. C. Jones, Kernel Smoothing, in Monographs on Statistics and Applied Probability. (Chapman and Hall, London, 1995), Vol. 60.
G. G. Walter, Wavelets and Other Orthogonal Systems with Applications (CRC Press, Boca Raton, FL, 1994).
L. G. Xue, “Approximation Rates of the Error Distribution of Wavelet Estimators of a Density Function under Censorship”, J. Statist. Plann. Inference 118 (1–2), 167–183 (2004).
Author information
Authors and Affiliations
Corresponding author
About this article
Cite this article
Bouzebda, S., Didi, S. & El Hajj, L. Multivariate wavelet density and regression estimators for stationary and ergodic continuous time processes: Asymptotic results. Math. Meth. Stat. 24, 163–199 (2015). https://doi.org/10.3103/S1066530715030011
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.3103/S1066530715030011
Keywords
- multivariate regression estimation
- multivariate density estimation
- stationarity
- ergodicity
- rates of strong convergence
- wavelet-based estimators
- martingale differences
- continuous time processes.