Abstract
A discussion of the evolution of a notion of strong mixing as a measure of short range dependence and with additional restrictions a sufficient condition for a central limit theorem, is given. A characterization of strong mixing for stationary Gaussian sequences is noted. Examples of long range dependence leading to limit theorems with nonnormal limiting distributions are specified. Open questions concerning limit theorems for finite Fourier transforms are remarked on. There are also related queries on the use of Fourier methods for a class of nonstationary sequences.
Access provided by Autonomous University of Puebla. Download chapter PDF
Similar content being viewed by others
Keywords
- Spectral Density
- Central Limit Theorem
- Gaussian Process
- Asymptotic Normality
- Gaussian Stationary Process
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
1 Introduction
In this section a discussion of the evolution of a notion of strong mixing as a measure of short range dependence and with additional restrictions a sufficient condition for a central limit theorem, is given. In the next section I will give a characterization of strong mixing for stationary Gaussian sequences. In Sect. 3 I will give a discussion of processes subordinated to Gaussian processes and in Sect. 4 results concerning the finite Fourier transform is noted. In Sect. 5 a number of open questions are considered.
In an effort to obtain a central limit theorem for a dependent sequence of random variables in [12], I made use of a blocking argument of S.N. Bernstein [1] and was led to what I called a strong mixing condition [2, 12]. In the blocking argument big blocks are separated by small blocks. Consider a sequence of random variables X n , \(n =\ldots,-1,0,1,\ldots\). Let \(\mathcal{B}_{n}\) and \(\mathcal{F}_{m}\) be the \(\sigma\)-fields generated by X j , j ≤ n and X j , j ≥ m, respectively. If
m > n with α(k) → 0 as \(k \rightarrow \infty \), the sequence {X n } is said to satisfy a strong mixing condition. Such a sequence needn’t be stationary. A sequence with such a strong mixing condition can be thought of as one with short range dependence and its absence an indicator of long range dependence.
The strong mixing condition together with the following assumptions are enough to obtain asymptotic normality for partial sums of the sequence. Assume that EX n = 0 for all n. The critical additional assumptions are
-
1.
$$\displaystyle{E\left \vert \sum _{j=a}^{b}X_{ j}\right \vert ^{2} \sim h(b - a)}$$
as \(b - a \rightarrow \infty \) with \(h(m) \uparrow \infty \) as \(m \rightarrow \infty \), where \(x(\theta ) \sim y(\theta )\) means x(θ)∕y(θ) → 1 as θ → θ 0 and
-
2.
$$\displaystyle{E\left \vert \sum _{j=a}^{b}X_{ j}\right \vert ^{2+\delta } = O\left (h(b - a)\right )^{1+\delta /2}}$$
as \(b - a \rightarrow \infty \) for some δ > 0.
The following theorem was obtained.
Theorem 1.
If {X n }, E(X n ) = 0, is a sequence satisfying a strong mixing condition and assumptions 1. and 2., we can determine numbers k n , p n , q n satisfying
as \(n \rightarrow \infty \) such that
is asymptotically normally distributed with positive variance (see [12] and [2]).
In the argument the numbers \(k_{n}\alpha (q_{n})\) have to be made very small. An elegant statement of a result can be given in a stationary case (see Bradley [3] for a proof).
Theorem 2.
Let {X n } be a strictly stationary sequence with E(X 0 ) = 0, \(EX_{0}^{2} < \infty \) that is strongly mixing and let \(\sigma _{n}^{2} = ES_{n}^{2} \rightarrow \infty \) as \(n \rightarrow \infty \) . The sequence \((S_{n}^{2}/\sigma _{n}^{2})\) is uniformly integrable if and only if \(S_{n}/\sigma _{n}\) is asymptotically normally distributed with mean zero and variance one.
In the paper [9] Kolmogorov and Rozanov showed that a sufficient condition for a stationary Gaussian sequence to be strongly mixing is that the spectral distribution be absolutely continuous with positive continuous spectral density.
One should note that the concept of strong mixing here is more restrictive in the stationary case than the ergodic theory concept of strong mixing. A very extensive discussion of our notion of strong mixing as well as that of other related concepts is given in the excellent three volume work of Richard Bradley [3].
In 1961 corresponding questions were taken up for what is sometimes referred as narrow band-pass filtering in the engineering literature. These results are strong enough to imply asymptotic normality for the real and imaginary parts of the truncated Fourier transform of a continuous time parameter stationary process. Let X(t), EX(t) = 0, be a separable strongly mixing stationary process with \(EX^{4}(t) < \infty \) that is continuous in mean of fourth order. If the covariance and 4th order cumulant function are integrable, it than follows that
are asymptotically normal with variance
and independent as \(T \rightarrow \infty \) (f(λ) the spectral density of X(t) at λ). This follows directly from the results given in [14].
2 Gaussian Processes
In the 1961 paper [13] a Gaussian stationary sequence {Y k } with mean zero and covariance
0 < D < 1∕2, was considered. The normalized partial sums process
of the derived quadratic sequence
was shown to have a limiting non-Gaussian distribution as \(n \rightarrow \infty \). The characteristic function of the limiting distribution is
with
Since conditions 1. and 2. are satisfied by X k , the fact that the limiting distribution is non-Gaussian implies that {X k } and {Y k } cannot be strongly mixing.
In their paper Helson and Sarason [6] obtained a necessary and sufficient condition for a Gaussian stationary sequence to be strongly mixing. This was that the spectral distribution of the sequence be absolutely continuous with spectral density w
with P a trigonometric polynomial and u and v real continuous functions on the unit circle and \(\tilde{v}\) the conjugate function of v.
It is of some interest to note that the functions of the form
with u and w continuous are such that w n is integrable for every positive or negative integer n. (The set of such functions w is W.) An example with a discontinuity at zero is noted in Ibragimov and Rozanov [7]
Making use of results on trigonometric series with monotone coefficients, it is clear that
is continuous and that
as λ → 0. So, f(λ) and 1∕f(λ) are both spectral densities of strongly mixing Gaussian stationary sequences. f(λ) has a discontinuity at λ = 0 while 1∕f(λ) is continuous with a zero at λ = 0. Sarason has also shown in [15, 16] that the functions \(\log w\), w ∈ W, have vanishing mean oscillation. Let f be a complex function on (−π, π] and I an interval with measure | I | .
Let
and
f is said to be of bounded mean oscillation if \(M_{2\pi }(f) < \infty \). Let
f is said to be of vanishing mean oscillation if f is of bounded mean oscillation and M 0(f) = 0.
In the case of a vector valued (d-vector) stationary strong mixing Gaussian sequence there is d 0 ≤ d such that the spectral density matrix w(λ) has rank d 0 for almost all λ. If d 0 = d the sequence is said to have full rank. The case of sequences of rank d 0 < d can be reduced to that of sequences of full rank. A result of Treil and Volberg [20] in the full rank case is noted.
Theorem 3.
Assume that the spectral density w of a stationary Gaussian process is such that w −1 ∈ L 1 . The process is strongly mixing if and only if
where det (w(λ)) and \([\log \mathrm{det}\;w](\lambda )\) are the harmonic extensions of w and \(\log \mathrm{det}w\) on the unit circle at the point λ on the unit disc.
The harmonic extension u on the unit disc of a function f on the unit circle is given via the Poisson kernel
3 Processes Subordinated to Gaussian Processes
In the paper [18] M. Taqqu considered the weak limit of the stochastic process
as \(n \rightarrow \infty \) and noted various properties of the limit process. Here [s] denotes the greatest integer less than or equal to s. M. Taqqu [19] and R. Dobrushin and P. Major [5] discovered about the same time that the simple example of M. Rosenblatt was a special case of an interesting broad class of nonlinear processes subordinated to the Gaussian stationary processes. Consider {X n }, EX n = 0, EX n 2 = 1 a stationary Gaussian sequence with covariance
where L(t), \(t \in (0,\infty )\) is slowly varying. Let H(⋅ ) be a function with
H j (⋅ ) is the jth Hermite polynomial with leading coefficient one. Then H(⋅ ) can be expanded in terms of the H j ’s
with
Assume that α < 1∕k with k the smallest index such that \(c_{k}\not =0\) (H is then said to have rank k). Set
and
\(n =\ldots,-1,0,1,\ldots\) and N = 1, 2, …. Then the finite dimensional distributions of Y n N, \(n =\ldots,-1,0,1,\ldots\) as \(N \rightarrow \infty \) tend to those of the sequence Y n ∗
with W(⋅ ) the Wiener process on \((-\infty,\infty )\) where in the integration it is understood that the hyper-diagonals \(x_{i} = x_{j},i\neq j\) are excluded, and
In [4] P. Breuer and P. Major obtained central limit theorems for nonlinear functions of Gaussian stationary fields. As in the discussion of results for noncentral limit theorem we shall consider the case of stationary sequences. Again, let
with X n a stationary Gaussian sequence EX n = 0, \(EX_{n}^{2} = 1\). H(⋅ ) is real-valued with
Assume that H has rank k and that
(r(⋅ ) the covariance function of the X sequence). Let H l be the lth Hermite polynomial. With \(A_{N} = N^{1/2}\) the limits
exist for all l ≥ k and
The finite dimensional distributions of Y n N as \(N \rightarrow \infty \) tend to the finite dimensional distributions of \(\sigma Z_{n}\) with the Z n i.i.d. standard normal random variables. T.C. Sun obtained the case of this result for k = 2 in [17].
4 Finite Fourier Transform
In 1961 paper [14] I showed that in the case of a separable continuous time parameter process a variety of filters amounting to narrow band-pass filtering, under the assumption of strong mixing, integrability of the covariance function and the 4th order cumulant function, stationarity and positivity of the spectral density imply asymptotic normality. This implies that
are asymptotically normal as \(T \rightarrow \infty \) for all λ and independent for \(\lambda \not =0\) as \(T \rightarrow \infty \).
A recent paper of Peligrad and Wu [11] is of considerable interest. They use a stationary ergodic Markov sequence ξ n on the probability space \((\varOmega,\mathcal{F},P)\) with marginal distribution
Let
The condition
is of particular interest. They obtain the following theorem among others.
Theorem 4.
If (X k ) is stationary ergodic satisfying (1) then for almost all θ ∈ (0,2π)
with g integrable over [0,2π] and
under P with S n (θ) the Fast Fourier transform computed at θ and N 1 (θ), N 2 (θ) independent identically distributed normal random variables with mean zero and variance g(θ)∕2. One can always take X k as a function of a Markov sequence \(\xi _{n} = (X_{k},k \leq n)\) .
In a number of examples one considers derived sequences
with
and A N a norming constant (which needn’t be \(\sqrt{N}\)). The interest is in convergence of the finite dimensional distributions of the sequence Z n N as \(N \rightarrow \infty \) to finite dimensional distributions of a limit sequence Z n ∗. The object is to determine the appropriate norming constant A N and the character of the nontrivial limit sequence Z n ∗. One is also led to the following question – for which sequences ξ n does one have
(equality in distribution for all N = 1, 2, … and n 1, …, n k ). If this is satisfied with \(A_{N} = N^{\alpha }\), ξ n is said to be a self-similar sequence with self-similarity parameter α.
In the case of the limit theorems of Taqqu [18, 19], Dobrushin and Major [5] the limit processes are self-similar with self-similarity parameter α.
It’s of interest to note that if the covariances
with L(n) slowly varying are monotone
converge uniformly outside an arbitrarily small neighbourhood of x = 0 and
as x → 0+. The real spectral density of the Gaussian stationary process with covariances r(n) has a singularity at x = 0. Given the Hermite polynomial H k consider the derived process \(H_{k}(X_{j})\) (X j the Gaussian process). The covariance of the derived process
so its spectral density will have a singularity at zero if and only if k α < 1.
A limit theorem of Kesten and Spitzer [8] is of great interest.
is the simple random walk on the integers (X i = ±1 with probability 1/2 and i.i.d.) with random sequence ξ(x), x integer, i.i.d. with the same distribution as the X i ’s but independent of them. The asymptotic behaviour of
is considered as \(n \rightarrow \infty \). U s is the linearly interpolated process. They show that
converges weakly to
where L t (x) is the local time at x of Brownian motion B t and Z(x) is a Brownian motion with time \(-\infty < x < \infty \).
ξ(S k ), k = 1, 2, … can be extended to a two-sided stationary sequence as follows. Introduce \(X_{0},X_{-1},X_{-2},\ldots\) as i.i.d. random variables with the same distribution as the earlier random variables and independent of all the other variables. Let η 0 = ξ(0),
The sequence η i is stationary and we obtain an approximation to its spectral density
and
as \(m \rightarrow \infty \). This suggests that the spectral density is of the form
and this behaves like
as λ → 0.
5 Open Questions
The almost everywhere character (in θ) of the result of Peligrad and Wu indicates that the asymptotics of the finite Fourier transform at points where there is a singularity of the spectral density functions are not dealt with. This would, for example, be the case if we had a Gaussian stationary sequence (X j ) with covariance of the form
β j > 0, 0 < α j < 1, λ j distinct, and wished to compute the finite Fourier transform of H(X k ) at λ = λ j with the leading non-zero Fourier-Hermite coefficient k of H(⋅ ) such that k α j < 1. As before the L j (⋅ ) are slowly varying. The variance of the finite Fourier transform and its limiting distributions when properly normalized as N tends to infinity are not determined. Of course this is just a particular example of interest under the assumptions made in the theorem of Peligrad and Wu.
The random sequences with covariances almost periodic functions contain a large class of interesting nonstationary processes. The harmonizable processes of this type have all their spectral mass concentrated on at most a countable number of
It would be of some interest to see whether one could characterize the Gaussian processes of this type which are strongly mixing. Assume that the spectra on the lines of support are absolutely continuous with spectral densities f b (u). Under rather strong conditions one can estimate the f b (⋅ ) (see [10]). However, there are still many open questions.
References
Bernstein, S.: Sur l’extension du théoreme limite du calcul des probabilités aux sommes de quantités dépendentes. Math. Ann. 97, 1–59 (1926)
Blum, J., Rosenblatt, M.: A class of stationary processes and a central limit theorem. Proc. Natl. Acad. Sci. USA 42, 412–413 (1956)
Bradley, R.: Introduction to Strong Mixing Conditions, vol. 1–3. Kendrick Press, Heber City (2007)
Breuer, P., Major, P.: Central limit theorems for non-linear functionals of Gaussian fields. J. Multivar. Anal. 13, 425–441 (1983)
Dobrushin, R.L., Major, P.: Non-central limit theorems for nonlinear functionals of Gaussian fields. Z. Wahrsch. Verw. Gebiete 50(1), 27–52 (1979)
Helson, H., Sarason, D.: Past and future. Math. Scand. 21, 5–16 (1967)
Ibragimov, I., Rozanov, Y.: Gaussian Random Processes. Springer, New York (1978)
Kesten, H., Spitzer, F.: A limit theorem related to a new class of self similar processes. Z. Wahrsch. Verw. Gebiete 50, 5–25 (1979)
Kolmogorov, A., Rozanov, Y.: Strong mixing conditions for stationary Gaussian processes. Theor. Probab. Appl. 5, 204–208 (1960)
Lii, K.S., Rosenblatt, M.: Estimation for almost periodic processes. Ann. Stat. 34, 1115–1130 (2006)
Peligrad, M., Wu, W.B.: Central limit theorem for Fourier transforms of stationary processes. Ann. Probab. 38, 2007–2022 (2010)
Rosenblatt, M.: A central limit theorem and a strong mixing condition. Proc. Natl. Acad. Sci. USA 42, 43–47 (1956)
Rosenblatt, M.: Independence and dependence. In: Proceedings of the 4th Berkeley Symposium on Mathematical Statistics and Probability, vol. II, pp. 431–443. University California Press, Berkeley (1961)
Rosenblatt, M.: Some comments on narrow band-pass filters. Q. Appl. Math. 18, 387–393 (1961)
Sarason, D.: An addendum to “Past and future”. Math. Scand. 30, 62–64 (1972)
Sarason, D.: Functions of vanishing mean oscillations. Trans. Am. Math. Soc. 207, 30 (1975)
Sun, T.C.: Some further results on central limit theorems for non-linear functionals of normal stationary processes. J. Math. Mech. 14, 71–85 (1965)
Taqqu, M.S.: Weak convergence to fractional Brownian motion and to the Rosenblatt process. Z. Wahrsch. Verw. Gebiete 31, 287–302 (1975)
Taqqu, M.S.: Convergence of integrated processes of arbitrary Hermite rank. Z. Wahrsch. Verw. Gebiete 50, 53–83 (1979)
Treil, S., Volberg, A.: Completely regular multivariate stationary processes and Muchenhaupt condition. Pac. J. Math. 190, 361–381 (1999)
Acknowledgements
I thank Professor Rafal Kulik for his help in putting this paper into coherent form.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer Science+Business Media New York
About this chapter
Cite this chapter
Rosenblatt, M. (2015). Short Range and Long Range Dependence. In: Dawson, D., Kulik, R., Ould Haye, M., Szyszkowicz, B., Zhao, Y. (eds) Asymptotic Laws and Methods in Stochastics. Fields Institute Communications, vol 76. Springer, New York, NY. https://doi.org/10.1007/978-1-4939-3076-0_15
Download citation
DOI: https://doi.org/10.1007/978-1-4939-3076-0_15
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4939-3075-3
Online ISBN: 978-1-4939-3076-0
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)