Abstract
In this paper, we obtain error bound for pseudo-binomial and negative binomial approximations to weighted sums of locally dependent random variables, using Stein’s method. We also discuss approximation results for weighted sums of independent random variables. We demonstrate our results through some applications in finance and runs in statistics.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction and Preliminaries
Sums of random variables (rvs) have always a special attraction as it raises in relevant theoretical challenges. Moreover, several linear statistics can be represented as weighted sums of rvs. Also, it is difficult to find the exact distribution of weighted sums of rvs, especially, if the underlying rvs are non-identical. So, it is of interest to study the behavior of such distributions. Many researchers studied the limiting behavior of weighted sums of rvs such as Chow and Lai [7], Olvera-Cravioto [18], and Zhengyan [28], among many others. But if weights are natural numbers, then it is also difficult to get asymptotic limits. Therefore, the study of the proximity of such distributions with a suitable distribution is of interest when the summation is taken over a finite set.
In this paper, we consider weighted sums of \({\mathbb {Z}}_+\)-valued rvs, where \({\mathbb {Z}}_+=\{0,1,2,\ldots \}\), the set of nonnegative integers, and propose its approximation with pseudo-binomial and negative binomial distributions by matching the first two moments. Also, we assume weights are natural numbers. Let \(X_1\sim \) PB(N, p), the pseudo-binomial distribution (see Čekanavičius and Roos [24], p. 370), and \(X_2\sim \) NB\((r,{\bar{p}})\), the negative binomial distribution, then their probability mass functions are given by
and
respectively, where \(N>1\), \(r>0\), \(0<q=1-p<1\), \(0<{\bar{q}}=1-{\bar{p}}<1\), \(\delta =\sum _{k=0}^{\left\lfloor N\right\rfloor }\left( {\begin{array}{c}N\\ k\end{array}}\right) {p}^{k}q^{N-k}\), \(\left( {\begin{array}{c}N\\ k\end{array}}\right) =N(N-1)\cdots (N-k+1)/k!\), and \(\left\lfloor N\right\rfloor \) is the greatest integer function of N. The study of asymptotic behavior for weighted sums of rvs is discussed widely in the literature under certain conditions on weights; for example, the sum of squares of weights is finite (see Chow and Lai [7]), weights are normalized (see Etemadi [9]) and geometrically weighted (see Bhati and Rattihalli [6]), among many others. However, we consider weights are natural numbers which do not satisfy these types of conditions and obtain error bounds for pseudo-binomial and negative binomial approximations. This study of proximity is useful to identify the behavior of such distributions over a finite set. We use the total variation distance metric and Stein’s method to derive our approximation results.
Next, let \({\mathcal {G}}=\{g:{{\mathbb {Z}}}_+\rightarrow {{\mathbb {R}}}|~g~\text {is bounded}\}\) and \({\mathcal {G}}_Y=\{g\in {\mathcal {G}}|~g(0)=0~\text {and}~g(y)=0,~\text {for}~y\notin \mathbf{\text {S}}(Y)\}\), for a \({\mathbb {Z}}_+\)-valued rv Y, where S(Y) is the support of the rv Y. We discuss briefly Stein’s method (Stein [20]) which can be carried out mainly in the three steps. First, compute a Stein operator \({\mathcal {A}}_Y\) which satisfies \({{\mathbb {E}}}[{\mathcal {A}}_Y g(Y)]=0\), for \(g \in {\mathcal {G}}_Y\). Second, find the solution of Stein equation
Finally, use a rv Z in place of k in (1.1) and take expectation and supremum which leads to the total variation distance between Y and Z as follows:
where \({\mathcal {H}}=\{I(A)| A \subseteq {{\mathbb {Z}}}_+\}\) and I(A) is the indicator function of the set A.
Next, consider a rv X and its Stein operator of the form
which represent pseudo-binomial Stein operator if \(\alpha =Np/q\) and \(\beta =-p/q\) and negative binomial Stein operator if \(\alpha =r {\bar{q}}\) and \(\beta ={\bar{q}}\), respectively. For details, see (5) and (6) of Upadhye et al. [23]. Also, the upper bound for the solution of (1.1) (say \(g_f\)) is given by
where \(\Delta g_f(k)=g_f(k+1)-g_f(k)\) and \(\Vert \Delta g_f\Vert =\sup _k |\Delta g_f(k)|\). See (2.8), (2.10), and (2.11) of Kumar et al. [14] and (57) of Čekanavičius and Roos [24] for more details. Observe that
are mean and variance of pseudo-binomial and negative binomial distributions, respectively. For more details, we refer the reader to Brown and Xia [5], Eichelsbacher and Reinert [8], Kumar et al. [14], Ley et al. [16], Upadhye and Barman [22], Upadhye et al. [23], and references therein.
This paper is organized as follows: In Sect. 2, we present our main results and discuss some relevant remarks and applications. In Sect. 3, we give the proofs of our main results.
2 Main Results
Let \(J\subset {\mathbb {N}}=\{1,2,\ldots \}\) be finite and \(\{\eta _i,i\in J\}\) be a collection of \({\mathbb {Z}}_+\)-valued random variables. Also, for each i, let \(w_i\in {\mathbb {N}}\), \({\mathbb {E}}(\omega _i \eta _i)^3<\infty \), and \(i\in A_i\subseteq B_i\subset J\) be such that \(\eta _i\) is independent of \(\eta _{A_i^c}\) and \(\eta _{A_i}\) is independent of \(\eta _{B_i^c}\), where \(\eta _A\) is the collection of random variables \(\{\eta _i,i\in A\}\) and \(A^c\) denotes the complement of the set A. See Section 3 of Röllin [19] for a similar type of locally dependent structure. In addition, if \(A_i=B_i=\{i\}\), then our locally dependent structure reduced to the independent collection of random variables. Now, let \(w_i=1\) for at least one \(i\in J\) and define
the weighted sum of locally dependent random variables. For a set \(A\subset J\), we let \(\eta _{A}^{*}=\sum _{i\in A}\omega _i \eta _i\). For any random variables Z, we define \({\mathcal {D}}(Z):=2d_{TV}({\mathcal {L}}(Z),{\mathcal {L}}(Z+1))\). Throughout this section, let X be a random variable having Stein operator (1.3) and
so that \({\mathbb {E}}X={\mathbb {E}}W\) and \(\mathrm {Var}(X)=\mathrm {Var}(W)\).
2.1 Locally Dependent Random Variables
In this subsection, we consider \(\{i\}\subset A_i\subset B_i\) and discuss the approximation result for the weighted sum of locally dependent random variables.
Theorem 2.1
Let W be the weighted sum of locally random variables as defined in (2.1) and X be a random variable having Stein operator (1.3) satisfying (2.2). Then,
where the upper bound of \(\Vert \Delta g\Vert \) is given in (1.4).
Remark 2.1
-
(i)
Observe that W can be represented as a conditional sum of independent random variables. Therefore, Subsections 5.3 and 5.4 of Röllin [19] are useful to find the upper bound of \({\mathcal {D}}(W|\cdot )\).
-
(ii)
The choice of parameters in (2.2) is valid if \({\mathbb {E}}W>\mathrm {Var}(W)\) and \({\mathbb {E}}W<\mathrm {Var}(W)\) for pseudo-binomial and negative binomial approximations, respectively.
Next, we discuss some applications of Theorem 2.1.
Example 2.1
((1,1)-runs) Let \(J=\{1,2,\ldots ,n\}\) and \(\{\zeta _i,i \in J\}\) be a sequence of independent Bernoulli trials with success probability \(p_i={\mathbb {P}}(\zeta _i=1)=1-{\mathbb {P}}(\zeta _i=0)\). Also, let \(A_i=\{j:|j-i|\le 1\}\cap J\), \(B_i=\{j:|j-i|\le 2\}\cap J\), \({\bar{\zeta }}_i=(1-\zeta _{i-1})\zeta _i\), and \(W_n=\sum _{i=2}^{n}{\bar{\zeta }}_i\). Then, the distribution of \(W_n\) is known as the distribution of (1, 1)-runs and it adopted our locally dependent structure with \(\omega _i=1\). For more details, see Huang and Tsai [12], Upadhye et al. [23], Vellaisamy [25], and reference therein.
Next, it can be easily verified that
Therefore, the pseudo-binomial approximation to \(W_n\) is suitable in the view of the valid choice of parameters. Now, let \({\mathcal {D}}(W_i^\star )={\mathcal {D}}(W_n|{\bar{\zeta }}_{B_i})\) and \({\bar{\zeta }}_{e}=\{{\bar{\zeta }}_{2k},1\le k\le \left\lfloor n/2\right\rfloor \}\) then \({\mathcal {L}}(W_i^\star |{\bar{\zeta }}_e=k)\) can be represented as the sum of independent random variables (say \(\zeta _i^{k}\), \(i\in \{1,2,\ldots ,n_k\}=:{\mathcal {F}}_k\) and \(k\in \{0,1\}^{\left\lfloor n/2\right\rfloor }\)), and therefore, from (5.11) if Röllin [19], we have
where \(V_{{\bar{\zeta }}_e=k}=\sum _{j \in {\mathcal {F}}_k}\min \left\{ 1/2,1-{\mathcal {D}}(\zeta _j^k)\right\} \). Let \(1/2 \ge {\mathbb {P}}(\zeta _i^k=1)=1-{\mathbb {P}}(\zeta _i^k=0)=\sum _{k_1,k_2\in \{0,1\}}\) \({\mathbb {P}}({\bar{\zeta }}_i=1|{\bar{\zeta }}_{i-1}=k_1,{\bar{\zeta }}_{i+1}=k_2)={\mathbb {P}}({\bar{\zeta }}_i=1|{\bar{\zeta }}_{i-1}=0,{\bar{\zeta }}_{i+1}=0)=(1-p_{i-1})p_i\). Therefore,
Hence, \(V_{{\bar{\zeta }}_e=k}=\frac{1}{2}\sum _{j \in {\mathcal {F}}_k}\min \left\{ 1,3(1-p_{i-1})p_i\right\} \) and, from Theorem 2.1 with the pseudo-binomial setting, we have
where \({\hat{n}}=\left( \sum _{i=2}^{n}(1-p_{i-1})p_i\right) ^2/\sum _{i=2}^{n}\sum _{j\in A_i}(1-p_{i-1})(1-p_{j-1})p_ip_j\), \({\hat{p}}=\sum _{i=2}^{n}\sum _{j\in A_i}(1-p_{i-1})(1-p_{j-1})p_ip_j/\sum _{i=2}^{n}(1-p_{i-1})p_i\), and \({\mathcal {F}}=\min _{k}{\mathcal {F}}_k\). Note that the above bound is of \(O(n^{-1/2})\) which is an improvement over (77) of Upadhye et al. [23], Theorem 2.1 of Vellaisamy [25], which are of O(1), and Theorem 2.1 of Godbole [11], which is of order O(n).
Example 2.2
(Collateralized Debt Obligation (CDO)) A CDO is a type of asset-backed security that transferred pool of assets into a product and sold to investors. These assets divided into a set of repayment which is called tranches. The tranches have different payment priorities and interest rates. The basic tranches used in CDO are senior, mezzanine, and equity. Investors can invest in their interested tranches. For more details, see Neammanee and Yonghint [17], Yonghint et al. [27], and reference therein.
In Yonghint et al. [27], it is demonstrated that the locally dependent CDO occurs in the borrower’s related assets that arise from several groups. If the element of groups have weights in terms of economy. Then, the weighted locally dependent CDO is also useful in applications.
We consider the CDO similar to discussed by Yonghint et at. [27]. Let the CDO tranche pricing is based on \({\bar{n}}\) assets and the recovery rate of ith assets is \(R_i>0\). The percentage cumulative loss in CDO up to time T is
where \(I_i=I(\tau _i \le T)\), and \(\tau _i\) is the default time of the ith asset. Assume the recovery rate is constant, say R; then, the CDO pricing problem is reduced to calculate
where \(z^*=(1-R)z/{\bar{n}}>0\) is the attachment or the detachment point of the tranche, \({\overline{W}}_{{\bar{n}}}=\sum _{i=1}^{{\bar{n}}} \omega _i I_i\), and \((a)^+=\max (a,0)\). Note that, from (2.4), it is sufficient to deal with \({\mathbb {E}}[({\overline{W}}_{{\bar{n}}}-z)^+]\). For additional details, see Yonghint et al. [27] and reference therein.
We are interested to approximate \({\mathbb {E}}[({\overline{W}}_{{\bar{n}}}-z)^+]\) by \({\mathbb {E}}[(\text {PB}(N,p)-z)^+]\). First, let us modify the Stein equation (1.1) as
Here, \(f:{\mathbb {Z}}_+\rightarrow {\mathbb {R}}\) such that \(f(k)=(k-z)^+\). Using the rv \({\overline{W}}_{{\bar{n}}}\) in place of k and taking expectation, we get
Therefore, it is enough to deal with the right-hand side, that is, \({\mathbb {E}}[{\mathcal {A}}g({\overline{W}}_{{\bar{n}}})]\).
Next, we move to find the upper bound for \(\Vert \Delta g\Vert \). Following the steps similar to Lemma 1 of Neammanee and Yonghint [17], for \(z\ge 0\), we have
It can be easily verified that (2.5) has a solution
for \(k\ge 1\). For details, see (2.6) of Eichelsbacher and Reinert [8]. Now, following the steps similar to Lemma 2 Neammanee and Yonghint [17], for \(k\ge 1\), we get
where \(\left\lceil x\right\rceil \) denote the least integer more than or equal to x. Also, for \(k\le Np\), we have
and, for \(k\ge np\),
Combining (2.8) and (2.9), for \(k\ge 1\), we have
Therefore, from (2.6) and (2.10), we have
Next, observe that
where
and
Using (2.7) and (2.11), we have
Hence, from (3.5), we have
where \(q=1-p=\mathrm {Var}({\overline{W}}_{{\bar{n}}})/{\mathbb {E}}{\overline{W}}_{{\bar{n}}}\), \(N=({\mathbb {E}}{\overline{W}}_{{\bar{n}}})^2/({\mathbb {E}}{\overline{W}}_{{\bar{n}}}-\mathrm {Var}({\overline{W}}_{{\bar{n}}}))\), \(I_{A}^{*}=\sum _{i\in A}\omega _i I_i\), \(I_{A}\) is the collection of random variables \(\{I_i:i\in A\}\), for \(A\subset \{1,2,\ldots ,{\bar{n}}\}\), and \({\mathcal {D}}({\overline{W}}_{{\bar{n}}}|\cdot )\) can be computed subject to the exact structure of dependency. For example, if the dependency structure is the same as discussed in Example 2.1 and \(\omega _i=1\), \(1\le i \le n\), then
which is an improvement over the bound given in Theorem 2(1) of Yonghint et al. [27].
2.2 Independent Random Variables
In this subsection, we consider \(B_i=A_i=\{i\}\) in the earlier discussed setup and obtain approximation results for \(W^*=\sum _{i\in J}\omega _i \eta _i\), the weighted sum of independent random variables. To simplify the presentation, let us define \(p_i(k):={\mathbb {P}}(\eta _i=k)\) and \(\gamma :=2 \max _{i \in J}d_{TV}(W_i,W_i+1)\) where \(W_i=W^*-\omega _i \eta _i\).
Theorem 2.2
Let \(W^*\) be the weighted sum of independent random variables and X be a random variable having Stein operator (1.3) satisfying (2.2). Then,
where \(d_i={\mathbb {E}}(\omega _i\eta _i)|(1-\beta )[{\mathbb {E}}(\eta _i)^2-{\mathbb {E}}(\eta _i(\eta _i-1))]+\beta {\mathbb {E}}(\eta _i)|\) and
Remark 2.1
Note that Remark 4.1 of Vellaisamy et al. [26] can be applied to our results, and hence for \(\gamma _j=\min \{1/2,1-d_{TV}(\omega _j\eta _j,\omega _j\eta _j+1)\}\), \(\gamma ^*=\max _{j \in J}\gamma _j\), we have
Therefore, if \(\eta _J\) is of O(n), then the bound (2.13) is of \(O(n^{-1/2})\). Observe that the above bound for \(\gamma \) is useful when \(w_j=1\) for many values of j.
Corollary 2.1
Assume the conditions of Theorem 2.2 hold with \(X\sim \) PB(N, p) and \({\mathbb {E}}W^*>\mathrm {Var}(W^*)\). Then,
where \(d_i={\mathbb {E}}(\omega _i\eta _i)|{\mathbb {E}}(\eta _i)^2-{\mathbb {E}}(\eta _i(\eta _i-1))-p{\mathbb {E}}(\eta _i)|\) and
Remark 2.2
-
(i)
If \(J=\{1,2,\ldots ,n\}\), \(\omega _i=1\), and \(\eta _i\sim \) Ber(p), for all \(1\le i \le n\). Then, \(h_i(k)=d_i=0\), and hence, \(d_{TV}({\mathcal {L}}(W^*), \text {PB}(N,p))=0\), as expected.
-
(ii)
Let \(\omega _i=1\) and \(\eta _i\sim \) Ber\((p_i)\), for \(i\in J=\{1,2,\ldots ,n\}\). Then, from Corollary 2.1, we have
$$\begin{aligned} d_{TV}({\mathcal {L}}(W^*),PB(N,p))\le \sqrt{\frac{2}{\pi }}\left( \frac{1}{4}+\sum _{i=1}^{n}{\bar{\gamma }}_i-{\bar{\gamma }}^*\right) ^{-1/2}\frac{1}{\left\lfloor N\right\rfloor pq}\sum _{i=1}^{n}p_i^2|p-p_i|, \end{aligned}$$(2.14)where \({\bar{\gamma }}_j=\frac{1}{2}\min \{1,1+p_i-|1-2p_i|\}\) and \({\bar{\gamma }}^*=\max _{1\le i\le n}{\bar{\gamma }}_i\). The bound given in (2.14) is of \(O(n^{-1/2})\) and is an order improvement over Theorem 1 of Barbour and Hall [2], Theorem 9.E of Barbour et al. [3], and the bounds discussed by Kerstan [13] and Le Cam [15].
-
(iii)
Consider the setup of CDO discussed in Example 2.2 under independent Bernoulli trials and unit weights, that is, \({\overline{W}}_n^*=\sum _{i=1}^{n}I_i\) where \(I_i\), for \(1\le i\le n\), are independent Bernoulli trials. Using \(A_i=B_i=\{i\}\) in (3.1), routine calculations lead to
$$\begin{aligned} \big |{\mathbb {E}}[{\mathscr {A}}g({\overline{W}}_n^*)]\big |\le \frac{(1+q)}{q^{\left\lceil N\right\rceil +1}}\sum _{i=1}^{n}p_i|p-p_i|, \end{aligned}$$(2.15)where \(p=\frac{1}{N}\sum _{i=1}^{n}p_i\). Note that if \(p_i=p\) in (2.15), for \(1\le i\le n\), then \(\big |{\mathbb {E}}[{\mathscr {A}}g({\overline{W}}_n^*)]\big |=0\), as expected. Also, from (3.8) with \(\omega _i=1\), for \(1\le i \le n\), we have
$$\begin{aligned} \big |{\mathbb {E}}[{\mathscr {A}}g({\overline{W}}_n^*)]\big |\le \sqrt{\frac{2}{\pi }}\left( \frac{1}{4}+\sum _{i=1}^{n}{\tilde{\gamma }}_i-{\tilde{\gamma }}^*\right) ^{-1/2}\frac{1+q}{q^{\left\lceil N\right\rceil +1}}\sum _{i=1}^{n}p_i^2|p-p_i|, \end{aligned}$$(2.16)where \({\tilde{\gamma }}_i=\frac{1}{2}\min \{1,1+p_i-|1-2p_i|\}\) and \({\tilde{\gamma }}^*=\max _{1\le i\le n}{\bar{\gamma }}_i\), \(q=1-p=\sum _{i=1}^{n}p_iq_i/\sum _{i=1}^{n}p_i\), and \(N=(\sum _{i=1}^{n}p_i)^2/\sum _{i=1}^{n}p_i^2\). For Poisson approximation, the existing bound given in (4) of Neammanee and Yonghint [17] is
$$\begin{aligned} \big |{\mathbb {E}}[{\mathscr {A}}g({\overline{W}}_n^*)]\big |\le \left( 2\exp \left( \sum _{i=1}^{n}p_i\right) -1\right) \sum _{i=1}^{n}p_i^2. \end{aligned}$$(2.17)Note that, for small values of \(p_i\), the bound given in (2.15) is better than the bound given in (2.17). For instance, let \(n=50\) and \(p_i\), \(1\le i\le 50\), be defined as follows:
i
\(p_i\)
i
\(p_i\)
i
\(p_i\)
0-10
0.05
21-30
0.15
41-50
0.25
11-20
0.10
31-40
0.20
Next, the following table gives a comparison between (2.15), (2.16), and (2.17).
Observe that our bounds are better than existing bounds for various values of N and \(p_i\).
Corollary 2.2
Assume the conditions of Theorem 2.2 hold with \(X\sim \) NB\((r,{\bar{p}})\) and \({\mathbb {E}}W^*<\mathrm {Var}(W^*)\). Then,
where \(d_i={\mathbb {E}}(\omega _i\eta _i)|{\bar{p}}[{\mathbb {E}}(\eta _i)^2-{\mathbb {E}}(\eta _i(\eta _i-1))]+{\bar{q}}{\mathbb {E}}(\eta _i)|\) and
Remark 2.3
-
(i)
If \(J=\{1,2,\ldots ,n\}\) and \(\omega _i=1\), for all i, then, from Corollary 2.2, we have
$$\begin{aligned}&d_{TV}({\mathcal {L}}(W^*),\text {NB}(r,{\bar{p}}))\nonumber \\&\le \frac{\gamma }{r {\bar{q}}} \sum _{i=1}^{n}\left( \sum _{k=2}^{\infty }\frac{k(k-1)}{2}|{\bar{p}}{\mathbb {E}}\eta _i p_i(k)+{\bar{q}}kp_i(k)-(k+1)p_i(k+1)|+d_i\right) , \end{aligned}$$(2.19)which is an improvement over the bound given in (17) of Vellaisamy et al. [26]. Also, if \(\eta _i\sim \) Geo\(({\bar{p}})\), the geometric distribution, for \(1\le i\le n\), then \(d_{TV}({\mathcal {L}}(W^*),\text {NB}(n,{\bar{p}}))=0\), as expected.
-
(ii)
If \(\eta _i\sim \text {NB}(n_i,p_i)\), \(1\le i \le n\), then the bound given in (2.19) leads to
$$\begin{aligned} d_{TV}({\mathcal {L}}(W^*),\text {NB}(r,{\bar{p}}))\le \frac{\gamma ^*}{r {\bar{q}}} \sum _{i=1}^{n}\left( {\bar{p}}(n_iq_i+1)\left| \frac{q_i}{p_i}-\frac{{\bar{q}}}{{\bar{p}}}\right| \frac{n_i(n_i+1)q_i^2}{p_i^2}+d_i\right) , \end{aligned}$$where \(\gamma ^*\le \sqrt{\frac{2}{\pi }}(\frac{1}{4}+\sum _{i=1}^{n}{\mathbb {P}}(\eta _i=\left\lfloor (n_i-1)q_i / p_i\right\rfloor )-\max _{1\le i\le n}{\mathbb {P}}(\eta _i=\left\lfloor (n_i-1)q_i / p_i\right\rfloor ))^{-1/2}\) and \(q_i=1-p_i\), which is an order improvement over the bound given in Theorem 3.1 of Teerapabolarn [21].
Example 2.3
(Compound Poisson Distribution) Let \(w_i=i\), \(\eta _i\sim \text {Po}(\lambda _i)\), the Poisson distribution, for \(i\in J=\{1,2,\ldots ,n\}\), and \(S_n=\sum _{i=1}^{n}i\eta _i\). The distribution of \(S_\infty \) is known as compound Poisson distribution. The mean and variance of \(S_n\) satisfy \(\sum _{i=1}^{n}i\lambda _i={\mathbb {E}}S_n< \mathrm {Var}(S_n)=\sum _{i=1}^{n}i^2\lambda _i\). Therefore, the negative binomial approximation is suitable in the view of the applicability of parameters. Hence, from (2.18), we have
where \({\bar{q}}=\sum _{i=1}^{n}i(i-1)\lambda _i\big / \sum _{i=1}^{n}i^2\lambda _i\) and \(r=\left( \sum _{i=1}^{n}i\lambda _i\right) ^2\big / \sum _{i=1}^{n}i(i-1)\lambda _i\), and
Note that if \(i\lambda _i\) is decreasing in i, then the bound is useful in practice. For similar conditions, see Barbour et al. [1] and Gan and Xia [10].
3 Proofs
In this section, we prove the main results presented in Sect. 2.
Proof of Theorem 2.1
Consider the Stein operator (1.3), and taking expectation with respect to W, we have
Using (2.2), the above expression leads to
Let \(W_i=W-\sum _{j\in A_i}\omega _i \eta _i=W-\eta _{A_i}^{*}\) so that \(\eta _i\) and \(W_i\) are independent random variables. Therefore,
Next, let \(W_i^*=W-\sum _{j\in B_i}\omega _i \eta _i=W-\eta _{B_i}^{*}\) so that \(\eta _i\) and \(\eta _{A_i}\) are independent of \(W_i^*\). Also, observe that
Multiply \({\mathbb {E}}[\Delta g(W+1)]\) in (3.3) and using the corresponding expression in (3.2), we get
Hence,
Using (1.2), the proof follows.
Proof of Theorem 2.2
Let \(A_i=B_i=\{i\}\), then \(\{\eta _i, i\in J\}\) becomes independent random variables, and \(W_i=W_i^*\) is independent of \(\eta _{A_i}=\eta _{B_i}=\eta _i\). Therefore, from (3.4), we have
Case I: If \(\omega _i=1\), then
Case II: If \(\omega _i \ge 2\), then
It is shown that in Barbour and Xia [5] (see also Barbour and Čekanavičius [4], p. 517) \(|{\mathbb {E}}(\Delta ^2 g(W_i+\cdot ))|\le \gamma \Vert \Delta g\Vert \). Hence, from (3.6) and (3.7), we have
Using (1.2), the proof follows. \(\square \)
References
Barbour, A.D., Chen, L.H.Y., Loh, W.L.: Compound poisson approximation for nonnegative random variables via Stein’s method. Ann. Prob. 20(4), 1843–1866 (1992)
Barbour, A.D., Hall, P.: On the rate of Poisson convergence. Math. Proc. Camb. Philos. Soc. 95(3), 473–480 (1984)
Barbour, A.D., Holst, L., Janson, S.: Poisson Approximation. Oxford University Press, Oxford (1992)
Barbour, A.D., Čekanavičius, V.: Total variation asymptotes for sum of independent integer random variables. Ann. Prob. 30(2), 509–545 (2002)
Barbour, A.D., Xia, A.: Poisson perturbation. ESAIM Probab. Stat. 3, 131–150 (1999)
Bhati, D., Rattihalli, R.N.: Distributions of sums of geometrically weighted finite valued discrete random variables. ProbStat Forum 7(January), 12–20 (2014)
Chow, Y.S., Lai, T.L.: Limiting behavior of weighted sums of independent random variables. Ann. Prob. 1(5), 810–824 (1973)
Eichelsbacher, P., Reinert, G.: Stein’s method for discrete Gibbs measures. Ann. Appl. Probab. 18(4), 1588–1618 (2008)
Etemadi, N.: Convergence of weighted averages of random variables revisited. Proc. Am. Math. Soc. 134(9), 2739–2744 (2006)
Gan, H.L., Xia, A.: Stein’s method for conditional compound Poisson approximation. Stat. Probab. Lett. 100, 19–26 (2015)
Godbole, A.P.: Approximate reliabilities of \(m\)-consecutive-\(k\)-out-of-\(n\): failure systems. Stat. Sinica 1, 321–327 (1993)
Huang, W.T., Tsai, C.S.: On a modified binomial distribution of order \(k\). Stat. Probab. Lett. 11(2), 125–131 (1991)
Kerstan, J.: Verallgemeinerung eines Satzes von Prochorow und Le Cam. Z. Wahrscheinlichkeitstheorie und Verw. Gebiete 2, 173–179 (1964)
Kumar, A.N., Upadhye, N.S., Vellaisamy, P.: Approximations related to the sums of \(m\)-dependent random variables. Preprint arXiv:2005.00780 (2020)
Le Cam, L.: An approximation theorem for the Poisson binomial distribution. Pac. J. Math. 10, 1181–1197 (1960)
Ley, C., Reinert, G., Swan, Y.: Stein’s method for comparison of univariate distributions. Probab. Surv. 14, 1–52 (2017)
Neammanee, K., Yonghint, N.: Poisson approximation for call function via Stein-Chen method. Bull. Malays. Math. Sci. Soc. 43, 1135–1152 (2020)
Olvera-Cravioto, M.: Asymptotics for weighted random sums. Adv. Appl. Probab. 44(4), 1142–1172 (2012). https://doi.org/10.1239/aap/1354716592
Röllin, A.: Symmetric and centered binomial approximation of sums of locally dependent random variables. Electron. J. Probab. 13(24), 756–776 (2008)
Stein, C.: A bound for the error in the normal approximation to the distribution of a sum of dependent random variables. In: Proc. Sixth Berkeley Symp. Math. Statist. Probab. II. Probability Theory, pp. 583–602. Univ. California Press, Berkeley
Teerapabolarn, K.: Negative binomial approximation for independent negative binomial variables. Appl. Math. Sci. 9(5), 239–241 (2015)
Upadhye, N.S., Barman, K.: A unified approach to Stein’s method for stable distributions. Preprint arXiv:2004.07593 (2020)
Upadhye, N.S., Čekanavičius, V., Vellaisamy, P.: On Stein operators for discrete approximations. Bernoulli 23(4A), 2828–2859 (2017)
Čekanavičius, V., Roos, B.: Two-parametric compound binomial approximations. Lith. Math. J. 14(4), 354–374 (2004)
Vellaisamy, P.: Poisson approximation for \((k_1, k_2)\)-events via the Stein-Chen method. J. Appl. Probab. 41(4), 1081–1092 (2004)
Vellaisamy, P., Upadhye, N.S., Čekanavičius, V.: On negative binomial approximation. Theory Probab. Appl. 57(1), 97–109 (2013)
Yonghint, N., Neammanee, K., Chaidee, N.: Poisson approximation for locally dependent CDO. Comm. Statist. Theory Methods (2020). https://doi.org/10.1080/03610926.2020.1759638
Zhengyan, L.: Laws of large numbers for weighted sums of random variables and random elements. Acta Math. Sin. 5(2), 185–192 (1989)
Acknowledgements
The author would like to thank Dr. Neelesh S. Upadhye for helpful comments and suggestions. The author is grateful to the associate editor and reviewers for many valuable suggestions and critical comments that improved the presentation of the paper.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Kumar, A.N. Approximations to Weighted Sums of Random Variables. Bull. Malays. Math. Sci. Soc. 44, 2447–2464 (2021). https://doi.org/10.1007/s40840-021-01077-z
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40840-021-01077-z
Keywords
- Locally dependent random variables
- Pseudo-binomial and negative binomial approximations
- Error bounds
- Stein’s method