Abstract
In this paper, we use the Linex loss function to derive the Bayesian estimate of the parameter of the exponential distribution based on ranked set sampling. Under this setup, we use both conjugate and Jeffreys prior distributions. To assess the efficiency of the obtained estimates, we compute the bias and mean squared error of the derived estimates and compare them with those based on the corresponding simple random sample through Monte Carlo simulations.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
Ranked set sampling enables one to provide more structure to the collected sample items and use this structure to develop efficient inferential procedures. This approach to data collection was first proposed by McIntyre ([11, 12]) for situations where taking the actual measurements for sample observations is difficult (may be costly, destructive, time-consuming), but mechanisms for either informally or formally ranking a set of sample units are relatively easy and reliable.
For discussions of some of the settings where ranked set sampling techniques have found applications, one may refer to Patil [13], Barnett and Moore [6], and Chen et al. [9]. During the last four decades, a good deal of attention has been devoted to this topic in the statistical literature. Some of this work has been geared toward specific parametric families. Many authors have used the ranked set sampling for estimating the unknown parameters of some distributions; for example, see Adatia [1] for the half-logistic distribution and Shaibu and Muttlak [16] for normal, exponential, and gamma distributions. Al-Hadhrami et al. [2] have studied the estimator of standard deviation of normal distribution using moving extreme ranked set sampling, while Al-Odat [3] has suggested a modification of estimating a ratio in rank set sampling. Sinha et al. [17] have proposed best linear unbiased estimators (BLUEs) of the parameters of the normal and exponential distributions under RSS. Stokes [18] has studied the maximum likelihood estimators under RSS of the parameters of the location-scale family. Sengupta and Mukhuti [15] have presented some unbiased estimators which are better than the nonparametric minimum variance quadratic unbiased estimator based on a balanced ranked set sample as well as the uniformly minimum variance unbiased estimator based on a simple random sample (SRS) of the same size. Jemain et al. [10] have studied the multistage median ranked set sampling for estimating the population median. Al-Saleh et al. [4] have obtained the Bayesian estimate of the exponential parameter using squared error loss function. In this paper, we use the linex loss function to derive an explicit form of the Bayesian estimate of the exponential distribution under ranked set sampling.
In Sect. 2, we present some preliminary details. In Sect. 3, we derive the Bayesian estimates of the exponential parameter based on gamma and Jefferys prior distributions. In Sect. 4, we develop an alternative procedure for deriving the Bayesian estimates. Finally, in Sect. 5, we present that some numerical results demonstrate the usefulness of the results developed here.
2 Preliminaries
Let \(X_1, X_2, \ldots , X_n\) be a sequence of independent and identically distributed (iid) random variables with probability density function \( f(x; \theta ) \) and cumulative distribution function \(F(x;\theta ) \), where \(\theta \) has a prior density function \(\Pi (\theta ).\) This sequence will be referred to here as a Simple Random Sample (SRS). Let
be the visual (judgment) order statistics of \(s\) sets, each is based on a simple random sample of size \(n.\) This is observed specifically as follows. A set of \(n\) items is drawn from the population, the items of the set are ranked by judgment, and only the item ranked the smallest is quantified. Then another set of size \(n\) is drawn, then ranked, and only the item ranked the second smallest is quantified. The procedure is repeated in this way until the item ranked the largest in the \(n\)-th set is quantified. This completes one cycle of this sampling. The cycle may be repeated \(m\) times until \(nm\) units have been quantified and these \(nm\) units form the RSS data.
Let \(Y_1, Y_2, \ldots , Y_s \) be a RSS from this distribution obtained using a full data of \(sn\) observations. It is assumed through out this paper that the judgmental identification of the ranks is perfect and at negligible cost. This assumption is made for many developments on RSS. Under this assumption, \(Y_i\) has the same distribution as \(X_{i:n}\) which is the \(i^{th}\) order statistic in a random sample of size \(n\) with pdf
Now, we assume that we have a RSS from an exponential distribution with parameter \(\theta \) with density function
In the Bayesian setup, the choice of the loss function is an important part, and it is well known that most studies use the squared error loss function (SEL) for measuring an estimators’ performance; see Box and Tiao [8] and Berger [7]. This is due to its simplicity and relevance to classical procedures. But, the squared error loss function is justified only when losses are symmetric in nature. The symmetric nature of this function gives equal weight to over-estimation as well as under-estimation. In the estimation of the survival function or reliability function, such a symmetric loss function may be inappropriate. A number of asymmetric loss functions have been discussed in the literature, but among these asymmetric losses, Linear-exponential (LINEX) loss function is widely used as it is a natural extension of the squared error loss function (SEL). It was originally introduced by Varian [19] and was popularized by Zellner [20].
The LINEX loss function for \(\theta \) can be expressed as
where \(\Delta =({\theta }^*-\theta )\), and \({\theta }^* \) is an estimate of \(\theta .\) The sign and magnitude of the shape parameter \(C\) represent the direction and degree of symmetry, respectively. When value of \(C \) is less than zero, the LINEX loss function gives more weight to under-estimation against over-estimation, and the situation is reversed when the value of \(C \) is greater than zero. For \(C\) close to zero, the LINEX loss is approximately squared error loss.
In order to develop the Bayesian analysis in the case at hand, the conjugate prior for \(\theta \) is considered, i.e., \(\theta \sim Gamma(\alpha , \beta ),\) whose probability density function is given by
where \( \alpha >0\) and \(\beta >0\) are the hyperparameters. If \(\alpha =\beta =0,\) the prior (2.3) becomes the Jeffreys prior, which is given by
3 Bayes Estimates
In this section, we derive the Bayes estimates of the exponential parameter \(\theta \) based on both SRS and RSS. In each case, we use both conjugate prior and the non-informative prior for the scale parameter. Also, we consider both the symmetric loss function (squared error loss) and asymmetric loss function (Linear-exponential, LINEX) to derive the corresponding Bayesian estimates. Throughout the paper, let \(\pi (\theta |\underline{X})\) and \(\pi (\theta |\underline{Y})\) denote the posterior densities of \(\theta \), given SRS \((\underline{X})\) and RSS \((\underline{Y})\), respectively.
3.1 Bayes Estimate Based on SRS
Let \(x_1, x_2, \ldots , x_n\) be a random sample from the exponential distribution with parameter \(\theta \) in (2.1), and \(g(\theta )\) be the conjugate prior in (2.3). In this case, the posterior density based on SRS can be written as
Hence, the Bayesian estimatie of \(\theta \) based on the squared error loss function is given by
while the Bayesian estimation of \(\theta \) based on the LINEX loss function is given by
where
and consequently
3.2 Bayes Estimate Based on RSS
Now, let \(y_1, y_2, \ldots , y_n\) be a one-cycle RSS from the exponential distribution in (2.1) and the prior density of \(\theta \) be as in (2.3). The density of the \(jth\) order statistic \(Y_j\) is known to be (Arnold et al. [5])
where \(c_k(j)=j {n \atopwithdelims ()j}{j-1 \atopwithdelims ()k} (-1)^k\) and \(h_k(y_j|\theta )=\theta \;(e^{-\theta y_j})^{n-j+k+1}.\)
Then, the joint density of the RSS in this case, due to the independence of \(y_i's\), is given by
Hence, the posterior density can be derived as
and the Bayesian estimate of \(\theta \) based on the squared error loss function is then obtained from (3.4) as
Next, in order to derive the Bayesian estimate of \(\theta \) based on the LINEX loss function, we need to calculate the posterior expectation of \(e^{-C\theta }\) from (3.4) as
Then from (3.6), the Bayesian estimate of \(\theta \) based on the LINEX loss function is given by
where \(E[e^{C\theta }]\) is as derived in Eq. (3.6).
3.3 Bayes Estimates Based on Non-informative Prior
Let \(\theta \) have a non-informative Jefferys prior in Eq. (2.4). Then, we obtain the Bayesian estimates of \(\theta \) in this case as follows:
-
1.
SRS
$$\begin{aligned} \widetilde{\theta }_{\textit{SEL}}^J(\underline{X})= \frac{1}{\overline{X}} \end{aligned}$$(3.8)and
$$\begin{aligned} \widetilde{\theta }_{\textit{LINEX}}^J(\underline{X})= - \frac{1}{C}\ln \Bigl [ \Bigl (1+ \frac{C}{n \overline{X} }\Bigr )^{-n}\Bigr ]. \end{aligned}$$(3.9) -
2.
RSS
$$\begin{aligned} \widetilde{\theta }_{\textit{SEL}}^J (\underline{Y}) = \frac{n \; {\displaystyle {\sum _{i_1=0}^{0} \sum _{i_2=0}^{1} \cdots \sum _{i_n=0}^{n-1}}} \Bigl [ {\displaystyle {\prod _{j=1}^n}} \;c_{i_j}(j)\Bigr ] {\bigl [{\displaystyle {\sum _{j=1}^n}} y_j(n-j+i_j+1)\bigr ]^{-(n+1)}}}{{\displaystyle {\sum _{i_1=0}^{0} \sum _{i_2=0}^{1} \cdots \sum _{i_n=0}^{n-1} }} \;\Bigl [ {\displaystyle {\prod _{j=1}^n}} \;c_{i_j}(j)\Bigr ] \; \bigl [{\displaystyle {\sum _{j=1}^n}} y_j(n-j+i_j+1)\bigr ]^{-n}} \end{aligned}$$(3.10)and
$$\begin{aligned} \widetilde{\theta }_{\textit{LINEX}}^J(\underline{Y})= - \frac{1}{C}\ln \left[ \frac{n {\displaystyle {\sum _{i_1=0}^{0} \sum _{i_2=0}^{1} \cdots \sum _{i_n=0}^{n-1}}} \Bigl [ {\displaystyle {\prod _{j=1}^n}} \;c_{i_j}(j)\Bigr ] {\bigl [{\displaystyle {\sum _{j=1}^n}} y_j(n-j+i_j+1)+C\bigr ]^{-(n+1)}}}{{\displaystyle {\sum _{i_1=0}^{0} \sum _{i_2=0}^{1} \cdots \sum _{i_n=0}^{n-1} }} \;\Bigl [ {\displaystyle {\prod _{j=1}^n}} \;c_{i_j}(j)\Bigr ] \; \bigl [{\displaystyle {\sum _{j=1}^n}} y_j(n-j+i_j+1)\bigr ]^{-n}}\right] . \end{aligned}$$(3.11)
3.4 Bayes Estimates Based on \(m\)-Cycle RSS
Based on \(m\) cycles, let
be the \(m\)-cycle RSS from the exponential distribution in Eq. (2.1) and the prior of \(\theta \) be as in Eq. (2.4). Then, the joint density in this case is given by
where
and
Hence, the posterior density can be expressed as
From (3.12), the Bayesian estimate of \(\theta \) based on the squared error loss function is obtained as
while the Bayesian estimate of \(\theta \) based on the LINEX loss function is obtained to be
Upon using the non-informative Jefferys prior in (2.4), we derive the Bayesian estimates based on the squared error and LINEX loss functions to be
and
respectively.
4 Alternative Procedure
In this section, we propose an alternative procedure for deriving the Bayesian estimates, which is simple in nature and reduces the amount of numerical calculation quite considerably for finding the estimates. Using the independent spacings property of the exponential distribution (see Arnold et al. [5]) and then by employing the partial fractions (see Sen and Balakrishnan [14]), we can rewrite the density of the \(j^{th}\) order statistic \(Y_j\) as
where \( H_k(j)=\prod \limits _{\ell =1,\ell \ne k }^j \frac{\ell }{\ell -k}=(-1)^{k-1}\; {j \atopwithdelims ()k}\). Then, the joint density for \(m\)-cycle RSS can be expressed as
where we use the notation
and
Then, the Bayesian estimates of \(\theta \) based on the gamma conjugate prior are obtained as follows:
and
Similarly, the Bayesian estimates of \(\theta \) based on Jefferys prior are obtained as follows:
and
5 Numerical Results
In order to demonstrate the usefulness of the Bayesian estimates based on both SRS and RSS derived in the preceding sections (for the RSS, we use the alternative procedure as in Sect. 4), we carry out Monte Carlo simulations using the following steps:
-
1.
Generate SRS and RSS samples of size \(n\) from the exponential distribution for the case when \(m=1\) (one cycle is used in many applications).
-
2.
Calculate the Bayesian estimates given derived in in Sect. 3 using the SRS and RSS samples;
-
3.
Repeat Steps 1 and 2 for 1,000 runs;
-
4.
Then calculate the bias and mean squared error (MSE) of all the estimates.
The results so obtained, for the cases \(n=3(1)6, \theta =2, \ \alpha =1, \ \beta =1\), and \(C=1,-1\), are all presented in Tables 1 and 2.
From Table 1, we first of all observe that the Bayesian estimates of \(\theta \) are all biased. Next, we observe that the estimates based on the informative gamma prior are less biased than the corresponding estimates based on Jefferys non-informative prior. Quite importantly, we finally observe that the Bayesian estimates based on RSS are considerably less biased than the corresponding Bayesian estimates based on SRS.
From Table 2, we first note that the mean squared error of all estimates decrease when \(n\) increases, as one would expect. Next, we observe that the mean squared error of the Bayesian estimates based on the informative gamma prior is in general less than the corresponding values for the estimates based on Jeffereys non-informative prior. Finally, we observe that the Bayesian estimates based on RSS have a much smaller mean squared error than the corresponding Bayesian estimates based on RSS in all cases considered. This clearly demonstrates the efficiency of inference based on RSS and also the usefulness of the Bayesian estimates based on RSS developed here for the scale parameter of the exponential distribution.
References
Adatia, A.: Estimation of parameters of the half-logistic distribution using generalized ranked set sampling. Comput. Statist. Data Anal. 33, 1–13 (2000)
Al-Hadhrami, S.A., Al-Omari, A.I., Al-Saleh, M.F.: Estimation of standard deviation of normal distribution using moving extreme ranked set sampling. Proc. Acad. Sci. Eng. Technol. 37, 988–993 (2009)
Al-Odat, N.A.: Modification in ratio estimator using rank set sampling. Eur. J. Sci. Res. 29(2), 265–268 (2009)
Al-Saleh, M.F., Al-Shrafat, K., Muttlak, H.: Bayesian estimation using ranked set sampling. Biom. J. 42, 489–500 (2000)
Arnold, B.C., Balakrishnan, N., Nagaraja, H.N.: A First Course in Order Statistics. Wiley, New York (1992)
Barnett, V., Moore, K.: Best linear unbiased estimates in ranked-set sampling with particular reference to imperfect ordering. J. Appl. Stat. 24, 697–710 (1997)
Berger, J.O.: Statistical Decision Theory and Bayesian Analysis. Springer-Verlag, New York (1985)
Box, G.E.P., Tiao, G.C.: Bayesian Inference in Statistical Analysis. Addison-Wesley, New York (1973)
Chen, Z., Bai, Z., Sinha, B.K.: Ranked Set Sampling Look. Springer-Verlag, New York (2003)
Jemain, A.A., Al-Omari, A.I., Ibrahim, K.: Multistage extreme ranked set samples for estimating the population mean. J. Stat. Theory Appl. 6, 456–471 (2007)
McIntyre, G.A.: A method for unbiased selective sampling using ranked sets. Aust. J. Agric. Res. 3, 385–390 (1952)
McIntyre, G.A.: A method of unbiased selective sampling using ranked sets. Am. Stat. 59, 230–232 (2005)
Patil, G.P.: Editorial: ranked set sampling. Environ. Ecol. Stat. 2, 271–285 (1995)
Sen, A., Balakrishnan, N.: Convolution of geometrics and a reliability problem. Stat. Probab. Lett. 43, 421–426 (1999)
Sengupta, S., Mukhti, S.: Unbiased variance estimation in a simple exponential population using ranked set samples. J. Stat. Plan. Inference 136, 1526–1553 (2006)
Shaibu, A.B., Muttlak, H.A.: Estimating the parameters of normal, exponential and gamma distributions using median and extreme ranked set samples. Statistica LXIV, 75–98 (2004)
Sinha, B.K., Sinha, B.K., Purkayastha, S.: On some aspects of ranked set sampling for estimation of normal and exponential parameters. Stat. Decis. 14, 223–240 (1996)
Stokes, S.L.: Parametric ranked set sampling. Ann. Inst. Stat. Math. 47, 465–482 (1995)
Varian, H.R.: A Bayesian approach to real estate assessment. In: Feinberg, S.E., Zellner, A. (eds.) Studies in Bayesian Econometrics and Statistics in Honor of L. J. Savage, pp. 195–208. Amsterdam, North-Holland (1975)
Zellner, A.: Bayesian estimation and prediction using asymmetric loss functions. J. Am. Stat. Assoc. 81, 446–451 (1986)
Acknowledgments
The authors would like to thank the referees for their helpful comments, which improved the presentation of the paper. This project was supported by King Saud University, Deanship of Scientific Research, College of Science Research Center.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Ataharul M. Islam.
Rights and permissions
About this article
Cite this article
Sadek, A., Sultan, K.S. & Balakrishnan, N. Bayesian Estimation Based on Ranked Set Sampling Using Asymmetric Loss Function. Bull. Malays. Math. Sci. Soc. 38, 707–718 (2015). https://doi.org/10.1007/s40840-014-0045-5
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40840-014-0045-5